Jobs in the United States

25+ jobs

Save this search

Added just now
Qualtrics Analytics and Insights Engineer III (CX / XM)
Deloitte US
Baltimore, MD · Boston, MA · Hartford, CT · Jericho, NY · Jersey City, NJ · McLean, VA · Mechanicsburg, PA · Morristown, NJ · NY · Philadelphia, PA · Pittsburgh, PA · Princeton, NJ · Richmond, VA · Rochester, NY · Rosslyn, VA · Stamford, CT · Washington, DC · Williamsville, NY
As an Analytics and Insights Engineer III on the Customer Strategy & Design team, you will be responsible for:
Added 1 min ago
HPC AI Solution Architect (S2S)
Deloitte US
Atlanta, GA · Charlotte, NC · Chicago, IL · Costa Mesa, CA · Dallas, TX · Detroit, MI · Hartford, CT · Houston, TX · Kansas City, MO · Los Angeles, CA · McLean, VA · Minneapolis, MN · Nashville, TN · NY · Philadelphia, PA · Princeton, NJ · Raleigh, NC · Richmond, VA · Sacramento, CA · San Jose, CA · Seattle, WA · St. Louis, MO · Stamford, CT · Tampa, FL
As a Lead Cloud Integrated Infra Engineer on the Silicon2Service team in Deloitte’s AI & Engineering practice, you will design and drive deployment of fully integrated architectures for…
Added 1 min ago
Senior, Full Stack Engineer - Tax Transformation
Deloitte US
Atlanta, GA · Boston, MA · Charlotte, NC · Chicago, IL · Costa Mesa, CA · Dallas, TX · Denver, CO · Grand Rapids, MI · Hartford, CT · Lake Mary, FL · Los Angeles, CA · McLean, VA · NY · Philadelphia, PA · Pittsburgh, PA · Raleigh, NC · Rosslyn, VA · San Diego, CA · San Francisco, CA · Seattle, WA · Tampa, FL · Washington, DC
As a Deloitte Tax Full Stack Engineer, Senior you’ll design, develop, and deploy cutting-edge web applications and features that solve key business challenges. You’ll work hands-on across…
Added 1 min ago
Senior Network Engineer (Route & Switch)
Deloitte US
Dallas, TX · Westlake, TX
Provide technical services in the areas of computer hardware and software. Administers, configures, monitors and tests application servers for business and network operations. Provides…
Added 1 min ago
Lead Application Systems Engineer
Deloitte US
Dallas, TX · Westlake, TX
Provide technical services in the areas of computer hardware and software for both the hotel and the internal employees located at Deloitte University. Administers, configures, monitors and…
Added 1 min ago
Data Engineer
Deloitte US
Atlanta, GA · Baltimore, MD · Bellevue, WA · Birmingham, AL · Boise, ID · Boston, MA · Charlotte, NC · Cincinnati, OH · Cleveland, OH · Costa Mesa, CA · Dallas, TX · Davenport, IA · Des Moines, IA · Fort Worth, TX · Fresno, CA · Grand Rapids, MI · Hartford, CT · Hermitage, TN · Jacksonville, FL · Jericho, NY · Jersey City, NJ · Kansas City, MO · Lansing, MI · Las Vegas, NV · Louisville, KY · McLean, VA · Memphis, TN · Miami, FL · Midland, MI · Milwaukee, WI · Morristown, NJ · NY · Philadelphia, PA · Princeton, NJ · Raleigh, NC · Richmond, VA · Rochester, NY · Sacramento, CA · Salt Lake City, UT · San Francisco, CA · San Jose, CA · St. Louis, MO · Stamford, CT · Tampa, FL · Tempe, AZ · Washington, DC
…work in a collaborative environment? As an experienced Data Engineer you will have the ability to share new ideas and collaborate on projects as a consultant without the extensive demands…
Added 22 mins ago
Senior Civil or Environmental Engineering Project Manager
SCS Engineers
Green Bay, WI
Coordinate staffing to complete quality work/projects.
Added 24 mins ago
TT
Founding Backend Software Engineer
True Talent Solutions Partners
San Francisco, CA
- $225,000 to $275,000 USD / year
Join a small team building generative AI technology for video creation. As a founding backend engineer, you will shape core systems and technical practices while working closely with…
Added 26 mins ago
AE
Campus Graduate Masters Summer Internship Program - 2027 AI Engineer, Enterprise Technology Services- Sunrise, FL
American Express
Sunrise, FL
- $24.05 to $63 USD / hour
At American Express, we empower future technologists to learn, innovate, and make an impact from day one. As an AI Engineer Intern in Enterprise Technology Services, you’ll join a 10-week…
Added 26 mins ago
AE
Campus Graduate Masters Summer Internship Program - 2027 Software Engineer, Enterprise Technology Services- Sunrise, FL
American Express
Sunrise, FL
- $24.05 to $63 USD / hour
At American Express, we empower future technologists to learn, innovate, and make an impact from day one. As a Software Engineer Intern, you’ll join a 10-week Summer Internship Program and…
Added 26 mins ago
AE
Campus Undergraduate Full-Time Engineer - 2027 Software Engineer I, Enterprise Technology Services- Sunrise, FL
American Express
Sunrise, FL
- $78,000 to $124,750 USD / year
- Full-time
At American Express, we empower technologists to learn, innovate, and make an impact from day one. As a Software Engineer in the full-time Technology Graduate Program, you’ll join a…
Added 26 mins ago
AE
Campus Undergraduate Full-Time Engineer - 2027 AI Engineer I, Enterprise Technology Services- Sunrise, FL
American Express
Sunrise, FL
- $78,000 to $124,750 USD / year
- Full-time
At American Express, we empower technologists to learn, innovate, and make an impact from day one. As an AI Engineer I in Enterprise Technology Services, you’ll join a full-time graduate…
Added 26 mins ago
AE
Campus Graduate Masters Full-Time Engineer - 2027 Software Engineer II, Enterprise Technology Services- Sunrise, FL
American Express
Sunrise, FL
- $89,250 to $150,250 USD / year
- Full-time
At American Express, we empower technologists to learn, innovate, and make an impact from day one. As a Software Engineer in the full-time Technology Graduate Program, you’ll join a…
Added 26 mins ago
AE
Campus Graduate Masters Full-Time Engineer - 2027 AI Engineer I, Enterprise Technology Services- Sunrise, FL
American Express
Sunrise, FL
- $78,000 to $124,750 USD / year
- Full-time
At American Express, we empower technologists to learn, innovate, and make an impact from day one. As an AI Engineer I in Enterprise Technology Services, you’ll join a full-time graduate…
Added 27 mins ago
Manufacturing Engineer - Machined Components
Teledyne
Daytona Beach, FL
…include aerospace and defense, factory automation, air and water quality environmental monitoring, electronics design and development, oceanographic research, deepwater oil and gas…
Added 27 mins ago
Apps Development Group Manager - Senior Vice President
Citigroup
Tampa, FL
The Digital Software Engineering Lead Analyst is a strategic technical leader responsible for designing and engineering enterprise grade Agentic AI solutions capable of integrating data…
Added 27 mins ago
C
Associate Controls Engineer
Carrier
Orlando, FL
- $53,000 to $106,000 USD / year
As a Controls Engineer, you’ll be an expert voice on-site- performing difficult and complex engineering activities and creating standard work for common procedures.
Added 39 mins ago
Senior Software Engineer
Kimedics, LLC
United States
The Senior Engineer is a highly capable individual contributor who leads the technical delivery of significant features and projects within their team. This role applies deep expertise to…
Added 1 hour ago
C
Field Engineer - Automated Logic
Carrier
Clifton, NJ
- $53,000 to $106,000 USD / year
…utility, operating and maintenance costs, and improve indoor air quality, occupant comfort, and productivity. Technology that supports the buildings and industry of today and tomorrow…
Added 1 hour ago
C
Field Engineer - Automated Logic
Carrier
Clifton, NJ
- $53,000 to $106,000 USD / year
…utility, operating and maintenance costs, and improve indoor air quality, occupant comfort, and productivity. Technology that supports the buildings and industry of today and tomorrow…
Added 1 hour ago
Lead Front End Software Engineer - Vice President
Citigroup
Jersey City, NJ
As a Lead Front End Software Engineer, you will drive the design and delivery of modern web applications using JavaScript and Angular within Citi's Technology organization. You will own the…
Added 1 hour ago
Submarine Acoustics Install Management Logistics Engineer, Senior
BOOZ, ALLEN & HAMILTON, INC.
Washington, DC
As a logistics engineer on our Naval Acquisition Portfolio team, you'll provide expertise in sonar hardware and software installation management and sustainment. You'll use your findings to…
Added 1 hour ago
Electrical QA/QC- Data Center
Actalent
Port Washington, WI
…Full-TimeAbout the OpportunityWe are seeking a motivated Project Engineer to join the project team in Mount Pleasant, Wisconsin. This role offers the opportunity to work on a large-scale,…
Added 1 hour ago
Project Engineer- Data Center Construction
Actalent
Port Washington, WI
…Full-TimeAbout the OpportunityWe are seeking a motivated Project Engineer to join the project team in Mount Pleasant, Wisconsin. This role offers the opportunity to work on a large-scale,…
Added 2 hours ago
AI Engineer
Thesis
NY
…and reduce repetitive operational work. We're looking for an engineer who can turn those experiments into reliable systems that people use every…

Lead Research Engineer – AI Evaluation & Benchmarking

Eagan, MN, United States
Frisco, TX, United States
NY, United States
Ann Arbor, MI, United States

Apply

Applications open in a new tab.

Job details

Apply by: Dec 31, 2026
Experience: 8-10+ years of relevant software engineering experience, including building and maintaining production systems involving machine learning or complex data.
Posting language: English
Posted: Oct 30, 2026

Original job description

Job Description

Thomson Reuters Labs is seeking a Lead Research Engineer to lead the design and delivery of production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable evaluation infrastructure that enables research and product teams to compare large language models (LLMs), measure quality, cost, and latency, and make informed decisions about model selection and development. You will own the engineering approach from early prototypes through reliable, maintainable tools, collaborating closely with research scientists, engineering teams, and product partners while helping shape technical direction and engineering delivery.

Key Responsibilities

Lead technical delivery and engineering planning: Partner with program and research leaders to define priorities, break projects into delivery stages, estimate effort and cost, recommend staffing and required skills, identify dependencies, and adapt plans to available resources.
Design and build scalable evaluation infrastructure: Extend existing shared tools and services, design new components where needed, and develop production-quality Python software, APIs, and reusable evaluation frameworks. Deliver useful initial versions, validate them with users, and improve them through iterative development.
Turn research methods into working software: Collaborate with scientists to build automated evaluation pipelines connecting model APIs, test datasets, and agreed scoring methods. Implement reliable workflows for comparing LLMs and other AI models using evaluation datasets relevant to products and customer needs.
Ensure reliable, reproducible model comparisons: Maintain repeatable experiments, separate evaluation data from model development, and make results traceable to evaluation inputs and methods. Measure model quality, operating cost, and latency to support product teams in validating model performance.
Build practical tools for researchers and product teams: Develop clear user interfaces, documentation, evaluation reports, and diagnostic capabilities. Enable scientists and product teams to run evaluations, understand failures, interpret results, and extend tools without depending on the original developer.
Own production reliability, performance, and responsible data use: Integrate automated testing, deployment, and monitoring from the beginning. Address performance, scalability, and operating costs, establish service maintenance and support ownership, and work with data specialists to implement access controls, permitted-use rules, and retention requirements.
Collaborate, mentor, and guide engineering decisions: Partner with foundational research, data engineering, platform engineering, and product teams to align interfaces, responsibilities, and delivery plans. Resolve technical dependencies, mentor engineers, communicate trade-offs and delivery risks, and recommend changes to scope or technical approach when necessary.

Required Qualifications

8-10+ years of relevant software engineering experience, including building and maintaining production systems involving machine learning or complex data.
Strong hands-on Python programming skills, including API design, automated testing, and working with structured and unstructured data.
Technical leadership and end-to-end delivery experience, including architecture decisions, engineering planning, staffing and effort estimation, project execution, and adapting priorities as requirements change.
Experience collaborating with research scientists or machine learning practitioners to translate experiments and research methods into working software.
Experience integrating or testing machine learning models, interpreting evaluation results, and applying findings to engineering decisions. Understanding of language models and the ability to recognize unreliable comparisons or test-data leakage.
Cloud engineering experience using AWS, Azure, or a comparable platform, including distributed workflows, automated deployment, and monitoring.
Working knowledge of SQL and experience developing software that processes structured and unstructured data.
Strong collaboration, communication, problem-solving, and mentoring skills, with experience coordinating technical delivery across research, engineering, and product stakeholders.
Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.

Preferred Qualifications

Experience building LLM evaluation and benchmarking pipelines, including automated scoring methods and human assessment workflows.
Familiarity with experiment tracking, dataset versioning, and reproducible evaluation processes.
Experience in natural language processing, information retrieval, or other applications involving complex text.
Experience reducing model inference or operating costs while maintaining evaluation quality and system performance.
A track record of developing reusable software libraries, frameworks, or tools adopted by other engineering teams.
Research contributions or open-source software contributions.

This posting is for proactive recruitment purposes and may be used to fill current openings or future vacancies within our organization. What’s in it For You?

Hybrid Work Model: We’ve adopted a flexible hybrid working environment for our office-based roles while delivering a seamless experience that is digitally and physically connected.
Flexibility & Work-Life Balance: Flex My Way is a set of supportive workplace policies designed to help manage personal and professional responsibilities, whether caring for family, giving back to the community, or finding time to refresh and reset. This builds upon our flexible work arrangements, including work from anywhere for up to 8 weeks per year, empowering employees to achieve a better work-life balance.
Career Development and Growth: By fostering a culture of continuous learning and skill development, we prepare our talent to tackle tomorrow’s challenges and deliver real-world solutions. Our Grow My Way programming and skills-first approach ensures you have the tools and knowledge to grow, lead, and thrive in an AI-enabled future.
Industry Competitive Benefits: We offer comprehensive benefit plans to include flexible vacation, two company-wide Mental Health Days off, access to the Headspace app, retirement savings, tuition reimbursement, employee incentive programs, and resources for mental, physical, and financial wellbeing.
Culture: Globally recognized, award-winning reputation for inclusion and belonging, flexibility, work-life balance, and more. We live by our values: Obsess over our Customers, Compete to Win, Challenge (Y)our Thinking, Act Fast / Learn Fast, and Stronger Together.
Social Impact: Make an impact in your community with our Social Impact Institute. We offer employees two paid volunteer days off annually and opportunities to get involved with pro-bono consulting projects and Environmental, Social, and Governance (ESG) initiatives.
Making a Real-World Impact: We are one of the few companies globally that helps its customers pursue justice, truth, and transparency. Together, with the professionals and institutions we serve, we help uphold the rule of law, turn the wheels of commerce, catch bad actors, report the facts, and provide trusted, unbiased information to people all over the world.

Our use of AI within the recruitment process Thomson Reuters utilizes Artificial Intelligence (AI) to support parts of our global recruitment process. Unless you opt-out, our AI system will assess the information provided by you and compare it to the requirements listed for the role, and present the result to our recruitment personnel for further review. The AI system acts as a supporting tool, but there is always a human making the decision if you will be considered for the role.

In the United States, Thomson Reuters offers a comprehensive benefits package to our employees. Our benefit package includes market competitive health, dental, vision, disability, and life insurance programs, as well as a competitive 401k plan with company match. In addition, Thomson Reuters offers market leading work life benefits with competitive vacation, sick and safe paid time off, paid holidays (including two company mental health days off), parental leave, sabbatical leave. These benefits meet or exceeds the requirements of paid time off in accordance with any applicable state or municipal laws. Finally, Thomson Reuters offers the following additional benefits: optional hospital, accident and sickness insurance paid 100% by the employee; optional life and AD&D insurance paid 100% by the employee; Flexible Spending and Health Savings Accounts; fitness reimbursement; access to Employee Assistance Program; Group Legal Identity Theft Protection benefit paid 100% by employee; access to 529 Plan; commuter benefits; Adoption & Surrogacy Assistance; Tuition Reimbursement; and access to Employee Stock Purchase Plan.

Thomson Reuters complies with local laws that require upfront disclosure of the expected pay range for a position. The base compensation range varies across locations.

Eligible office location(s) for this role include one or more of the following: New York City, San Francisco, Los Angeles, and/or Irvine, CA; McLean, VA; Washington, DC. The base compensation range for the role in any of those locations is $146,800 USD - $272,600 USD. For any eligible US locations, unless otherwise noted, the base compensation range for this role is $127,400 USD - $236,600 USD. For Ontario, Canada, the base compensation range for this role is $140,000 CAD - $175,000 CAD.

Base pay is positioned within the range based on several factors including an individual’s knowledge, skills and experience with consideration given to internal equity. Base pay is one part of a comprehensive Total Reward program which also includes flexible and supportive benefits and other wellbeing programs. This role may also be eligible for an Annual Bonus based on a combination of enterprise and individual performance.

About Us

Thomson Reuters informs the way forward by bringing together the trusted content and technology that people and organizations need to make the right decisions. We serve professionals across legal, tax, accounting, compliance, government, and media. Our products combine highly specialized software and insights to empower professionals with the data, intelligence, and solutions needed to make informed decisions, and to help institutions in their pursuit of justice, truth, and transparency. Reuters, part of Thomson Reuters, is a world leading provider of trusted journalism and news.

We are powered by the talents of 26,000 employees across more than 70 countries, where everyone has a chance to contribute and grow professionally in flexible work environments. At a time when objectivity, accuracy, fairness, and transparency are under attack, we consider it our duty to pursue them. Sound exciting? Join us and help shape the industries that move society forward.

As a global business, we rely on the unique backgrounds, perspectives, and experiences of all employees to deliver on our business goals. To ensure we can do that, we seek talented, qualified employees in all our operations around the world regardless of race, color, sex/gender, including pregnancy, gender identity and expression, national origin, religion, sexual orientation, disability, age, marital status, citizen status, veteran status, or any other protected classification under applicable law. Thomson Reuters is proud to be an Equal Employment Opportunity Employer providing a drug-free workplace.

Thomson Reuters makes reasonable accommodations for applicants with disabilities, including veterans with disabilities, and for sincerely held religious beliefs in accordance with applicable law. If you reside in the United States and require an accommodation in the recruiting process, you may contact our Human Resources Department at HR.Leave-Expert@thomsonreuters.com. Disability accommodations in the recruiting process may include things like a sign language interpreter, making interview rooms accessible, providing assistive technology, or other relevant accommodations. Please note this email is not intended for general recruitment questions and we will promptly respond to inquiries regarding accommodations. More information on requesting an accommodation here.

Learn more on how to protect yourself from fraudulent job postings here.

More information about Thomson Reuters can be found on thomsonreuters.com

Apply

Report this job