Jobs in the United States

25+ jobs

Save this search

Added 2 mins ago
M
Senior Business Operations Manager
Microsoft
United States
- $97,600 to $206,400 USD / year
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Added 2 mins ago
M
Senior Technical Support Engineer
Microsoft
TX · NC · Irving, TX · Charlotte, NC · Irving · Charlotte
- $86,100 to $187,400 USD / year
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Added 2 mins ago
M
Director, Relationship Marketing Ops & Capabilities
Microsoft
WA · CA · GA · NY · Redmond, WA · Mountain View, CA · Atlanta, GA · Redmond · Mountain View · Atlanta · New York
- $130,900 to $272,300 USD / year
Added 2 mins ago
M
Software Engineer
Microsoft
WA · Redmond, WA · Redmond
- $85,400 to $183,700 USD / year
…want to reshape security and empower every user, customer, and developer with a security cloud that protects them with end to end, simplified solutions. The Microsoft Security organization…
Added 2 mins ago
M
Solution Area Specialists
Microsoft
Dallas · Austin
- $107,600 to $205,600 USD / year
Added 2 mins ago
M
Senior Software Engineer
Microsoft
WA · Redmond, WA · Redmond
- $119,800 to $261,000 USD / year
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Added 2 mins ago
M
Software Engineer II & Senior Software Engineer - CoreAI Speech Team
Microsoft
WA · Redmond, WA · Redmond
- $102,100 to $202,200 USD / year
Integrate AI and agentic capabilities into data processing workflows to improve automation and developer productivity.
Added 2 mins ago
M
Site Reliability Engineer II
Microsoft
WA · Redmond, WA · Redmond
- $102,100 to $219,200 USD / year
Added 2 mins ago
M
Principal Product Manager
Microsoft
WA · CA · Redmond, WA · Mountain View, CA · Redmond · Mountain View
- $142,800 to $304,200 USD / year
Added 2 mins ago
M
Cyber Security Analyst
Microsoft
United States
- $102,100 to $219,200 USD / year
Added 2 mins ago
M
Principal Technical Program Manager
Microsoft
United States
- $142,800 to $304,200 USD / year
Added 2 mins ago
M
Senior Security Researcher
Microsoft
WA · Redmond, WA · Redmond
- $119,800 to $261,000 USD / year
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Added 2 mins ago
M
Senior Hardware Engineer
Microsoft
WA · CA · OR · Redmond, WA · Mountain View, CA · Hillsboro, OR · Redmond · Mountain View · Hillsboro
- $119,800 to $261,000 USD / year
Added 6 mins ago
CO
Corrections Officer Trainee - SCI Cambridge Springs - Female Only
Commonwealth of Pennsylvania
Cambridge Springs, PA
- $49,010 USD / year
Your application must be submitted by the posting closing date. Late applications and other required materials will not be accepted.
Added 6 mins ago
CO
Corrections Officer Trainee - SCI Phoenix
Commonwealth of Pennsylvania
Collegeville, PA
- $49,010 USD / year
Your application must be submitted by the posting closing date. Late applications and other required materials will not be accepted.
Added 6 mins ago
CO
Corrections Officer Trainee - SCI Somerset and SCI Laurel Highlands
Commonwealth of Pennsylvania
Somerset, PA
- $49,010 USD / year
Your application must be submitted by the posting closing date. Late applications and other required materials will not be accepted.
Added 6 mins ago
CO
Corrections Officer Trainee - SCI Dallas
Commonwealth of Pennsylvania
Dallas, PA
- $49,010 USD / year
Your application must be submitted by the posting closing date. Late applications and other required materials will not be accepted.
Added 6 mins ago
CO
Corrections Officer Trainee - SCI Forest
Commonwealth of Pennsylvania
Marienville, PA
- $49,010 USD / year
Your application must be submitted by the posting closing date. Late applications and other required materials will not be accepted.
Added 6 mins ago
Test Manager - Output/CCM/Document Management Systems
Jobgether
Remote, United States
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Test Manager – Output/CCM/Document Management Systems based…
Added 6 mins ago
Business Analyst - Health Insurance
Jobgether
Remote, United States
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Business Analyst – Health Insurance based in United States.
Added 6 mins ago
CO
Corrections Officer Trainee - SCI Frackville and SCI Mahanoy
Commonwealth of Pennsylvania
Frackville, PA
- $49,010 USD / year
Your application must be submitted by the posting closing date. Late applications and other required materials will not be accepted.
Added 6 mins ago
CO
Corrections Officer Trainee - SCI Houtzdale
Commonwealth of Pennsylvania
Houtzdale, PA
- $49,010 USD / year
Your application must be submitted by the posting closing date. Late applications and other required materials will not be accepted.
Added 6 mins ago
CO
Corrections Officer Trainee - SCI Albion
Commonwealth of Pennsylvania
Albion, PA
- $49,010 USD / year
Your application must be submitted by the posting closing date. Late applications and other required materials will not be accepted.
Added 6 mins ago
CO
Building Automation Systems Technician 1
Commonwealth of Pennsylvania
Annville, PA
- $46,827 to $70,592 USD / year
Your application must be submitted by the posting closing date. Late applications and other required materials will not be accepted.
Added 6 mins ago
CO
Customer Service Representative (Clerical Assistant 3)
Commonwealth of Pennsylvania
Reading, PA
- $44,273 to $66,055 USD / year
NOTE: This posting will close on November 10, 2026 or after a total of 50 applications are received, whichever occurs first.

Microsoft AI

AI Evaluation Systems Engineering Lead

Mountain View, CA, United States

$142,800 to $331,200 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $142,800 to $331,200 USD / year
Posting language: English
Posted: Sep 29, 2026

Original job description

Overview

Microsoft AI is looking for a hands-on engineering lead to build the evaluation infrastructure that helps researchers improve frontier models and make reliable release decisions. You will lead the Eval Systems team, building systems that turn model checkpoints into trustworthy results - quickly, reproducibly, and at scale.

The role combines deep technical work with team leadership. You will shape the architecture and roadmap, contribute to implementation, and hire and develop engineers. Working closely with research, training, and inference teams, you will make evaluation a dependable part of the model-development loop, from early experiments through release readiness.

We are looking for someone who enjoys difficult systems problems, makes thoughtful engineering tradeoffs, and builds teams grounded in clear ownership, collaboration, and technical excellence.

Responsibilities

Set technical direction. Own the team’s architecture, roadmap, and delivery, balancing immediate research needs with long-term reliability and scalability.
Build end-to-end evaluation systems. Develop infrastructure for benchmark configuration, model inference, grading, aggregation, and results publication across training checkpoints and deployed models.
Accelerate research iteration. Reduce evaluation turnaround time and improve throughput, scheduling, and GPU efficiency. Make it easier for researchers to integrate benchmarks, investigate results, and compare models.
Make results trustworthy. Establish reproducible configurations, traceable results, validation, and regression checks. Partner with evaluation owners to preserve correctness and comparability as models and infrastructure evolve.
Own operational excellence. Define and track reliability and performance objectives. Improve observability, failure recovery, and on-call practices, addressing recurring problems at their source.
Stay hands-on. Contribute code, lead design reviews, and help debug challenging problems across evaluation, inference, and distributed execution.
Build and develop the team. Hire and mentor engineers, establish clear responsibilities, and foster an inclusive environment where people can do their best work.
Lead across teams. Align research and engineering partners on priorities, dependencies, and tradeoffs, and communicate progress and risks clearly.

Required Qualifications

Bachelor’s Degree in Computer Science or a related technical discipline AND 6+ years of technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python.
OR equivalent experience.

Preferred Qualifications

Bachelor's Degree in Computer Science or related technical field AND 10+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
Substantial software engineering experience building and operating production distributed systems, infrastructure platforms, or ML systems.
Demonstrated technical leadership, including setting direction and delivering complex projects through a team.
Strong programming skills, including proficiency in Python and experience contributing to large, shared codebases.
Experience diagnosing distributed-system failures and improving reliability, performance, and resource efficiency.
Experience with production operations, including monitoring, incident response, and on-call practices.
Ability to translate evolving requirements into clear engineering priorities and work effectively with research and engineering partners.
A track record of mentoring engineers and strengthening team engineering practices.
Experience with LLM evaluation, benchmarking, model-based grading, or reinforcement learning infrastructure.
Experience with GPU-backed inference, distributed training, or large-scale compute workloads.
Familiarity with distributed execution frameworks and schedulers such as Ray, Kubernetes, or Slurm.
Experience improving experimental reproducibility, validating metrics, or investigating differences across evaluation and serving environments.
Experience hiring engineers, managing people, or growing a technical team.
A track record of simplifying complex infrastructure and reducing operational burden through automation and systematic reliability improvements.

Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year. Software Engineering IC6 - The typical base pay range for this role across the U.S. is USD $165,600 - $296,400 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $220,800 - $331,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Apply About employer

Report this job