Jobs in the United States

25+ jobs

Group jobs by employerEmail me new jobs Save this search

Added 8 mins ago
FC
Building Automation Systems (BAS) Operations Manager (Engineer III)
Fairfax County
Fairfax, VA
- $38.84 to $67.96 USD / hour
…standardization efforts, ensure regulatory compliance, and support a high-reliability environment across all FMD-managed…
Added 8 mins ago
FC
Chief Building Engineer
Fairfax County
Fairfax, VA
- $37.01 to $64.77 USD / hour
Chief Building Engineer – Lead Operations for a Multi-Building Organization
Added 11 mins ago
Senior Electrical Engineer - Federal
P2S
Seattle, WA
Are you a Senior Electrical Engineer with experience in Federal/Ports looking to grow your career?
Added 42 mins ago
Senior Director, Software and Quality Engineering
OneStream
United States
Partner with SRE/CloudOps on reliability, incident response, and runbooks, and with Security to build compliance (SOX, SOC 2, GDPR) into the secure SDLC.
Added 48 mins ago
Mechanical / Manufacturing Engineer
Precinmac
Albany, OR
We are seeking a motivated Mechanical/Manufacturing Engineer to support the design, development, and manufacturing of custom mechanical components and assemblies for a diverse range of…
Added 1 hour ago
TT
Senior Software Engineer, Customer Studio Backend
True Talent Solutions Partners
Remote, United States
- $180,000 to $320,000 USD / year
- Contribute to system architecture, scalability, maintainability, and reliability, and engage with users and product specifications.
Added 1 hour ago
Software Test Engineer (Level 2 or 3) AHT
Northrop Grumman
Dulles, VA
Northrop Grumman Space Systems is seeking a Software Test Engineer to support the verification and validation of mission-critical satellite ground software. In this role, you will develop &…
Added 1 hour ago
Network Security Engineer
SAIC
Suffolk, VA
SAIC is seeking a Network Security Engineer with experience in US Navy IT networks to support the sustained operation and maintenance of a newly deployed naval enterprise transport network,…
Added 1 hour ago
Network Engineer III
CACI International
Springfield, VA
Team CACI has an exciting and challenging opportunity available for a Network Engineer who performs research, requirements analysis, design, installation, documentation, troubleshooting,…
Added 1 hour ago
Software Development Engineer III, AFX Planning Tools
Amazon
Herndon, VA
…millions of customers? We are looking for a Software Development Engineer III to join our team at Amazon and help shape the technical direction of critical software systems. In this role,…
Added 1 hour ago
AIML - Sr. LLM Inference Quality Engineer
Apple
Seattle, WA
…model (LLM) services at scale. We are looking for a senior engineer to own the correctness, consistency, and stability of LLM inference in production. You will design and build the…
Added 1 hour ago
A
Facilities Engineer (Electrician)
Aerotek
Greensburg, IN
- $35 to $45 USD / hour
Job Title: Facilities Engineer (Electrician)Job DescriptionThe Facilities Engineer (Electrician) performs daily maintenance assessments of facility systems, supports other trades with…
Added 1 hour ago
Software Program Manager
Space Dynamics Laboratory
North Logan, UT
…execution, and Agile team enablement to ensure delivery of high-reliability software critical to national security and space…
Added 1 hour ago
Staff Applied AI Engineer
IVANTI, INC.
SOUTH JORDAN, UT
…optimization/recommendation systems that drive concrete business actions. {=html} - Engineer agentic AI systems. Design and ship LLM-powered agents and workflows that are token-efficient by…
Added 1 hour ago
Senior Systems Operations Engineer
IDENTRUST, INC
SALT LAKE CITY, UT
Added 1 hour ago
Systems Engineer
INNOVA SOLUTIONS INC
SALT LAKE CITY, UT
A client of Innova Solutions is immediately hiring for aSystems Specialist Engineer Position Type: Full-Time Contract, Contract to hire Duration: 12 months Location: Salt Lake City, UT…
Added 1 hour ago
Supervisor - Operations Engineering
ONEOK, Inc
Tulsa, OK
…Integrity, and other stakeholder groups to improve the safety, reliability, compliance, and performance of company…
Added 1 hour ago
NG
2027 Intern Engineer - Product Support
Northrop Grumman
Oklahoma City, OK
- $17.5 to $39.25 USD / hour
Support design reviews and trade studies by providing sustainment inputs (maintainability, reliability, and supportability) for B‑2 modifications.
Added 1 hour ago
Data Engineer - Remote
Mindex
Remote, United States
Design and optimize Snowflake pipelines and downstream objects for performance, reliability, and ease of operation.
Added 1 hour ago
B&
Senior Electrical Engineer - Water/Wastewater
Black & Veatch Family of Companies
Los Angeles, CA
- $163,404 to $272,872 USD / year
Studies – Energy Optimization, Power System Coordination and Arc Flash Hazard Analysis, and Electrical Reliability Analysis
Added 2 hours ago
Sr Reliability Engineer
Drägerwerk AG & Co. KGaA
Andover, MA
We are seeking a Senior Reliability Engineer to work hybrid in our Andover, MA office.
Added 2 hours ago
Software Engineer and Data Automation Specialist
U. S. Sentencing Commission
Washington, DC
For example, to qualify for the JS-13, one (1) year of specialized experience must have been at the GS-12 level or equivalent
Added 2 hours ago
C
Senior Healthcare Payer Claims QA Engineer
Cognizant
Washington, DC
- $96,000 to $110,000 USD / year
As a Senior Healthcare Payer Claims Test Engineer , you will help ensure the quality, accuracy, and reliability of healthcare payer claims-processing applications and integrations. You will…
Added 2 hours ago
C
Senior Healthcare QA Engineer – Payer/ Claims
Cognizant
Washington, DC
- $96,000 to $110,000 USD / year
As a Senior Healthcare QA Engineer – Payer/ Claims , you will help ensure the quality, accuracy, and reliability of healthcare payer claims-processing applications and integrations. You…
Added 2 hours ago
C
Senior Healthcare Payer Claims QA Engineer
Cognizant
Washington, DC
- $90,000 to $112,500 USD / year
As a Senior Quality Engineer - Healthcare Claims Testing , you will make an impact by ensuring the quality, accuracy, and reliability of healthcare payer claims processing solutions through…

AIML - Sr. LLM Inference Quality Engineer

Seattle, WA, United States

The base pay range for this role is between $195,700 and $338,400, and your base pay will depend on your skills, qualifications, experience, and location.

Apply on jobs.apple.com About employer

Applications open in a new tab.

Job details

Pay: The base pay range for this role is between $195,700 and $338,400, and your base pay will depend on your skills, qualifications, experience, and location.
Posting language: English
Posted: Nov 13, 2026

Original job description

Summary Apple is building the next generation of AI data center infrastructure to power large language model (LLM) services at scale. We are looking for a senior engineer to own the correctness, consistency, and stability of LLM inference in production. You will design and build the automation frameworks, evaluation methodology, and qualification strategy that give us confidence in every model, prompt, serving stack, and infrastructure change before it reaches our users. Your work is the safety net that lets Apple ship frontier AI quickly, without sacrificing quality, safety, or trust.

Description In this role, you will lead the qualification of an LLM inference, output-correctness, automation framework for large-scale AI data center deployment and platform validation. You will architect qualification systems for generative AI, including agentic workflows and tool-using models, running at data center scale, validating that outputs remain correct, consistent, and stable as models, weights, prompts, serving runtimes, quantization schemes, and accelerator hardware change underneath them. This is a hands-on AI systems engineering role at the intersection of machine learning, distributed systems, and quality engineering. You will write production-quality software in Python, C++, and/or Swift, apply statistical and ML-evaluation methods to validate both data and model behavior, and build AI-assisted QA tooling that makes testing itself smarter and faster. You will partner closely with ML engineers, inference/performance engineers, distributed systems engineers, and platform teams, and you will be a trusted Quality voice on what “correct” and “stable” mean for LLM inference at scale, including the inherently non-deterministic, probabilistic nature of generative output. You should be comfortable operating in ambiguity, defining quality bars where none exist yet, and delivering rigorous results on tight schedules.

Responsibilities

Design and develop qualification frameworks for LLM inference systems deployed at data center scale, validating output correctness, consistency, and stability across model, weight, prompt, runtime, and infrastructure changes. Build the LLM inference output-correctness automation framework used for large-scale deployment and platform validation. Architect the end-to-end test and qualification strategy for distributed ML serving systems - spanning unit, integration, regression, and end-to-end layers. Design harnesses that enable validation of ML/LLM services independently of upstream model and service dependencies (mocking, trace replay, and synthetic traffic generation).

Gate releases in CI: every change to a model, weight, prompt, tool definition, or runtime runs against the relevant evals, producing a before/after comparison a reviewer can read in one glance. Create prompt-level and scenario-based regression suites, and track quality across model, prompt, and infrastructure versions over time.

Validate tool-use, function-calling, and multi-turn agentic workflows for correct invocation, argument formation, task completion, and multi-turn coherence; flag output that is wrong, empty, or silently degraded. Develop safety, refusal, and policy-compliance coverage, verifying guardrail and alignment behavior holds across releases. Probe AI-specific risk: prompt injection, data leakage across users and permissions, hallucinated or ungrounded output, and cost/latency regressions. Build adversarial and robustness tests, long-context, ambiguous and underrepresented inputs, to surface failure modes before users encounter them.

Qualify inference-optimization techniques (quantization, KV-cache, speculative decoding, batching) for output parity against a full-precision reference. Validate output equivalence across serving backends and accelerators, ensuring hardware and runtime swaps preserve generation quality. Perform functional, performance, fault-injection, and reliability testing, benchmarking quality-vs-latency/throughput trade-offs to surface the correctness cost of performance optimizations.

Develop and use AI-powered/agentic QA tooling that improves test-case generation, defect detection, flaky-test analysis, and failure triage automating any check performed manually more than once. Define and implement metrics, logging pipelines, distributed tracing, and observability tooling to monitor output correctness, model quality, data quality, drift, latency, and system health in production. Apply log analysis using Splunk and Apple internal debugging tools to root-cause failures in complex LLM serving systems. Perform regression, performance, and integration testing across platforms, including iOS and macOS, for on-device and server-backed AI features. Develop production AI infrastructure software in Python, C++, and/or Swift, applying modularity, scalability, testability, and performance principles.

Minimum Qualifications 5+ years of experience with hardware and/or software development lifecycle processes. 5+ years of experience in one or more compiled languages (e.g., C, C++, Objective-C/Swift). Proficiency in one or more scripting languages (e.g., Python, Go, or JavaScript). Experience using AI/LLMs to improve testing itself - test-case generation, defect detection, or reducing manual QA effort. Familiarity with LLM serving and inference optimization (batching, KV-cache, quantization, speculative decoding, distributed/multi-accelerator serving) and GPU-accelerated software. Experience with CI/CD, Kubernetes, containers, and cloud-native systems, and integrating automated evals into release pipelines. Experience with machine learning and LLMs, their common practical applications, and commonly used frameworks (e.g., PyTorch, Hugging Face Transformers, or comparable inference/serving stacks). Experience with observability and distributed tracing for ML systems (e.g., Splunk, Prometheus, Grafana, LangSmith, or similar) and monitoring for model drift. B.S., M.S., or Ph.D. in Computer Engineering, Electrical Engineering, Computer Science, or equivalent experience.

Preferred Qualifications 5+ years using one or more of the following scripting languages: Python, Go, or JavaScript 5+ years of experience working with and building operating systems 2+ years of experience in LLM testing/development.

Pay & Benefits At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $195,700 and $338,400, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

EEO Statement Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant

Accessibility At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here - in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.

Learn about accessibility in Apple’s workplace

Learn about reasonable accommodations for job applicants

Application Deadline Apple accepts applications to this posting on an ongoing basis.

Apply on jobs.apple.com About employer

More about this job

Skills

Python
C++
Swift
ML
Splunk
Debugging
Apple macOS
Software development
C
Objective C
Go
JavaScript
CI/CD
Kubernetes
Machine learning
PyTorch
Hugging Face
Prometheus
Grafana
Computer engineering
Electrical engineering
Computer science

Report this job

Work requirements

Jobs in the United States