Jobs in the United States

25+ jobs

Save this search

Added 5 mins ago
Senior Staff AI / ML Solutions Engineer
PPD Development, LP
Morrisville, NC
We have a new opening within the Clinical Research Group (CRG) of Thermo Fisher for a Senior Staff AI/ML Solutions Engineer to support the Finance organization and serve as the hands-on…
Added 6 mins ago
S
Staff Backend Graph Engineer
Socure
Remote, United States
- $225,000 to $250,000 USD / year
As a Staff Engineer on this team, you’ll set the technical direction for the platform behind that decision. You’ll own hard problems end to end, work across Engineering, Data Science,…
Added 6 mins ago
Fullstack Software Engineer
Scowtt Inc
Kirkland, WA
We are looking for a motivated and self-driven Full-Stack Software Engineer to join our diverse team. In this role, you will contribute to the development, deployment, and maintenance of…
Added 7 mins ago
Software Engineer 3
Kiewit
Lenexa, KS
TAG is hiring Software Engineer to help design and deliver AI-powered enterprise applications across Kiewit’s district portfolio. This role is ideal for a developer who has outgrown pure…
Added 9 mins ago
Solutions Architect - Digital Native Business (Geo)
Databricks
Remote, United States
Databricks certifications (Data Engineer, ML, Platform)
Added 11 mins ago
Data Engineer, WW Pricing - Data & Analytics
Amazon.com Services LLC
Seattle, WA
As a Data Engineer, you will create data models and ML data infrastructure that power our pricing algorithms and shape both customer and seller experiences. You'll develop essential data…
Added 11 mins ago
Sr. Business Intelligence Engineer, ASP BI
Amazon Web Services, Inc.
Austin, TX · Seattle, WA · Dallas, TX
AWS is seeking a Senior Business Intelligence Engineer III to lead analytics strategy for the Specialist Insights team, focused on Data and AI. This team operates at the intersection of…
Added 13 mins ago
Staff Machine Learning Engineer, AI Infrastructure
Waymo
Mountain View, CA · San Francisco, CA · NY
…autonomous vehicles, and have an incessant drive to improve the performance of our technology…
Added 18 mins ago
AI/ML Engineer
Booz Allen Hamilton_United States
Washington, DC
As a Machine Learning (ML) Engineer on our Physical AI team, you’ll have the chance to impact national defense as a critical member of our research and development team. Your customer will…
Added 18 mins ago
Principal Staff Mechanical Engineer
ATI
Woburn, MA
…hasn’t fundamentally changed in decades into an automated, high-performance system built for the future of automotive…
Added 18 mins ago
Artificial Intelligence Engineer, Senior
Booz Allen Hamilton_United States
Charleston, SC
Artificial Intelligence Engineer, SeniorThe Opportunity:
Added 26 mins ago
Associate Software Engineer - Tech Catalyst Program (All Locations)
Hartford Fire Ins. Co
Hartford, CT · Charlotte, NC
The Tech Catalyst Engineer contributes to the design, development, testing, deployment, and support of technology solutions that address business and customer needs. Working as part of an…
Added 26 mins ago
Tech & Data Program Summer 2027 - Software Engineer Intern (Hartford)
Hartford Fire Ins. Co
Hartford, CT
Tech & Data Program Summer 2027 – Software Engineer Intern
Added 27 mins ago
AI Software Engineer
United Imaging Healthcare North America, Inc.
Houston, TX
…range. Additionally, the position may also be eligible to earn performance-based incentive compensation (such as cash…
Added 1 hour ago
Software Engineer (AI Agents)
Fluent, LLC
Remote, United States
Fluent is hiring its first dedicated AI Engineer. Over the past year, AI at Fluent has moved from pilots to production: a service desk agent that closes tickets without a human touch, a…
Added 1 hour ago
Senior Principal Engineer - FW/SW Development
Astera Labs
San Jose, CA · CA
Astera Labs is seeking a Senior Principal / Distinguished Engineer - FW/SW Development to join our engineering team in San Jose, CA. This is a high-impact individual contributor role at the…
Added 1 hour ago
A
Principal Engineer, Digital Regulatory Assurance (Life Sciences)
AbbVie
North Chicago, IL
- $109,500 to $208,500 USD / year
The Principal Quality Engineer – Digital Regulatory Assurance is responsible for providing regulatory assurance and quality oversight for IT applications, infrastructure platforms, and…
Added 1 hour ago
1
Engineering Manager, Infrastructure (Device Trust)
1Password
Remote, United States
- $192,000 to $278,000 USD / year
Added 2 hours ago
KC
Artificial Intelligence Engineer
KLA Corporation
Milpitas, CA
- $140,500 to $238,900 USD / year
KLA’s total rewards package for employees may also include participation in performance incentive programs and eligibility for additional benefits including but not limited to: medical,…
Added 2 hours ago
Senior Software Development Engineer, Annapurna ML Systems, Trainium
Annapurna Labs (U.S.) Inc.
Austin, TX · San Diego, CA · Cupertino, CA
We're seeking a Sr.Software Development Engineer with deep storage expertise to architect, build, and operate the high-performance storage infrastructure that accelerates silicon…
Added 2 hours ago
Scientific, Computer Engineer, Staff Cloud Infrastructure
Revolution Medicines
Redwood City, CA
We are seeking a Staff Cloud Infrastructure / Scientific Computer Engineer to help build, operate, and improve the infrastructure foundations that support computational science, data…
Added 2 hours ago
Electronic Warfare Engineer
SRC, Inc
San Antonio, TX
Conduct original EW all-source intelligence research and engineering analysis to characterize system performance and capabilities
Added 2 hours ago
Principal Architect – Smart Systems & AI Innovation
Quest Global
Greenville, SC · Schenectady, NY
Engineer for CNI: Specify hybrid and air‑gapped deployment patterns; adopt Kubernetes/GitOps, SBOMs, signed artifacts, SAST/DAST, supply‑chain controls, and auditable DevSecOps pipelines…
Added 2 hours ago
Staff Hardware Systems Design Engineer, Platforms Infrastructure
Google
Sunnyvale, CA
…generation of hardware experiences, delivering unparalleled performance, efficiency, and…
Added 2 hours ago
BL
Systems Engineer - Onsite, Chantilly, VA
BluePath Labs
Chantilly, VA
- $135,000 to $175,000 USD / year
We are seeking a highly skilled Systems Engineer with strong Data Engineering experience to design, secure, and optimize mission-critical data solutions. This role blends systems…

Jobgether

Senior Machine Learning Engineer, Inference

Remote, United States

$250,000 to $300,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $250,000 to $300,000 USD / year
Experience: At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.
Posting language: English
Posted: Nov 5, 2026

Original job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Machine Learning Engineer, Inference based in the United States.

Join a high-performing engineering team developing advanced real-time voice and large language model (LLM) technology. As a Senior Machine Learning Engineer, you will own inference optimization from research through production deployment, helping bring sophisticated models to consumer-scale applications. You will tackle complex challenges involving latency, throughput, GPU efficiency, and distributed serving infrastructure. Working directly with modern inference engines, you will apply cutting-edge acceleration techniques to improve performance and scalability. You will collaborate closely with research and product teams to turn innovative models into reliable production systems. This is an opportunity to make a significant technical impact on AI products serving hundreds of millions of users.

Accountabilities

You will lead end-to-end inference optimization, ensuring that advanced machine learning models perform efficiently and reliably in production environments. Your responsibilities will include:

• Own the optimization process from research models to production deployment.

• Improve latency and throughput for real-time voice and LLM inference at consumer scale.

• Work directly with inference engines such as vLLM, TensorRT-LLM (TRT-LLM), and SGLang to enhance performance.

• Implement model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Develop high-performance GPU workloads using C++, CUDA, Rust, or optimized Python.

• Build and scale distributed multi-GPU and multi-node inference systems using Kubernetes, Ray, and custom load-balancing solutions.

• Collaborate with research and product teams to bring new models into production.

Requirements

The ideal candidate is a senior-level machine learning inference or systems engineer with strong hands-on experience optimizing production inference engines and building scalable GPU infrastructure. You should bring:

• At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.

• Practical experience optimizing inference engines such as vLLM or TRT-LLM at the engine level, beyond basic model deployment.

• A proven background in developing backend and machine learning systems and serving models in production.

• Strong systems programming and GPU optimization skills using C++, CUDA, Rust, or optimized Python.

• Hands-on knowledge of model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Experience with distributed systems, Kubernetes, Ray, load balancing, multi-GPU and multi-node inference, and high-concurrency environments.

• Excellent English communication skills.

• Residence in the United States, Canada, the United Kingdom, Germany, Switzerland, or Serbia.

Additional advantages include a track record of rapid career progression, contributions to open-source inference engines or technical publications, and a PhD in Computer Science, Physics, or Mathematics, or a degree from a leading computer science program. The ability to commute to Mountain View, California, is also a plus.

Benefits

• Salary: $250,000–$300,000 annual base salary, plus competitive equity.

• Employment: Full-time, permanent position.

• Work arrangement: Onsite in Mountain View, California, preferred; remote opportunities available in the United States, Canada, the United Kingdom, Germany, Switzerland, and Serbia.

• Visa support: H-1B and OPT transfers supported.

• Relocation assistance: Available for candidates relocating to the San Francisco Bay Area.

• Language: English-speaking working environment.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

Apply About employer

Report this job