Jobs in the United States

25+ jobs

Save this search

Added 1 min ago
Sr. New Product Introduction (NPI) System Engineer-Palo Alto, CA
x Varian Medical Systems, Inc.
United States
…product takes more than great design it takes exceptional system-level leadership. As our Senior New Product Introduction Systems Engineer, you will shape how next-generation radiation…
Added 1 min ago
Tech Lead, Platform
M7 Health
New York City, NY
- Experienced, hands-on engineer: You have 6+ years building and operating production software, with a track record of owning systems end-to-end. You still love writing code and want a role…
Added 4 mins ago
Lead Software Integration Solutions Architect
RTX
United States
…a Lead Software Integration Solutions Architect to provide senior technical leadership across the Advanced Technology Programs within the Radar Product Line (RPL). In this role, you will…
Added 4 mins ago
Senior Mechanical Design Engineer(Onsite)
RTX
United States
A Senior Mechanical Design Engineer will be working in a focused, cross-functional team of engineers developing highly reliable products which meet customer specified requirements/…
Added 4 mins ago
Auxiliary Power Systems Sr. Engineer (Onsite)
RTX
United States
The Senior Engineer, Project Engineering will be responsible for overseeing and improving designs, manufacturing, and engine test processes for legacy and new production Military APU…
Added 4 mins ago
Production Engineer
ASML US, LP. (US20)
Wilton, CT
As a Production Engineer at ASML in Wilton, Connecticut, you will help turn advanced engineering designs into reliable manufacturing processes. Your work will directly support the…
Added 4 mins ago
Senior Systems Engineer
AEye, Inc
Pleasanton, CA
We are looking for a Senior Systems Engineer to join our systems engineering team and drive the requirements, system architecture, performance analysis, and functional safety work for…
Added 5 mins ago
Project Engineer-Electrical
McKim & Creed, Inc.
Pittsburgh, PA · Berkeley Lake, GA · Atlanta, GA
Prepares design computations and assessments, performs technical evaluations, and prepares technical reports and correspondence under the guidance of a senior engineer.
Added 5 mins ago
Advanced Mfg Engineer Sr Adv
Aerospace
Torrance, CA
As an Advanced Manufacturing Engineer Senior Advanced here at Honeywell Aerospace, you will drive advanced manufacturing strategies, optimize processes, and implement cutting-edge…
Added 7 mins ago
System Architect - SME
ClearFocus Technologies
Remote, United States
The Storage Engineer-_SME provides senior technical leadership for enterprise storage services under the SEC Infrastructure Support Services (ISS) contract. This role architects,…
Added 7 mins ago
DO
Office Chief, Office of Program Management
Department of Transportation
CA
- $13,892 to $15,782 USD / month
Experience: One year of transportation engineering experience as a senior level engineer in the California state service.
Added 10 mins ago
Staff Backend Software Engineer
Raydar
Seattle, WA
…architecture through production reliability. The role suits a senior engineer who has personally shipped backend systems and wants to shape how they are…
Added 10 mins ago
Principal Engineer - Agentic AI Engineering
Bank of America, National Association
United States
…clear in-office expectations, while providing an appropriate level of flexibility based on role-specific responsibilities and business…
Added 13 mins ago
Principal/Sr. Principal Facilities Engineer - Level 3 or 4
Northrop Grumman
Clearfield, UT
Basic for Senior Principal Facilities Engineer Level Qualifications (Level 4):
Added 14 mins ago
Principal Software Engineer
HEALTHEQUITY, INC.
DRAPER, UT
Principal Software Engineer Job Locations US-Remote Our Mission Our mission is to SAVE AND IMPROVE LIVES BY EMPOWERING HEALTHCARE CONSUMERS.Come be part of remarkable. Overview At…
Added 14 mins ago
Senior Principal Test Engineer
Northrop Grumman
Roy, UT
Northrop Grumman Defense Systems is seeking a Senior Principal System Test Engineer for the Command Systems team. This position will be located in Roy, UT and will support the Sentinel…
Added 14 mins ago
Senior Principal Test Engineer
Northrop Grumman
Roy, UT
Northrop Grumman Defense Systems is seeking a Senior Principal Test Engineer for the AVE-IATC (TP&E) team. This position will be located in Roy, UT and will support the Sentinel (GBSD)…
Added 14 mins ago
Senior Principal Test Engineer
Northrop Grumman
Roy, UT
Northrop Grumman Strategic Deterrent Systems division is seeking a Senior Principal Test Engineer to join our team of highly qualified and diverse individuals. This position will be located…
Added 14 mins ago
Sentinel Systems Engineering Manager 2
Northrop Grumman
Roy, UT
The primary objective of this role is to collaborate across Systems Engineering, System Test, Global Supply Chain, suppliers, and other Integrated Product Teams (IPTs) to develop and stand…
Added 14 mins ago
Missile Integration Technical Lead
Northrop Grumman
Corinne, UT · Roy, UT
Northrop Grumman Defense Systems is seeking a Missile Integration Technical Lead - Senior Staff Systems Test Engineer to join the Sentinel program in enhancing the US Space Force’s ICBM…
Added 15 mins ago
K
Senior Java Backend Software Engineer
Kforce
Westlake, TX
- $68 to $78 USD / hour
Kforce has a client in Westlake, TX that is seeking a Senior Java Backend Software Engineer.
Added 18 mins ago
A
Senior Structural Engineer - LA28
AECOM
Orange, CA
- $175,000 to $200,000 USD / year
AECOM is seeking a Senior Structural Engineer based in Orange or Los Angeles, CA. This Structural Engineer will support a wide range of projects across industries including entertainment,…
Added 18 mins ago
A
Senior Structural Engineer - LA28
AECOM
Los Angeles, CA
- $175,000 to $200,000 USD / year
AECOM is seeking a Senior Structural Engineer based in Orange or Los Angeles, CA. This Structural Engineer will support a wide range of projects across industries including entertainment,…
Added 18 mins ago
A
Senior ITS Engineer
AECOM
Charlotte, NC
- $180,000 to $230,000 USD / year
The Senior ITS Engineer will provide technical leadership, project management, and strategic guidance for Intelligent Transportation Systems (ITS), traffic signal systems, Transportation…
Added 19 mins ago
RU
Databricks/Spark Migration Delivery Consultant
Randstad USA
Remote, United States
- $65 to $69.78 USD / hour
through senior executives on how best to utilize Snowﬂake to make their business successful. Our Solution Architects are comfortable with change and live on the cutting edge of technology.

Jobgether

Senior Machine Learning Engineer, Inference

Remote, United States

$250,000 to $300,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $250,000 to $300,000 USD / year
Experience: At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.
Posting language: English
Posted: Nov 5, 2026

Original job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Machine Learning Engineer, Inference based in the United States.

Join a high-performing engineering team developing advanced real-time voice and large language model (LLM) technology. As a Senior Machine Learning Engineer, you will own inference optimization from research through production deployment, helping bring sophisticated models to consumer-scale applications. You will tackle complex challenges involving latency, throughput, GPU efficiency, and distributed serving infrastructure. Working directly with modern inference engines, you will apply cutting-edge acceleration techniques to improve performance and scalability. You will collaborate closely with research and product teams to turn innovative models into reliable production systems. This is an opportunity to make a significant technical impact on AI products serving hundreds of millions of users.

Accountabilities

You will lead end-to-end inference optimization, ensuring that advanced machine learning models perform efficiently and reliably in production environments. Your responsibilities will include:

• Own the optimization process from research models to production deployment.

• Improve latency and throughput for real-time voice and LLM inference at consumer scale.

• Work directly with inference engines such as vLLM, TensorRT-LLM (TRT-LLM), and SGLang to enhance performance.

• Implement model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Develop high-performance GPU workloads using C++, CUDA, Rust, or optimized Python.

• Build and scale distributed multi-GPU and multi-node inference systems using Kubernetes, Ray, and custom load-balancing solutions.

• Collaborate with research and product teams to bring new models into production.

Requirements

The ideal candidate is a senior-level machine learning inference or systems engineer with strong hands-on experience optimizing production inference engines and building scalable GPU infrastructure. You should bring:

• At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.

• Practical experience optimizing inference engines such as vLLM or TRT-LLM at the engine level, beyond basic model deployment.

• A proven background in developing backend and machine learning systems and serving models in production.

• Strong systems programming and GPU optimization skills using C++, CUDA, Rust, or optimized Python.

• Hands-on knowledge of model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Experience with distributed systems, Kubernetes, Ray, load balancing, multi-GPU and multi-node inference, and high-concurrency environments.

• Excellent English communication skills.

• Residence in the United States, Canada, the United Kingdom, Germany, Switzerland, or Serbia.

Additional advantages include a track record of rapid career progression, contributions to open-source inference engines or technical publications, and a PhD in Computer Science, Physics, or Mathematics, or a degree from a leading computer science program. The ability to commute to Mountain View, California, is also a plus.

Benefits

• Salary: $250,000–$300,000 annual base salary, plus competitive equity.

• Employment: Full-time, permanent position.

• Work arrangement: Onsite in Mountain View, California, preferred; remote opportunities available in the United States, Canada, the United Kingdom, Germany, Switzerland, and Serbia.

• Visa support: H-1B and OPT transfers supported.

• Relocation assistance: Available for candidates relocating to the San Francisco Bay Area.

• Language: English-speaking working environment.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

Apply About employer

Report this job