Jobs in the United States

25+ jobs

Save this search

Added 19 mins ago
J
Senior Machine Learning Engineer, Inference
Jobgether
Remote, United States
- $250,000 to $300,000 USD / year
…all applications and next steps. Our partner is looking for a Senior Machine Learning Engineer, Inference based in the United…
Added 35 mins ago
DO
Engineer, Water Resources
Department of Water Resources
CA
- $6,488 to $12,152 USD / month
Under the supervision of a Senior Engineer, Water Resources in the Central Valley Modeling Section of the Modeling Support Office, is responsible for developing and maintaining present and…
Added 54 mins ago
Consultant, Data Engineer - Reference Data Management
AB3 Nationwide Life and Annuity Insurance Co
OH · AZ
…visualization, governance, engineering, AI engineering, and machine learning to produce targeted data solutions. If you have the drive and desire to be part of a future-forward data-enabled…
Added 1 hour ago
Staff Engineer - Software Engineering
Capital One
Cambridge, MA
You will work alongside our talented team of developers, machine learning experts, product managers and people leaders. Our Distinguished Engineers are leading experts in their domains,…
Added 1 hour ago
Machine Perception (MP) Engineer – Level 6
Northrop Grumman
Gilbert, AZ
…bring your pioneering spirit to our collaborative teams. As a Machine Perception (MP) Engineer – Level 6 located in Dulles, VA, or Gilbert, AZ , you’ll be a linchpin in missions of…
Added 1 hour ago
Lead Application Engineer
Deliberately.ai
San Francisco, CA
We are looking for a Lead Application Engineer to join our team and lead the development of key projects across our application. This senior-level role requires someone who can…
Added 2 hours ago
Senior/Staff Software Engineer [Full Stack]
Prudentia Sciences
Boston, MA · New York, NY
We're seeking an exceptional Senior/Staff Software Engineer to build and lead our core platform as we scale. This is a rare opportunity to join a high-impact technology company in a major…
Added 2 hours ago
Senior Quantum Platform Engineer
Quanta Standard Inc
Washington, DC · Arlington, VA · Alexandria, VA
Quanta Standard Inc. is seeking a highly skilled and experienced Senior Quantum Platform Engineer to join our team. This role requires a minimum of 8 years of experience in similar roles…
Added 2 hours ago
AR
Mid/Senior Level Robotics Software Engineer
AlphaOne Robotics
Dallas, TX
- $100,000 to $150,000 USD / year
Knowledge of machine learning frameworks (e.g., PyTorch, TensorFlow) and models (eg. Yolo) for robotics applications like perception or decision-making.
Added 2 hours ago
RS
Software Engineer - Full Stack/Backend
Reframe Systems
Boston, MA
- $150,000 to $190,000 USD / year
We’re seeking a Software Engineer to design and build full-stack applications that support our manufacturing operations. You’ll work with cloud-native services, data pipelines, IoT devices,…
Added 2 hours ago
Senior Principal Software Engineer (Python) – Founding Engineer - Seattle
Solvin AI
WA · Seattle, WA
Design, build, and maintain the infrastructure for our AI and machine learning models.
Added 2 hours ago
Senior Data Engineer
Marble Technologies
Lincoln, NE · Omaha, NE · Cambridge, MA
As a Senior Data Engineer at Marble, you will own the design and performance of data pipelines that power everything from real-time classification dashboards to ML training datasets to…
Added 2 hours ago
Senior Generative AI Engineer / Architect
Cinter Career
Plano, TX
We are seeking an experienced and hands-on Senior Generative AI Engineer / Architect to design, develop, and implement innovative AI and machine learning solutions. This role focuses on…
Added 2 hours ago
Senior Machine Learning Engineer
Casap
San Francisco, CA
Casap is looking for a talented Machine Learning Engineer in San Francisco excited to supercharge how banks operate with a rapidly scaling product at the forefront of automation and…
Added 2 hours ago
M
Senior Software Engineering Manager
Microsoft
WA · Redmond, WA · Redmond
- $119,800 to $261,000 USD / year
AI Strategy & Architecture: Set direction for AI-native security experiences and platform components, LLMs vs classical Machine Learning (ML), Retrieval-Augmented Generation (RAG) design,…
Added 2 hours ago
M
Principal Software Engineer - AI Infrastructure
Microsoft
WA · Redmond, WA · Redmond
- $142,800 to $304,200 USD / year
3+ years building machine learning training infrastructure, such as Graphics Processing Unit (GPU) cluster scheduling, data pipelines, and checkpointing and storage systems, using…
Added 2 hours ago
Computer Vision Algorithm Engineer
US Tech Solutions
Bridgewater, NJ
information retrieval, machine learning, media processing, and related fields
Added 2 hours ago
Recruitment Drive: Java / .Net / BA
Saviance Technologies
New York, NY
Senior Investment Banking Project Manager 1 NYC, NY 120 K "Need locals who can come for F2F
Added 2 hours ago
Senior Data Engineer
Pattern AI
Remote, United States
PatternAI is an automated machine learning platform that reveals critical patterns in data for narrow business problems.
Added 2 hours ago
PP
Senior Technical Product Manager - AI Agents, Evals & Reliability, Artificial Intelligence (AI) Required, Work From Home
Parallel Partners
Remote, United States
- $165,000 to $200,000 USD / year
We are looking for a Senior Technical Product Manager. This is a deeply technical, hands-on role. The Senior Technical Product Manager will work directly with engineers on systems design,…
Added 2 hours ago
Software Web Development Engineer
Options Group
New York, NY
Experience working with machine learning technologies.
Added 2 hours ago
Senior Software Engineer
MessageControl
Chicago, IL
Bonus: Machine learning experience in a production environment.
Added 3 hours ago
Data Engineer
AvantCredit
Chicago, IL
Preferably has a basic understanding in statistics, machine learning modeling techniques
Added 3 hours ago
PN
Software Engineer II
Pacific Northwest National Laboratory
Richland, WA · Seattle, WA
- $109,000 USD / year
As a Software Engineer on PNNL's Software Engineering and Architectures (SEA) team, you'll have the chance to shape mission-critical SI systems, help build enterprise-scale data platforms,…
Added 4 hours ago
O
Senior Platform Software Engineer, AI
Oracle
Nashville, TN
- $92,500 to $209,500 USD / year
We are seeking a Senior Platform Software Engineer to design, build, and operate scalable services that improve the developer experience and increase engineering productivity. You will work…

Jobgether

Senior Machine Learning Engineer, Inference

Remote, United States

$250,000 to $300,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $250,000 to $300,000 USD / year
Experience: At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.
Posting language: English
Posted: Nov 5, 2026

Original job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Machine Learning Engineer, Inference based in the United States.

Join a high-performing engineering team developing advanced real-time voice and large language model (LLM) technology. As a Senior Machine Learning Engineer, you will own inference optimization from research through production deployment, helping bring sophisticated models to consumer-scale applications. You will tackle complex challenges involving latency, throughput, GPU efficiency, and distributed serving infrastructure. Working directly with modern inference engines, you will apply cutting-edge acceleration techniques to improve performance and scalability. You will collaborate closely with research and product teams to turn innovative models into reliable production systems. This is an opportunity to make a significant technical impact on AI products serving hundreds of millions of users.

Accountabilities

You will lead end-to-end inference optimization, ensuring that advanced machine learning models perform efficiently and reliably in production environments. Your responsibilities will include:

• Own the optimization process from research models to production deployment.

• Improve latency and throughput for real-time voice and LLM inference at consumer scale.

• Work directly with inference engines such as vLLM, TensorRT-LLM (TRT-LLM), and SGLang to enhance performance.

• Implement model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Develop high-performance GPU workloads using C++, CUDA, Rust, or optimized Python.

• Build and scale distributed multi-GPU and multi-node inference systems using Kubernetes, Ray, and custom load-balancing solutions.

• Collaborate with research and product teams to bring new models into production.

Requirements

The ideal candidate is a senior-level machine learning inference or systems engineer with strong hands-on experience optimizing production inference engines and building scalable GPU infrastructure. You should bring:

• At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.

• Practical experience optimizing inference engines such as vLLM or TRT-LLM at the engine level, beyond basic model deployment.

• A proven background in developing backend and machine learning systems and serving models in production.

• Strong systems programming and GPU optimization skills using C++, CUDA, Rust, or optimized Python.

• Hands-on knowledge of model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Experience with distributed systems, Kubernetes, Ray, load balancing, multi-GPU and multi-node inference, and high-concurrency environments.

• Excellent English communication skills.

• Residence in the United States, Canada, the United Kingdom, Germany, Switzerland, or Serbia.

Additional advantages include a track record of rapid career progression, contributions to open-source inference engines or technical publications, and a PhD in Computer Science, Physics, or Mathematics, or a degree from a leading computer science program. The ability to commute to Mountain View, California, is also a plus.

Benefits

• Salary: $250,000–$300,000 annual base salary, plus competitive equity.

• Employment: Full-time, permanent position.

• Work arrangement: Onsite in Mountain View, California, preferred; remote opportunities available in the United States, Canada, the United Kingdom, Germany, Switzerland, and Serbia.

• Visa support: H-1B and OPT transfers supported.

• Relocation assistance: Available for candidates relocating to the San Francisco Bay Area.

• Language: English-speaking working environment.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

Apply About employer

Report this job