Jobs in the United States

25+ jobs

Save this search

Added 8 mins ago
M
Senior Machine Learning Engineer / Applied Scientist
Microsoft
BC, CA
- $114,400 to $203,900 CAD / year
We are looking for a Senior Machine Learning Engineer / Applied Scientist to help design, evaluate, and ship the next generation of AI-powered product experiences. The role combines strong…
Added 24 mins ago
EG
Cloud Engineer
Eliassen Group
Augusta, ME
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…
Added 24 mins ago
EG
Databricks Data Engineer
Eliassen Group
Augusta, ME
- $150,000 to $154,000 USD / year
Our client seeks a Databricks Data Engineer to design, build, and maintain scalable, reliable, and secure data pipelines, infrastructure, and systems that support consulting services and…
Added 25 mins ago
Corporate Sales Engineer, Customer Sales (Remote)
CrowdStrike
Jefferson City, MO
CrowdStrike is seeking a Corporate Sales Engineer who is passionate about cybersecurity. In this role, you will learn to articulate how current security solutions are designed and deployed,…
Added 30 mins ago
EG
Cloud Engineer
Eliassen Group
Helena, MT
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…
Added 30 mins ago
EG
Databricks Data Engineer
Eliassen Group
Helena, MT
- $150,000 to $154,000 USD / year
Our client seeks a Databricks Data Engineer to design, build, and maintain scalable, reliable, and secure data pipelines, infrastructure, and systems that support consulting services and…
Added 35 mins ago
Software Developer – Entry Level
CGI Technologies and Solutions, Inc.
Lafayette, LA
Support debugging, troubleshooting, and performance improvements across application and system components.
Added 35 mins ago
EG
Databricks Data Engineer
Eliassen Group
Baton Rouge, LA
- $150,000 to $154,000 USD / year
Our client seeks a Databricks Data Engineer to design, build, and maintain scalable, reliable, and secure data pipelines, infrastructure, and systems that support consulting services and…
Added 35 mins ago
EG
Cloud Engineer
Eliassen Group
Baton Rouge, LA
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…
Added 41 mins ago
AI Security Engineer, US ADC Security
Amazon.com Services LLC
Jessup, MD · Arlington, VA · Herndon, VA
Amazon's Security team is looking for an AI Security Engineer with strong insight and passion for security to ensure our AI applications are designed and built to the highest standards.…
Added 45 mins ago
EG
Databricks Data Engineer
Eliassen Group
Des Moines, IA
- $150,000 to $154,000 USD / year
Our client seeks a Databricks Data Engineer to design, build, and maintain scalable, reliable, and secure data pipelines, infrastructure, and systems that support consulting services and…
Added 45 mins ago
EG
Cloud Engineer
Eliassen Group
Des Moines, IA
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…
Added 51 mins ago
AI Engineer ||
Mastercard
O'Fallon, MO
The AI Engineer is responsible for designing and delivering AI-powered solutions that improve engineering productivity and business workflows. This role requires a strong foundation in…
Added 56 mins ago
Principal Cybersecurity Incident Response Engineer
Wells Fargo
CHANDLER, AZ
Wells Fargo is seeking a Principal Engineer in Technology as part of Cybersecurity. Learn more about the career areas and lines of business at wellsfargojobs.com.
Added 56 mins ago
Information Security Engineer Security Baseline Configuration
Wells Fargo
CHANDLER, AZ
Wells Fargo is seeking an Information Security Engineer to support the Security Baseline Configuration program within Cybersecurity. This role will help modernize and scale…
Added 56 mins ago
T
Technical Support Engineer (Dedrone)
TEKsystems
Mesa, AZ
- $27 to $29 USD / hour
…Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis…
Added 57 mins ago
Field Service Engineer IV (C4) - Technical Lead
Applied Materials
Phoenix, AZ
As a Field Service Engineer [Customer Engineer] at Applied Materials, you serve as the direct liaison with customers, collaborating closely to install, maintain, and upgrade equipment.…
Added 57 mins ago
AE
Campus Undergraduate Summer Internship Program - 2027 AI Engineer, Enterprise Technology Services- Phoenix, AZ
American Express
Phoenix, AZ
- $24.05 to $63 USD / hour
At American Express, we empower future technologists to learn, innovate, and make an impact from day one. As an AI Engineer Intern in Enterprise Technology Services, you’ll join a 10-week…
Added 57 mins ago
EG
Databricks Data Engineer
Eliassen Group
Phoenix, AZ
- $150,000 to $154,000 USD / year
Our client seeks a Databricks Data Engineer to design, build, and maintain scalable, reliable, and secure data pipelines, infrastructure, and systems that support consulting services and…
Added 57 mins ago
EG
Cloud Engineer
Eliassen Group
Phoenix, AZ
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…
Added 1 hour ago
Data Engineer (BigQuery)
Northramp LLC
Washington, DC
Northramp is seeking a Data Engineer (BigQuery) to join the team supporting a mission-critical effort to consolidate, modernize, and operate our client's enterprise cloud services across…
Added 1 hour ago
Data Engineer (BigQuery)
Northramp LLC
Reston, VA
Northramp is seeking a Data Engineer (BigQuery) to join the team supporting a mission-critical effort to consolidate, modernize, and operate our client's enterprise cloud services across…
Added 1 hour ago
Data Engineer (BigQuery)
Northramp LLC
Bethesda, MD
Northramp is seeking a Data Engineer (BigQuery) to join the team supporting a mission-critical effort to consolidate, modernize, and operate our client's enterprise cloud services across…
Added 1 hour ago
Senior Product Engineer, Internal Tools
CALPAK
Gardena, CA
CALPAK is seeking an experienced Senior Product Engineer to lead the development of our internal tools and systems. Serving as both product manager and senior engineer, this role will…
Added 1 hour ago
Software Engineer (AI Agents)
Fluent, LLC
NY · New York, NY
Fluent is hiring its first dedicated AI Engineer. Over the past year, AI at Fluent has moved from pilots to production: a service desk agent that closes tickets without a human touch, a…

Jobgether

Senior Machine Learning Engineer, Inference

Remote, United States

$250,000 to $300,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $250,000 to $300,000 USD / year
Experience: At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.
Posting language: English
Posted: Nov 5, 2026

Original job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Machine Learning Engineer, Inference based in the United States.

Join a high-performing engineering team developing advanced real-time voice and large language model (LLM) technology. As a Senior Machine Learning Engineer, you will own inference optimization from research through production deployment, helping bring sophisticated models to consumer-scale applications. You will tackle complex challenges involving latency, throughput, GPU efficiency, and distributed serving infrastructure. Working directly with modern inference engines, you will apply cutting-edge acceleration techniques to improve performance and scalability. You will collaborate closely with research and product teams to turn innovative models into reliable production systems. This is an opportunity to make a significant technical impact on AI products serving hundreds of millions of users.

Accountabilities

You will lead end-to-end inference optimization, ensuring that advanced machine learning models perform efficiently and reliably in production environments. Your responsibilities will include:

• Own the optimization process from research models to production deployment.

• Improve latency and throughput for real-time voice and LLM inference at consumer scale.

• Work directly with inference engines such as vLLM, TensorRT-LLM (TRT-LLM), and SGLang to enhance performance.

• Implement model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Develop high-performance GPU workloads using C++, CUDA, Rust, or optimized Python.

• Build and scale distributed multi-GPU and multi-node inference systems using Kubernetes, Ray, and custom load-balancing solutions.

• Collaborate with research and product teams to bring new models into production.

Requirements

The ideal candidate is a senior-level machine learning inference or systems engineer with strong hands-on experience optimizing production inference engines and building scalable GPU infrastructure. You should bring:

• At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.

• Practical experience optimizing inference engines such as vLLM or TRT-LLM at the engine level, beyond basic model deployment.

• A proven background in developing backend and machine learning systems and serving models in production.

• Strong systems programming and GPU optimization skills using C++, CUDA, Rust, or optimized Python.

• Hands-on knowledge of model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Experience with distributed systems, Kubernetes, Ray, load balancing, multi-GPU and multi-node inference, and high-concurrency environments.

• Excellent English communication skills.

• Residence in the United States, Canada, the United Kingdom, Germany, Switzerland, or Serbia.

Additional advantages include a track record of rapid career progression, contributions to open-source inference engines or technical publications, and a PhD in Computer Science, Physics, or Mathematics, or a degree from a leading computer science program. The ability to commute to Mountain View, California, is also a plus.

Benefits

• Salary: $250,000–$300,000 annual base salary, plus competitive equity.

• Employment: Full-time, permanent position.

• Work arrangement: Onsite in Mountain View, California, preferred; remote opportunities available in the United States, Canada, the United Kingdom, Germany, Switzerland, and Serbia.

• Visa support: H-1B and OPT transfers supported.

• Relocation assistance: Available for candidates relocating to the San Francisco Bay Area.

• Language: English-speaking working environment.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

Apply About employer

Report this job