Jobs in the United States

25+ jobs

Save this search

Added just now
Operations Performance Engineer
ROHM & HAAS CHEMICALS LLC
Bristol, PA
Dow has an exciting opportunity for an Operations Performance Engineer located in Bristol (PA, USA).
Added 1 min ago
Senior Solutions Specialist
TensorWave
Las Vegas, NV
…sales, marketing, and partnerships, including the Deal Desk process and pipeline reporting. Your primary focus will be matching active deals, to available capacity. You'll also support Deal…
Added 1 min ago
SB
Staff Firmware Engineer - AMR
Standard Bots
Boston, MA
- $180,000 to $215,000 USD / year
We're looking for an exceptional Staff Firmware Engineer to lead the firmware of Bolt's mobile base. This role sets the firmware architecture for that base from the first prototype: drive…
Added 1 min ago
Federal Data and Analytics Sr Sales Executive
ServiceNow
Remote, United States
It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy. That moment inspired Fred to build a company that could…
Added 1 min ago
Sr. Systems Reliability Engineer
TECHTRONIC CORDLESS GP
Brookfield, WI
The Sr. Systems Reliability Engineer will provide technical leadership in the development, validation, and reliability of complex product systems that integrate electrical hardware,…
Added 1 min ago
Senior Security Engineer – ServiceNow SIR & DLP
Bank of America, National Association
WA
Senior Technology Delivery Lead will lead the end-to-end technology delivery of our enterprise ServiceNow Security Incident Response (SIR) and Data Loss Prevention (DLP) capabilities.
Added 2 mins ago
Manager, Renewable Development
Invenergy LLC
Denver, CO
Lead development activities in early, mid, and/or late stages of the project.
Added 4 mins ago
Senior Structural Associate
USA Thornton Tomasetti, Inc.
Kansas City, MO
…mission is to bring our clients' ideas to life and, in the process, lay the groundwork for a better, more resilient future. We provide support and opportunities to our employees to achieve…
Added 4 mins ago
Quality Engineer
nLIGHT
Camas, WA
5 years experience working as a Quality Engineer, Product Engineer, Process Engineer, Manufacturing Engineer, or Industrial Engineer.
Added 4 mins ago
Senior Lead Software Engineer - Security Platforms
JPMC page
Jersey City, NJ · Brooklyn, NY · Columbus, OH · Plano, TX · Tampa, FL · NY
As a Senior Lead Software Engineer at JPMorganChase within Consumer & Community Banking, you are an integral part of an agile team that works to enhance, build, and deliver trusted…
Added 4 mins ago
O
Senior Network Development Engineer
Oracle
Seattle, WA
- $91,400 to $187,000 USD / year
Participates in network solution and architecture design process and contribute to the roadmaps development.
Added 5 mins ago
Engineer V (LNG/LPG Senior Engineer)- $80 per hr-
Scope Services
Hopkinton, MA
The Senior Engineer reports directly to the Lead Engineer.
Added 5 mins ago
Engineer V (Electrical Engineer)- $85.00-90 per hr
Scope Services
Hopkinton, MA
…systems. Working with related discipline engineers, the electrical engineer will provide guidance on how to best select and integrate new equipment into the plant. The electrical engineer…
Added 5 mins ago
Data Engineer Senior - Data Modeling
PNC Bank NA
PA
As a Senior Data Engineer, you will partner closely with a Lead to design, build, and support scalable data solutions. This is a hands-on role focused on data engineering, governance, and…
Added 5 mins ago
Data Engineer Senior - Data Modeling
PNC Bank NA
PA
As a Senior Data Engineer, you will partner closely with a Lead to design, build, and support scalable data solutions. This is a hands-on role focused on data engineering, governance, and…
Added 7 mins ago
AP
Senior Software Engineer, Data Activation & Products - Activision
ACTIVISION PUBLISHING, INC.
United States
- $102,800 to $190,204 USD / year
We are looking for a talented Senior Software Engineer to join the Data Activation & Products team! You will help set the software engineering standards for our team, build internal…
Added 8 mins ago
Sr Principal Engineer - IPT Leader
RTX
United States
The Effector Guidance Electronics Team is searching for a Sr. Principal Engineer with Integrated Product Team management experience. The role of the Sr. Principal Engineer is to lead and…
Added 8 mins ago
High Temperature Composites Engineer (Onsite)
RTX
United States
We are seeking a motivated and detail-oriented Sr. Engineer to join our High Temperature Composites (HTC) team. The HTC Engineer position is for an experienced engineer with a Degree in…
Added 8 mins ago
R
Principal Test Equipment Maintenance Tech Lead - PART TIME
RTX
United States
- Part-time
Raytheon is seeking a motivated Principal Electrical Engineer to fill key Maintenance, Repair and Engineering Technical training role within the Metrology & Test Equipment Maintenance…
Added 8 mins ago
Software Engineer
RTX
United States
The Strategic Communication Software (SW) Engineering Department has an opportunity for a talented Software Engineer II to join our team onsite in Largo Florida. This role requires a…
Added 8 mins ago
Software Engineer II
RTX
United States
The Strategic Communication Software (SW) Engineering Department has an opportunity for a talented Software Engineer II to join our team onsite in Largo Florida. This role requires a…
Added 8 mins ago
Senior Software Engineer
RTX
United States
The Strategic Communication Software (SW) Engineering Department has an opportunity for a talented Sr Software Engineer to join our team onsite in Largo Florida. This role requires a…
Added 8 mins ago
Sr Metrology Engineer
RTX
United States
…manufacturing, and test operations. We are seeking a Senior Metrology Engineer to provide technical leadership for calibration processes, measurement uncertainty analysis, decision rules,…
Added 8 mins ago
Project Chief, Cyber & Assurance R&D
RTX
United States
Collins Applied Research & Technology seeks a Project Chief Engineer to manage a diverse portfolio of emerging technologies in cyber security, tactical operations, and high assurance…
Added 8 mins ago
Ci2 Chief Engineer
RTX
United States
As Chief Engineer, you will lead engineering teams (e.g. infrastructure, software, systems, specialties) to achieve program and technical success aligned with our customer and mission needs…

Jobgether

Senior Machine Learning Engineer, Inference

Remote, United States

$250,000 to $300,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $250,000 to $300,000 USD / year
Experience: At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.
Posting language: English
Posted: Nov 5, 2026

Original job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Machine Learning Engineer, Inference based in the United States.

Join a high-performing engineering team developing advanced real-time voice and large language model (LLM) technology. As a Senior Machine Learning Engineer, you will own inference optimization from research through production deployment, helping bring sophisticated models to consumer-scale applications. You will tackle complex challenges involving latency, throughput, GPU efficiency, and distributed serving infrastructure. Working directly with modern inference engines, you will apply cutting-edge acceleration techniques to improve performance and scalability. You will collaborate closely with research and product teams to turn innovative models into reliable production systems. This is an opportunity to make a significant technical impact on AI products serving hundreds of millions of users.

Accountabilities

You will lead end-to-end inference optimization, ensuring that advanced machine learning models perform efficiently and reliably in production environments. Your responsibilities will include:

• Own the optimization process from research models to production deployment.

• Improve latency and throughput for real-time voice and LLM inference at consumer scale.

• Work directly with inference engines such as vLLM, TensorRT-LLM (TRT-LLM), and SGLang to enhance performance.

• Implement model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Develop high-performance GPU workloads using C++, CUDA, Rust, or optimized Python.

• Build and scale distributed multi-GPU and multi-node inference systems using Kubernetes, Ray, and custom load-balancing solutions.

• Collaborate with research and product teams to bring new models into production.

Requirements

The ideal candidate is a senior-level machine learning inference or systems engineer with strong hands-on experience optimizing production inference engines and building scalable GPU infrastructure. You should bring:

• At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.

• Practical experience optimizing inference engines such as vLLM or TRT-LLM at the engine level, beyond basic model deployment.

• A proven background in developing backend and machine learning systems and serving models in production.

• Strong systems programming and GPU optimization skills using C++, CUDA, Rust, or optimized Python.

• Hands-on knowledge of model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Experience with distributed systems, Kubernetes, Ray, load balancing, multi-GPU and multi-node inference, and high-concurrency environments.

• Excellent English communication skills.

• Residence in the United States, Canada, the United Kingdom, Germany, Switzerland, or Serbia.

Additional advantages include a track record of rapid career progression, contributions to open-source inference engines or technical publications, and a PhD in Computer Science, Physics, or Mathematics, or a degree from a leading computer science program. The ability to commute to Mountain View, California, is also a plus.

Benefits

• Salary: $250,000–$300,000 annual base salary, plus competitive equity.

• Employment: Full-time, permanent position.

• Work arrangement: Onsite in Mountain View, California, preferred; remote opportunities available in the United States, Canada, the United Kingdom, Germany, Switzerland, and Serbia.

• Visa support: H-1B and OPT transfers supported.

• Relocation assistance: Available for candidates relocating to the San Francisco Bay Area.

• Language: English-speaking working environment.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

Apply About employer

Report this job