Jobs in the United States

25+ jobs

Save this search

Added 2 mins ago
LEAD PRINCIPAL ENGINEER, ID1 ATE DE PROC
Micron Idaho Semiconductor Manufacturing (Triton) LLC
Boise, ID
Etch process development on the latest state-of-the-art plasma etch tools, necessitating proficiency in Inductively Coupled Plasma (ICP), Capacitively Coupled Plasma (CCP), and Electron…
Added 2 mins ago
Director BESS
Constellation Energy Generation, LLC.
Kennett Square, PA
Directs overall management of the Battery Energy Storage Systems (BESS) project and is fully responsible for BESS engineering and technology. Lead BESS team efforts to support the…
Added 7 mins ago
E T Consultant
World Bank Group
Washington, DC
ITSFE is seeking a skilled and experienced Solution Engineer to join our growing team as an ET Consultant. The Solution Engineer will design, build, enhance, and support web-based solutions…
Added 9 mins ago
J
Software Engineer Lead
Jobgether
Remote, United States
- $105,000 to $135,000 USD / year
As a Software Engineer Lead, you will oversee the design, development, and lifecycle management of enterprise software solutions supporting digital banking, financial applications, and…
Added 9 mins ago
J
Senior Machine Learning Engineer, Inference
Jobgether
Remote, United States
- $250,000 to $300,000 USD / year
Join a high-performing engineering team developing advanced real-time voice and large language model (LLM) technology. As a Senior Machine Learning Engineer, you will own inference…
Added 11 mins ago
Sr. Engineer - Electrical Maintenance
MAHLE
Pithampur, IN
Work closely with cross-functional teams, including quality control, production, engineering, and R&D, to ensure smooth production flow and the successful integration of new technologies.
Added 13 mins ago
Principal Electrical Engineer
Oracle
Santa Clara, CA · Burlington, MA
Oracle's Hardware Development Organization seeks to add an experienced On-Board Power Engineer to work within our Server Development team in Santa Clara, California or in Burlington MA. As…
Added 13 mins ago
O
Senior Network Developer
Oracle
Seattle, WA · Nashville, TN · Redwood City, CA · Santa Clara, CA · Reston, VA
- $91,400 to $187,000 USD / year
The mission of our Network Development Engineering team is to provide services that allow our customers to drive operational excellence in OCI networks at scale. Our customers want…
Added 27 mins ago
A
Sr Civil Track Engineer
AECOM
Fresno, CA
- $90,000 to $160,000 USD / year
Under the direction of the Rail Infrastructure Manager, the Senior Track & Civil Engineer provides advanced engineering support for track and civil infrastructure design & construction and…
Added 27 mins ago
A
Sr Civil Track Engineer
AECOM
Bakersfield, CA
- $90,000 to $160,000 USD / year
Under the direction of the Rail Infrastructure Manager, the Senior Track & Civil Engineer provides advanced engineering support for track and civil infrastructure design & construction and…
Added 27 mins ago
A
Sr Civil Track Engineer
AECOM
Sacramento, CA
- $90,000 to $160,000 USD / year
Under the direction of the Rail Infrastructure Manager, the Senior Track & Civil Engineer provides advanced engineering support for track and civil infrastructure design & construction and…
Added 27 mins ago
A
Mid-Level Civil Construction Engineer (4 years experience required)
AECOM
Fresno, CA
- $80,000 to $140,000 USD / year
The Construction Engineer will support the California High-Speed Rail program by contributing to engineering analysis, data management, and performance reporting. This role is suited for an…
Added 27 mins ago
A
Mid-Level Civil Construction Engineer (4 years experience required)
AECOM
Bakersfield, CA
- $80,000 to $140,000 USD / year
The Construction Engineer will support the California High-Speed Rail program by contributing to engineering analysis, data management, and performance reporting. This role is suited for an…
Added 27 mins ago
A
Mid-Level Civil Construction Engineer (4 years experience required)
AECOM
Sacramento, CA
- $80,000 to $140,000 USD / year
The Construction Engineer will support the California High-Speed Rail program by contributing to engineering analysis, data management, and performance reporting. This role is suited for an…
Added 27 mins ago
A
Railroad Bridge Engineer
AECOM
Sacramento, CA
- $140,000 to $240,000 USD / year
This role will review bridge designs, evaluate contractor submittals, and resolves field engineering issues to ensure compliance with project specifications, design standards, and…
Added 27 mins ago
A
Railroad Bridge Engineer
AECOM
Fresno, CA
- $140,000 to $240,000 USD / year
This role will review bridge designs, evaluate contractor submittals, and resolves field engineering issues to ensure compliance with project specifications, design standards, and…
Added 27 mins ago
A
Railroad Bridge Engineer
AECOM
Bakersfield, CA
- $140,000 to $240,000 USD / year
This role will review bridge designs, evaluate contractor submittals, and resolves field engineering issues to ensure compliance with project specifications, design standards, and…
Added 27 mins ago
A
Civil Construction Engineer (2 years of experience required)
AECOM
Bakersfield, CA
- $80,000 to $120,000 USD / year
The Construction Engineer will support the California High-Speed Rail program by contributing to engineering analysis, data management, and performance reporting. This role is suited for an…
Added 27 mins ago
A
Civil Construction Engineer (2 years of experience required)
AECOM
Fresno, CA
- $80,000 to $120,000 USD / year
The Construction Engineer will support the California High-Speed Rail program by contributing to engineering analysis, data management, and performance reporting. This role is suited for an…
Added 27 mins ago
A
Civil Construction Engineer (2 years of experience required)
AECOM
Sacramento, CA
- $80,000 to $120,000 USD / year
The Construction Engineer will support the California High-Speed Rail program by contributing to engineering analysis, data management, and performance reporting. This role is suited for an…
Added 27 mins ago
Data Center Electrical Engineer
Google
Bridgeport, CT
As a Data Center Services Electrical Engineer, you will play a crucial role in the field-level implementation and operational support of Google’s rapidly expanding data centers. You will be…
Added 27 mins ago
Hardware/Software Co-Design Engineer, Inference
Google
Sunnyvale, CA
In most instances, this position requires in-person interviews as part of the hiring process.
Added 28 mins ago
Process Engineer Staff
Plexus Manufacturing Sdn. Bhd.
Neenah, WI
Purpose Statement: The process engineer is responsible for providing technical expertise throughout the manufacturing process. This role involves offering guidance on best practices and…
Added 28 mins ago
PS
Project Engineer (Staff, Senior, or Prinicpal) - Denver, CO
Public Service Co. of Colorado
Denver, CO
- $81,800 to $156,600 USD / year
Under general direction, this Project Engineer role will demonstrate complete understanding & wide application of engineering technical principle, theories, & concepts in the field.…
Added 35 mins ago
Staff Thin Film Process Development Engineer
Micron Technology, Inc.
Boise, ID
As a Staff Thin Film Process Development Engineer, you will develop and own advanced thin-film deposition processes supporting next-generation semiconductor technologies. You will translate…

Jobgether

Senior Machine Learning Engineer, Inference

Remote, United States

$250,000 to $300,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $250,000 to $300,000 USD / year
Experience: At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.
Posting language: English
Posted: Nov 5, 2026

Original job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Machine Learning Engineer, Inference based in the United States.

Join a high-performing engineering team developing advanced real-time voice and large language model (LLM) technology. As a Senior Machine Learning Engineer, you will own inference optimization from research through production deployment, helping bring sophisticated models to consumer-scale applications. You will tackle complex challenges involving latency, throughput, GPU efficiency, and distributed serving infrastructure. Working directly with modern inference engines, you will apply cutting-edge acceleration techniques to improve performance and scalability. You will collaborate closely with research and product teams to turn innovative models into reliable production systems. This is an opportunity to make a significant technical impact on AI products serving hundreds of millions of users.

Accountabilities

You will lead end-to-end inference optimization, ensuring that advanced machine learning models perform efficiently and reliably in production environments. Your responsibilities will include:

• Own the optimization process from research models to production deployment.

• Improve latency and throughput for real-time voice and LLM inference at consumer scale.

• Work directly with inference engines such as vLLM, TensorRT-LLM (TRT-LLM), and SGLang to enhance performance.

• Implement model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Develop high-performance GPU workloads using C++, CUDA, Rust, or optimized Python.

• Build and scale distributed multi-GPU and multi-node inference systems using Kubernetes, Ray, and custom load-balancing solutions.

• Collaborate with research and product teams to bring new models into production.

Requirements

The ideal candidate is a senior-level machine learning inference or systems engineer with strong hands-on experience optimizing production inference engines and building scalable GPU infrastructure. You should bring:

• At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.

• Practical experience optimizing inference engines such as vLLM or TRT-LLM at the engine level, beyond basic model deployment.

• A proven background in developing backend and machine learning systems and serving models in production.

• Strong systems programming and GPU optimization skills using C++, CUDA, Rust, or optimized Python.

• Hands-on knowledge of model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Experience with distributed systems, Kubernetes, Ray, load balancing, multi-GPU and multi-node inference, and high-concurrency environments.

• Excellent English communication skills.

• Residence in the United States, Canada, the United Kingdom, Germany, Switzerland, or Serbia.

Additional advantages include a track record of rapid career progression, contributions to open-source inference engines or technical publications, and a PhD in Computer Science, Physics, or Mathematics, or a degree from a leading computer science program. The ability to commute to Mountain View, California, is also a plus.

Benefits

• Salary: $250,000–$300,000 annual base salary, plus competitive equity.

• Employment: Full-time, permanent position.

• Work arrangement: Onsite in Mountain View, California, preferred; remote opportunities available in the United States, Canada, the United Kingdom, Germany, Switzerland, and Serbia.

• Visa support: H-1B and OPT transfers supported.

• Relocation assistance: Available for candidates relocating to the San Francisco Bay Area.

• Language: English-speaking working environment.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

Apply About employer

Report this job