Jobs in the United States

25+ jobs

Save this search

Added 1 min ago
UA
SUPERVISORY EMERGENCY MANAGEMENT SPECIALIST
U.S. Army Corps of Engineers
Philadelphia, PA
- $117,284 to $152,471 USD / year
…involved in emergency operations. | Represent the District Engineer at disaster coordination meetings involving Regional Directors from several federal agencies, State, and local…
Added 5 mins ago
VH
Supervisory Healthcare Engineer
Veterans Health Administration
Kings, NY
- $174,922 to $227,406 USD / year
The Healthcare Engineer provides for a safe, reliable, and precisely controlled operating environment for direct patient care. Healthcare Engineers serve as experts in the design,…
Added 5 mins ago
Lead Transmission Line Engineer - Remote
ICF
Kansas City, MO
We are seeking a Lead Transmission Line Engineer to support and advance our growing transmission engineering practice. In this role, you will provide senior‑level technical expertise, lead…
Added 6 mins ago
Principal Engineer Software (Idira IGA)
Palo Alto Networks
Needham Heights, MA
We are seeking a Principal Engineer Software to lead the technical evolution of our Identity Governance & Administration (IGA) platform. This is a role for a deeply technical, hands-on…
Added 6 mins ago
Principal Engineer Software (IGA platform)
Palo Alto Networks
Needham Heights, MA
We are seeking a Principal Engineer Software to lead the technical evolution of our Identity Governance & Administration (IGA) platform. This is a role for a deeply technical, hands-on…
Added 6 mins ago
JW
Senior Application Engineer-Electrical
Judd Wire Inc.
Turners Falls, MA
- $120,840 USD / year
Senior Application Engineer - Electrical Description Judd Wire Inc., a Sumitomo Electric Group company, is looking for a Senior Application Engineer - Aerospace for our Turners Falls, MA…
Added 6 mins ago
Manufacturing Engineer 3 - 31037
Huntington Ingalls Industries
Pocasset, MA
HII creates advanced unmanned solutions for defense, marine research and commercial applications. Serving customers in more than 30 countries, HII provides design, autonomy, manufacturing,…
Added 6 mins ago
Engineer V
General Atomics
Acton, MA
…Technology Products’ Systems Engineering Directorate for a Project Engineer to lead engineering and development of cutting-edge GA-EMS products and technologies. This position directly…
Added 6 mins ago
Software QA Engineer II Senior - (E2)
Applied Materials
Billerica, MA
…the foundation of virtually every new semiconductor chip and advanced display in the world. The equipment that we create and service is essential to advancing AI and accelerating the…
Added 6 mins ago
Software Quality Engineer I
Medtronic
Newton, MA
We anticipate the application window for this opening will close on - 10 Nov 2026
Added 6 mins ago
Software Test Engineer I
Medtronic
Newton, MA
Medtronic is seeking a motivated and detail-oriented Software Test Engineer to join our Affera Mapping and Ablation System team. This role is essential in supporting the testing and quality…
Added 7 mins ago
Sr Software Engineer (HashiCorp Vault)
IBM
LOWELL, MA
We're looking for a seasoned engineer to design, build, and operate HashiCorp Vault as a service. You'll be responsible for secure, highly available, and compliant secrets management…
Added 7 mins ago
Senior Geothermal Consultant Job Details | Black & Veatch Family of Companies
Black & Veatch
Burlington, MA
Support Owner’s Engineer / Independent Engineer scopes through disciplined technical review.
Added 7 mins ago
Northeast Tunnels Regional Practice Lead Job Details | Black & Veatch Family of Companies
Black & Veatch
Burlington, MA
…teams on heavy civil projects. With minimal supervision, apply advanced engineering techniques and analyses for problems and methods and may supervise multi-discipline engineering staff on…
Added 7 mins ago
Front End Web Applications Developer (Mid-Level) (5664)
SMX
Boston, MA
SMX is currently looking for a highly motivated Software Engineer - Front End Web Applications to contribute to the design, build, support, and implementation of the Budget and Spend (BAS)…
Added 7 mins ago
Senior Telecom Engineer
Maximus
Boston, MA
Maximus is seeking an experienced Senior Telecom Engineer to lead the design, implementation, and optimization of Genesys Cloud solutions. This role is responsible for executing large-scale…
Added 7 mins ago
Substation Engineer - Protection and Controls
Jacobs
Boston, MA
…understanding the client standards, provide feedback on the application and be able to develop Substation design deliverables fully and independently as required for the projects on-time…
Added 7 mins ago
Lead Open Source Developer - TypeScript/Node/Angular/React/.NET
Kelly Services
Boston, MA
We are seeking a Lead Open Source Software Engineer to provide technical leadership across a growing suite of open source products and platforms. This role combines hands-on software…
Added 7 mins ago
Lead Substation Engineer - Protection and Controls
Jacobs
Boston, MA
…understanding the client standards, provide feedback on the application and be able to develop Substation design deliverables fully and independently as required for the projects on-time…
Added 7 mins ago
Agentic automation, Frontier AI
Lilly
Boston, MA
…foundational platforms, streamlining lab operations through advanced technologies and data connectivity, and intentionally investing in novel technologies and…
Added 7 mins ago
EG
Staff AI & Data Engineer – Databricks
Eliassen Group
Boston, MA
- $80 to $90 USD / hour
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the…
Added 8 mins ago
UC
Supervisory General Engineer
U.S. Coast Guard
Norfolk, VA
- $127,646 to $165,945 USD / year
This vacancy is for a GS-0801-14, Supervisory General Engineer located in the Department of Homeland Security, U.S. Coast Guard, SILC ENGINEERING SERVICES DIVISION in NORFOLK, Virginia.
Added 8 mins ago
UC
Supervisory General Engineer
U.S. Coast Guard
Norfolk, VA
- $127,646 to $165,945 USD / year
This vacancy is for a GS - 0801 - 14, Supervisory General Engineer located in the Department of Homeland Security, U.S. Coast Guard, SILC ENGINEERING SERVICES DIVISION in NORFOLK, Virginia.
Added 10 mins ago
NG
Mechanical Engineer
National Gallery of Art
Washington, DC
- $121,785 to $158,322 USD / year
Preparing the scope of work for architect and engineer (A&E) contracts and reviewing the contractor's designs.
Added 10 mins ago
NG
Mechanical Engineer
National Gallery of Art
Washington, DC
- $121,785 to $158,322 USD / year
Preparing the scope of work for architect and engineer (A&E) contracts and reviewing the contractor's designs.

Jobgether

Senior Machine Learning Engineer, Inference

Remote, United States

$250,000 to $300,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $250,000 to $300,000 USD / year
Experience: At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.
Posting language: English
Posted: Nov 5, 2026

Original job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Machine Learning Engineer, Inference based in the United States.

Join a high-performing engineering team developing advanced real-time voice and large language model (LLM) technology. As a Senior Machine Learning Engineer, you will own inference optimization from research through production deployment, helping bring sophisticated models to consumer-scale applications. You will tackle complex challenges involving latency, throughput, GPU efficiency, and distributed serving infrastructure. Working directly with modern inference engines, you will apply cutting-edge acceleration techniques to improve performance and scalability. You will collaborate closely with research and product teams to turn innovative models into reliable production systems. This is an opportunity to make a significant technical impact on AI products serving hundreds of millions of users.

Accountabilities

You will lead end-to-end inference optimization, ensuring that advanced machine learning models perform efficiently and reliably in production environments. Your responsibilities will include:

• Own the optimization process from research models to production deployment.

• Improve latency and throughput for real-time voice and LLM inference at consumer scale.

• Work directly with inference engines such as vLLM, TensorRT-LLM (TRT-LLM), and SGLang to enhance performance.

• Implement model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Develop high-performance GPU workloads using C++, CUDA, Rust, or optimized Python.

• Build and scale distributed multi-GPU and multi-node inference systems using Kubernetes, Ray, and custom load-balancing solutions.

• Collaborate with research and product teams to bring new models into production.

Requirements

The ideal candidate is a senior-level machine learning inference or systems engineer with strong hands-on experience optimizing production inference engines and building scalable GPU infrastructure. You should bring:

• At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.

• Practical experience optimizing inference engines such as vLLM or TRT-LLM at the engine level, beyond basic model deployment.

• A proven background in developing backend and machine learning systems and serving models in production.

• Strong systems programming and GPU optimization skills using C++, CUDA, Rust, or optimized Python.

• Hands-on knowledge of model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Experience with distributed systems, Kubernetes, Ray, load balancing, multi-GPU and multi-node inference, and high-concurrency environments.

• Excellent English communication skills.

• Residence in the United States, Canada, the United Kingdom, Germany, Switzerland, or Serbia.

Additional advantages include a track record of rapid career progression, contributions to open-source inference engines or technical publications, and a PhD in Computer Science, Physics, or Mathematics, or a degree from a leading computer science program. The ability to commute to Mountain View, California, is also a plus.

Benefits

• Salary: $250,000–$300,000 annual base salary, plus competitive equity.

• Employment: Full-time, permanent position.

• Work arrangement: Onsite in Mountain View, California, preferred; remote opportunities available in the United States, Canada, the United Kingdom, Germany, Switzerland, and Serbia.

• Visa support: H-1B and OPT transfers supported.

• Relocation assistance: Available for candidates relocating to the San Francisco Bay Area.

• Language: English-speaking working environment.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

Apply About employer

Report this job