Jobs in the United States

25+ jobs

Save this search

Added 3 mins ago
Senior Software Engineer (Institutional, Financing)
Coinbase
Charleston, WV
As a Senior Software Engineer on the Financing Engineering team within the Institutional group, you'll design, build, and scale the systems that safely manage billions of dollars in loans…
Added 3 mins ago
Associate Software Engineer
Highmark Health
Charleston, WV
This job is an integral member of an agile software engineer team responsible for building scalable software applications across all digital channels to serve our customers. Responsible for…
Added 4 mins ago
Mechanical Engineer, Data Center Operations Engineering
Meta
Charleston, WV
Meta is seeking a Mechanical Engineer to join our Data Center Operations Engineering team. Our data centers are the foundation upon which our rapidly growing infrastructure efficiently…
Added 4 mins ago
T
Information Security Engineer
TTEC
Charleston, WV
- $65,000 to $70,000 USD / year
…award-winning employment experience. As a Information Security Engineer working remote in US, you’ll be a part of bringing humanity to business.…
Added 4 mins ago
Director - Customer Response Engineering
Trellix
Charleston, WV
Partner with Technical Support, Customer Success, Product Management, and Engineering so issues reach the right engineer fast and customer feedback reaches the roadmap.
Added 7 mins ago
G
Senior Electrical Engineer
GPAC
Lincoln, NE
- $120,000 to $140,000 USD / year
Hiring a Senior Electrical Engineer to lead electrical system design for a variety of commercial, institutional, healthcare, and retail projects. This position will play a key role in…
Added 8 mins ago
CO
Assistant Electrical Engineer (Department of Utilities)
City of Sacramento
Sacramento, CA
- $38.76 to $54.55 USD / hour
…Engineering Division is seeking a motivated Assistant Electrical Engineer to join the team that plays a vital role in providing electrical engineering support for our drainage, water, and…
Added 8 mins ago
CO
Associate Electrical Engineer (Department of Utilities)
City of Sacramento
Sacramento, CA
- $47.05 to $66.2 USD / hour
THIS POSTING IS FOR ASSOCIATE ELECTRICAL ENGINEER
Added 12 mins ago
RF Digital Circuit Engineer
SAIC
Crane, IN
SAIC is seeking an experienced RF and Digital Circuit Engineer to support the design, development, integration, testing, troubleshooting, and sustainment of complex electronic systems in…
Added 12 mins ago
Key Account Manager
American Electric Power
Elkhart, IN · South Bend, IN · Muncie, IN · Ft. Wayne, IN
Promotes and supports operating company energy efficiency/demand response programs system wide to assigned key accounts.
Added 12 mins ago
C
Staff Engineer, Firmware & Embedded Software
Carrier
Indianapolis, IN
- $96,000 to $192,000 USD / year
The Staff Engineer is a technical expert responsible for leading the embedded design, development, and optimization of embedded software for our next-generation air-conditioner products.
Added 13 mins ago
Principal CSV Engineer - Automation Engineering
Lilly
Indianapolis, IN · Lebanon, IN
This role will work as a member of the Automation Engineering Department at Eli Lilly, Foundry. The engineer will serve as a technical subject matter expert, providing automation support…
Added 15 mins ago
J
Sr. Systems Engineer – AI Gateway Platform
Jobgether
Remote, United States
- $125,000 to $180,000 USD / year
…applications and next steps. Our partner is looking for a Sr. Systems Engineer – AI Gateway Platform based in the United…
Added 28 mins ago
G
Mechanical Design Engineer (HVAC / Plumbing)
GPAC
Union City, CA
- $85,000 to $100,000 USD / year
We are seeking a motivated Mechanical Design Engineer to join an established engineering team in Union City, CA. This position is ideal for someone with a Mechanical Engineering degree and…
Added 29 mins ago
Ordinance Engineer Sr
Lockheed Martin
Courtland, AL
…Prompt Strike (CPS) program is creating the first hypersonic system for the U.S. Navy, and we are looking for talented individuals to join our…
Added 29 mins ago
Systems Engineer 4 - RF Communications - Space AHT
Northrop Grumman
Huntsville, AL
This position is for a Sr Principal Systems Engineer - RF Communications to support the IFICS Data Terminal (IDT) product team on the Ground Based Mid-Course Defense (GMD) Weapon System…
Added 29 mins ago
Senior Principal Test Engineer
Northrop Grumman
Huntsville, AL
Northrop Grumman Defense Systems is seeking to hire a Senior Principal Test Engineer . This position will be located in Huntsville, AL supporting Advanced Programs .
Added 29 mins ago
Principal Engineer Systems - AHT
Northrop Grumman
Huntsville, AL
…Systems Engineering (MBSE) practices to develop and maintain system architectures and models. Performing functional analysis, requirements allocation, interface definition, and system-level…
Added 29 mins ago
Sr. Specialist, Quality Engineering
L3Harris
Huntsville, AL
Job Title: Sr. Specialist, Tooling Quality Engineer
Added 29 mins ago
Staff Engineer Software Architect - Level 5
Northrop Grumman
Huntsville, AL
…exciting career opportunity for a Staff Software Architect Engineer – Level 5 to join our team of qualified, diverse individuals . The position can be located on-site in Boulder, CO,…
Added 29 mins ago
Principal/ Sr Principal Mission Assurance Engineer
Northrop Grumman
Huntsville, AL
Northrop Grumman Defense Systems is seeking a Principal/Sr. Principal Mission Assurance Engineer to support the SLCM-N Program Quality & Mission Assurance Team in Huntsville, AL. This role…
Added 29 mins ago
Senior Materials and Process Engineer
Leidos
Huntsville, AL
We are in search of a motivated, organized, and adaptable Senior Materials & Processes (M&P) Engineer to join the Advanced Materials & Test Division in Huntsville. As a core member of the…
Added 29 mins ago
Senior C/C++ Embedded Software Engineer/Analyst
Intuitive Research and Technology Corporation
Huntsville, AL
We are seeking an experienced C/C++ Embedded Software Engineer who will support the Software and Integration Directorate (S3I) program in the development of launcher control software. In…
Added 29 mins ago
Autonomous Systems Project Engineer- Launched Effects
Integration Innovation, Inc. (i3)
Huntsville, AL
i3 is searching for an Autonomous Systems Project Engineer to serves as the technical innovator and engineering lead driving the development, integration, and flight-testing of…
Added 29 mins ago
Sentinel - Systems Engineer / Principal Systems Engineer
Northrop Grumman
Huntsville, AL
Northrop Grumman Defense has an opening for a Systems Engineer (level 2)/ Principal Systems Engineer (level 3) to support a Futures Program within the Command Systems Business Unit (BU)…

Jobgether

Senior Machine Learning Engineer, Inference

Remote, United States

$250,000 to $300,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $250,000 to $300,000 USD / year
Experience: At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.
Posting language: English
Posted: Nov 5, 2026

Original job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Machine Learning Engineer, Inference based in the United States.

Join a high-performing engineering team developing advanced real-time voice and large language model (LLM) technology. As a Senior Machine Learning Engineer, you will own inference optimization from research through production deployment, helping bring sophisticated models to consumer-scale applications. You will tackle complex challenges involving latency, throughput, GPU efficiency, and distributed serving infrastructure. Working directly with modern inference engines, you will apply cutting-edge acceleration techniques to improve performance and scalability. You will collaborate closely with research and product teams to turn innovative models into reliable production systems. This is an opportunity to make a significant technical impact on AI products serving hundreds of millions of users.

Accountabilities

You will lead end-to-end inference optimization, ensuring that advanced machine learning models perform efficiently and reliably in production environments. Your responsibilities will include:

• Own the optimization process from research models to production deployment.

• Improve latency and throughput for real-time voice and LLM inference at consumer scale.

• Work directly with inference engines such as vLLM, TensorRT-LLM (TRT-LLM), and SGLang to enhance performance.

• Implement model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Develop high-performance GPU workloads using C++, CUDA, Rust, or optimized Python.

• Build and scale distributed multi-GPU and multi-node inference systems using Kubernetes, Ray, and custom load-balancing solutions.

• Collaborate with research and product teams to bring new models into production.

Requirements

The ideal candidate is a senior-level machine learning inference or systems engineer with strong hands-on experience optimizing production inference engines and building scalable GPU infrastructure. You should bring:

• At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.

• Practical experience optimizing inference engines such as vLLM or TRT-LLM at the engine level, beyond basic model deployment.

• A proven background in developing backend and machine learning systems and serving models in production.

• Strong systems programming and GPU optimization skills using C++, CUDA, Rust, or optimized Python.

• Hands-on knowledge of model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Experience with distributed systems, Kubernetes, Ray, load balancing, multi-GPU and multi-node inference, and high-concurrency environments.

• Excellent English communication skills.

• Residence in the United States, Canada, the United Kingdom, Germany, Switzerland, or Serbia.

Additional advantages include a track record of rapid career progression, contributions to open-source inference engines or technical publications, and a PhD in Computer Science, Physics, or Mathematics, or a degree from a leading computer science program. The ability to commute to Mountain View, California, is also a plus.

Benefits

• Salary: $250,000–$300,000 annual base salary, plus competitive equity.

• Employment: Full-time, permanent position.

• Work arrangement: Onsite in Mountain View, California, preferred; remote opportunities available in the United States, Canada, the United Kingdom, Germany, Switzerland, and Serbia.

• Visa support: H-1B and OPT transfers supported.

• Relocation assistance: Available for candidates relocating to the San Francisco Bay Area.

• Language: English-speaking working environment.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

Apply About employer

Report this job