Find work in the United States.

A simpler way to find your next job.

Jobs in the United States

25+ jobs

Save this search

Added 2 mins ago
J
Senior Software Engineer
Jobgether
Remote, United States
- $170,000 to $200,000 USD / year
This is an opportunity to join a fully remote, AI-first engineering team building intelligent systems that optimize cloud data warehouse performance and costs. As a Senior Software…
Added 2 mins ago
J
Senior Backend Cloud Engineer
Jobgether
Remote, United States
- $120,000 to $170,000 USD / year
This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Senior Backend Cloud Engineer based in the United States.
Added 2 mins ago
Network Operations Manager
Jobgether
Remote, United States
…environments and data center infrastructure. You will serve as the senior technical escalation point, guiding critical incident resolution and driving proactive improvements across multiple…
Added 7 mins ago
AI Connect Principal Engineer
Verizon Services Corp. BC
Irving, TX · Chicago, IL · Denver, CO · Basking Ridge, NJ · Las Vegas, NV · Chandler, AZ · Kansas City, MO
…transport networks engineered for immense scale. As a Principal Engineer and senior individual contributor within Network Engineering, you will serve as the chief technical authority…
Added 18 mins ago
Senior Electrical Commissioning Engineer
FST Technical Services
York, PA
A Senior Electrical Commissioning Project engineer reports to a team leader and is responsible for the delivery and execution of our professional services tasks for equipment and associated…
Added 39 mins ago
Sr. Software Development Engineer, GenAI, Kumo
Amazon Web Services, Inc.
Bellevue, WA
…fulfilling the vision of a self-healing cloud. We are looking for Senior Software Developer with unfettered curiosity and drive to help build “best in the world” support (contact center)…
Added 40 mins ago
Senior Process Engineer
Bachmann Chemical and Engineering
Torrington, CT
…well-qualified individual to join our talented team as our Sr. Process Engineer. In this role, you will develop and implement manufacturing processes, procedures, and equipment through…
Added 40 mins ago
Senior Firmware Equipment Engineer
Bachmann Chemical and Engineering
Torrington, CT
…individual to join our talented team as ourFirmware Equipment Engineer. In this role, you will develop robust, maintainable embedded firmware that supports reliable and on-time equipment…
Added 44 mins ago
CO
Senior Engineer/Senior Project Manager
City of San Mateo
San Mateo, CA
- $149,364 to $194,916 USD / year
Senior Engineer/Senior Project Manager to join our Public Works Department!
Added 1 hour ago
G
Transportation Engineer
GPAC
Bloomington, IN
- $70,000 to $145,000 USD / year
We are seeking a Transportation Engineer to join a dynamic, multi-disciplinary engineering consulting firm. This individual will contribute to the planning, design, and delivery of…
Added 1 hour ago
Senior Software Development Engineer in Test (SDET)
Jobgether
Remote, United States
The Senior Software Development Engineer in Test (SDET) will play a key role in ensuring the quality, reliability, and performance of innovative digital healthcare technology solutions. In…
Added 1 hour ago
Lead Specialist, Technical Architect
Pearson
Jefferson City, MO
As a Quality Engineer Architect aligned to the E30 expert track, you provide domain-level quality leadership for ExamDeveloper. This role is unique within the ExamDeveloper quality…
Added 2 hours ago
Senior Linux System Administrator - 306502
Delaware Nation Industries
Dahlgren, VA
Delaware Nation Industries is seeking a Linux System Administrator – Senior to provide advanced systems administration and engineering support for the Air Force Joint Worldwide Intelligence…
Added 2 hours ago
Senior MEP Resident Engineer
ZUTARI 2026
Africa, GA
To provide senior technical leadership and site-based supervision of mechanical, electrical, fire protection, controls and related mission-critical systems throughout data-centre…
Added 2 hours ago
T
Site Operations Manager
TEKsystems
St Francisville, LA
- $85 USD / hour
…sites critical environment. The Site Manager serves as the senior single point of contact to site leadership and oversees the supplier team across all shifts, ensuring consistent…
Added 2 hours ago
Senior DevOps
KēSTA I.T.
Remote, United States
…team in Spain. The role takes direction from the principal engineer and works in a fully remote, highly self-directed way. The first priority is getting up to speed on existing systems,…
Added 2 hours ago
Forward Deployed Engineer (FDE)
PVM, Inc.
Arlington, VA
PVM is hiring a Senior Forward Deployed Engineer to serve as a technical lead for Southern California Edison's environments in Palantir Foundry. These systems support wildfire mitigation,…
Added 4 hours ago
PKI Engineer, Senior
BOOZ, ALLEN & HAMILTON, INC.
Laurel, MD
As an Identity and Access Management ( IAM ) engineer at Booz Allen, you'll play a critical role in the world of IAM and Zero T rus t. In this role, you'll support large-scale PKI projects…
Added 4 hours ago
Platform Tooling Engineer
GD Information Technology, Inc.
United States
We are seeking a Platform Tooling Engineer to join our team supporting Centers for Medicare & Medicaid Services (CMS) Agile Tools, Licensing and Shared Services (ATLAS) program. NOTE: This…
Added 4 hours ago
Graduate Development Program, Associate Engineer, Electrical Planning and Design
natgridProd
Syracuse, NY · Buffalo, NY · Albany, NY
…help shape the future of the electric grid? As an Associate Engineer in Electrical Planning and Design, you’ll support projects that help keep electric service safe, reliable, and ready for…
Added 4 hours ago
Graduate Development Program, Associate Engineer, Transmission & Distribution Line Standards
natgridProd
Northboro, MA
Interested in helping shape the standards that power the electric grid? As an Associate Engineer, you'll work alongside experienced engineers and industry experts to develop and maintain…
Added 4 hours ago
Graduate Development Program, Associate Engineer, Transmission Planning Modeling
natgridProd
Waltham, MA
Interested in helping shape the future of the electric grid? As an Associate Engineer on the Transmission Planning Modeling team, you'll help develop and maintain the power system models…
Added 4 hours ago
Graduate Development Program, Associate Engineer, Transmission Planning
natgridProd
Waltham, MA
Interested in helping shape the future of the electric grid? As an Associate Engineer on the Transmission Planning team, you'll support studies and analyses that help ensure the safe,…
Added 5 hours ago
Enterprise - Senior Software Engineer - Spring, Java, JavaScript
Erias Ventures, LLC
Columbia, MD
The Software Engineer develops, maintains, and enhances complex and diverse software systems (e.g., processing-intensive analytics, novel algorithm development, manipulation of extremely…
Added 5 hours ago
Senior Cloud Security Engineer
Altera Corporation
San Jose, CA
The Senior Cloud Security Engineer is a hands-on technical lead responsible for designing, implementing, and improving security across the organization’s Microsoft Azure and Amazon Web…

Jobgether

Senior Machine Learning Engineer, Inference

Remote, United States

$250,000 to $300,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $250,000 to $300,000 USD / year
Experience: At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.
Posting language: English
Posted: Nov 5, 2026

Original job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Machine Learning Engineer, Inference based in the United States.

Join a high-performing engineering team developing advanced real-time voice and large language model (LLM) technology. As a Senior Machine Learning Engineer, you will own inference optimization from research through production deployment, helping bring sophisticated models to consumer-scale applications. You will tackle complex challenges involving latency, throughput, GPU efficiency, and distributed serving infrastructure. Working directly with modern inference engines, you will apply cutting-edge acceleration techniques to improve performance and scalability. You will collaborate closely with research and product teams to turn innovative models into reliable production systems. This is an opportunity to make a significant technical impact on AI products serving hundreds of millions of users.

Accountabilities

You will lead end-to-end inference optimization, ensuring that advanced machine learning models perform efficiently and reliably in production environments. Your responsibilities will include:

• Own the optimization process from research models to production deployment.

• Improve latency and throughput for real-time voice and LLM inference at consumer scale.

• Work directly with inference engines such as vLLM, TensorRT-LLM (TRT-LLM), and SGLang to enhance performance.

• Implement model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Develop high-performance GPU workloads using C++, CUDA, Rust, or optimized Python.

• Build and scale distributed multi-GPU and multi-node inference systems using Kubernetes, Ray, and custom load-balancing solutions.

• Collaborate with research and product teams to bring new models into production.

Requirements

The ideal candidate is a senior-level machine learning inference or systems engineer with strong hands-on experience optimizing production inference engines and building scalable GPU infrastructure. You should bring:

• At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.

• Practical experience optimizing inference engines such as vLLM or TRT-LLM at the engine level, beyond basic model deployment.

• A proven background in developing backend and machine learning systems and serving models in production.

• Strong systems programming and GPU optimization skills using C++, CUDA, Rust, or optimized Python.

• Hands-on knowledge of model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Experience with distributed systems, Kubernetes, Ray, load balancing, multi-GPU and multi-node inference, and high-concurrency environments.

• Excellent English communication skills.

• Residence in the United States, Canada, the United Kingdom, Germany, Switzerland, or Serbia.

Additional advantages include a track record of rapid career progression, contributions to open-source inference engines or technical publications, and a PhD in Computer Science, Physics, or Mathematics, or a degree from a leading computer science program. The ability to commute to Mountain View, California, is also a plus.

Benefits

• Salary: $250,000–$300,000 annual base salary, plus competitive equity.

• Employment: Full-time, permanent position.

• Work arrangement: Onsite in Mountain View, California, preferred; remote opportunities available in the United States, Canada, the United Kingdom, Germany, Switzerland, and Serbia.

• Visa support: H-1B and OPT transfers supported.

• Relocation assistance: Available for candidates relocating to the San Francisco Bay Area.

• Language: English-speaking working environment.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

Apply About employer

Report this job