Jobs in the United States

25+ jobs

Save this search

Added just now
Senior Pre-Sales Infrastructure/Network Design Engineer
ewminds consulting Services
New York, NY
AI-Assisted Design: Use AI tools to support and improve design workflows, ideation, prototyping, and overall design efficiency.
Added 2 mins ago
Network Development Engineer, Amazon Customer Service
Amazon.com Services LLC
Seattle, WA
…coordinate tech change management with business operations, and partner with business owners, security engineers, and other tech teams to innovate on how transport across public and private…
Added 3 mins ago
S
Senior Forward Deployed Industry Consultant, Pharma
SAS
UNAVAILABLE, NJ
- $136,948 to $167,380 USD / year
Partner closely with Sales, Industry Advisors, technical teams, Product Management and Customer Success to align embedded innovation with overall account strategy and support reuse across…
Added 4 mins ago
Data Engineer
Tetrad Digital Integrity LLC
Springfield, VA
TDI is seeking Data Engineers to support an exciting National Security mission to position NGA to be the enterprise and community GEOINT data provider, improving the way analysts,…
Added 6 mins ago
KW
Jr. Systems Engineer (Digital Engineering Process Support)
KBR Wyle Services, LLC
Chantilly, VA
- $82,000 to $102,000 USD / year
KBR/Trinzic is seeking a Junior Systems Engineer (Digital Engineering Process Support) to join our team on site in Chantilly, VA. TS/SCI with Polygraph is required for consideration.
Added 6 mins ago
KW
Jr. Systems Engineer (Digital Engineering Engagement)
KBR Wyle Services, LLC
Chantilly, VA
- $82,000 to $102,000 USD / year
This effort is in direct support of a US Space Industry Prime Partner in the Chantilly, VA area. We are looking for the self-driven, the bold, the passionate Systems Engineers who will join…
Added 6 mins ago
KW
Job Posting Title Jr. Systems Engineer (Digital Engineering Process Support)
KBR Wyle Services, LLC
Chantilly, VA
- $82,000 to $102,000 USD / year
KBR is seeking a Junior Systems Engineer (Digital Engineering Process Support) to join our team on site in Chantilly, VA. TS/SCI with Polygraph is required for consideration.
Added 6 mins ago
KW
Junior Systems Engineer (Digital Engineering Process Support)
KBR Wyle Services, LLC
Chantilly, VA
- $82,000 to $102,000 USD / year
KBR/Trinzic is seeking a Junior Systems Engineer (Digital Engineering Process Support) to join our team on site in Chantilly, VA. TS/SCI with Polygraph clearance is required for…
Added 6 mins ago
KW
Job Posting Title Jr. Systems Engineer (Digital Engineering Process Support)
KBR Wyle Services, LLC
Chantilly, VA
- $82,000 to $102,000 USD / year
KBR is seeking a Junior Systems Engineer (Digital Engineering Process Support) to join our team on site in Chantilly, VA. TS/SCI with Polygraph clearance is required for consideration.
Added 6 mins ago
KW
Jr. Systems Engineer (Digital Engineering Process Support)
KBR Wyle Services, LLC
Chantilly, VA
- $82,000 to $102,000 USD / year
KBR is seeking a Junior Systems Engineer (Digital Engineering Process Support) to join our team on site in Chantilly, VA. TS/SCI with Polygraph clearance is required for consideration.
Added 6 mins ago
KW
Jr. Systems Engineer (Digital Engineering Process Support)
KBR Wyle Services, LLC
Chantilly, VA
- $82,000 to $102,000 USD / year
KBR/Trinzic is seeking a Junior Systems Engineer (Digital Engineering Process Support) to join our team on site in Chantilly, VA. TS/SCI with Polygraph clearance is required for…
Added 6 mins ago
KW
Job Posting Title Jr. Systems Engineer (Digital Engineering Process Support)
KBR Wyle Services, LLC
Chantilly, VA
- $82,000 to $102,000 USD / year
KBR/Trinzic is seeking a Junior Systems Engineer (Digital Engineering Process Support) to join our team on site in Chantilly, VA. TS/SCI with Polygraph is required for consideration.
Added 6 mins ago
KW
Junior Systems Engineer (Digital Engineering Process Support)
KBR Wyle Services, LLC
Chantilly, VA
- $82,000 to $102,000 USD / year
KBR/Trinzic is seeking a Junior Systems Engineer (Digital Engineering Process Support) to join our team on site in Chantilly, VA. TS/SCI with Polygraph clearance is required for…
Added 7 mins ago
RG
Database Engineer II
RELI GROUP INC
Remote, United States
- $91,015.65 to $133,489.62 USD / year
At RELI Group, our work is grounded in purpose. We partner with government agencies to solve complex challenges, improve public health, strengthen national security, and make government…
Added 9 mins ago
Network Design Engineer
General Dynamics Mission Systems, Inc
Annapolis Junction, MD
…everything in between.The experienced Advanced Network Design Engineer we seek will provide technical support to customers in installing and troubleshooting issues with GDMS Cyber products,…
Added 13 mins ago
N
Seasonal and Regular Commission Sales - Oak Park Mall
Nordstrom
Overland Park, KS
- $13.5 USD / hour
…through follow-ups as children grow into their next sizes. Partner with expecting and new parents to help them navigate baby essentials, including shoes and baby…
Added 13 mins ago
EG
Workday Adaptive Planning Engineer
Eliassen Group
Topeka, KS
- $65 to $75 USD / hour
Our client is seeking a Workday Adaptive Planning Engineer to design, build, and maintain financial planning and forecasting solutions. The role partners with FP&A, Accounting, and Finance…
Added 13 mins ago
EG
Quality Assurance Engineer - PHP
Eliassen Group
Topeka, KS
- $40 to $50 USD / hour
Our client seeks a results-driven Senior Quality Assurance Engineer to support Policyholder Portal applications. The role requires manual, automation, mobile, API, and database testing…
Added 16 mins ago
Project Engineer
Rockford
Detroit, MI
Rockford is seeking a motivated Construction Project Engineer to join our team. In this role, you will support construction projects from start to finish, assisting with project planning,…
Added 17 mins ago
Data Engineer / Metadata Engineer
ECS FEDERAL LLC
ARLINGTON, VA
We are seeking a talented Data Engineer / Metadata Engineer to design, develop, and optimize data pipelines, metadata repositories, and data governance solutions that support enterprise…
Added 21 mins ago
Transportation Director
Michael Baker International
Louisville, KY
Coordinate business development activities to support overall growth objectives, including project pursuits, client outreach, marketing, teaming arrangements, capture planning, proposal…
Added 22 mins ago
A
Civil/Environmental Engineer
AECOM
Waterloo, IA
- $70,100 to $83,300 USD / year
AECOM is seeking an Entry Level Civil/Environmental Engineer to join our growing Water, Wastewater, and Conveyance team for our Waterloo, Iowa office. This is an excellent opportunity for a…
Added 22 mins ago
Automation Software Engineer - Power BI and Automation
B10 Wells Fargo Bank, N. A.
IRVING, TX
Seeking a Software Engineer to design, develop, and support enterprise reporting, automation, and collaboration solutions leveraging Microsoft Power BI and SharePoint.
Added 24 mins ago
IT Systems Engineer I - Portland, OR
VC3, Inc.
Remote, United States
Strong background working in Microsoft 365 Partner Center/Entra ID
Added 25 mins ago
Senior Stormwater Engineer
Jacobs
Portland, OR
In addition to supporting other water, transportation, and architectural projects, the Senior Stormwater Engineer/Senior Landscape Architect, will have a unique opportunity to lead…

Jobgether

Senior Machine Learning Engineer, Inference

Remote, United States

$250,000 to $300,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $250,000 to $300,000 USD / year
Experience: At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.
Posting language: English
Posted: Nov 5, 2026

Original job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Machine Learning Engineer, Inference based in the United States.

Join a high-performing engineering team developing advanced real-time voice and large language model (LLM) technology. As a Senior Machine Learning Engineer, you will own inference optimization from research through production deployment, helping bring sophisticated models to consumer-scale applications. You will tackle complex challenges involving latency, throughput, GPU efficiency, and distributed serving infrastructure. Working directly with modern inference engines, you will apply cutting-edge acceleration techniques to improve performance and scalability. You will collaborate closely with research and product teams to turn innovative models into reliable production systems. This is an opportunity to make a significant technical impact on AI products serving hundreds of millions of users.

Accountabilities

You will lead end-to-end inference optimization, ensuring that advanced machine learning models perform efficiently and reliably in production environments. Your responsibilities will include:

• Own the optimization process from research models to production deployment.

• Improve latency and throughput for real-time voice and LLM inference at consumer scale.

• Work directly with inference engines such as vLLM, TensorRT-LLM (TRT-LLM), and SGLang to enhance performance.

• Implement model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Develop high-performance GPU workloads using C++, CUDA, Rust, or optimized Python.

• Build and scale distributed multi-GPU and multi-node inference systems using Kubernetes, Ray, and custom load-balancing solutions.

• Collaborate with research and product teams to bring new models into production.

Requirements

The ideal candidate is a senior-level machine learning inference or systems engineer with strong hands-on experience optimizing production inference engines and building scalable GPU infrastructure. You should bring:

• At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.

• Practical experience optimizing inference engines such as vLLM or TRT-LLM at the engine level, beyond basic model deployment.

• A proven background in developing backend and machine learning systems and serving models in production.

• Strong systems programming and GPU optimization skills using C++, CUDA, Rust, or optimized Python.

• Hands-on knowledge of model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Experience with distributed systems, Kubernetes, Ray, load balancing, multi-GPU and multi-node inference, and high-concurrency environments.

• Excellent English communication skills.

• Residence in the United States, Canada, the United Kingdom, Germany, Switzerland, or Serbia.

Additional advantages include a track record of rapid career progression, contributions to open-source inference engines or technical publications, and a PhD in Computer Science, Physics, or Mathematics, or a degree from a leading computer science program. The ability to commute to Mountain View, California, is also a plus.

Benefits

• Salary: $250,000–$300,000 annual base salary, plus competitive equity.

• Employment: Full-time, permanent position.

• Work arrangement: Onsite in Mountain View, California, preferred; remote opportunities available in the United States, Canada, the United Kingdom, Germany, Switzerland, and Serbia.

• Visa support: H-1B and OPT transfers supported.

• Relocation assistance: Available for candidates relocating to the San Francisco Bay Area.

• Language: English-speaking working environment.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

Apply About employer

Report this job