Find work in the United States.

A simpler way to find your next job.

Jobs in the United States

25+ jobs

Save this search

Added 3 days ago
IT Manager
NexTech Solutions LLC
Huntsville, AL
…Department of State and Department of War customers. The IT Manager runs NTS corporate IT day to day: infrastructure, endpoints, identity, collaboration tools, business systems, and the…
Added 4 days ago
Technical Program Manager, Infrastructure
Andromeda Cluster
Remote, United States
Andromeda's infrastructure team designs, deploys, and operates large-scale GPU clusters for AI labs and compute providers. The Technical Program Manager runs program delivery across our…
Added 4 days ago
Senior Machine Learning Engineer, Inference
AIDA Recruitment
Mountain View · Mountain View, CA
Inference: The team owns how our client’s models run in production – inference engines, GPU efficiency, model acceleration and the distributed serving infrastructure behind realtime voice…
Added 4 days ago
Senior Technical Program Manager, Corporate Builds
Nebius
United States
Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model…
Added 5 days ago
J
GPU Infrastructure Deployment Program Manager
Jobgether
Remote, United States
- $120,000 to $200,000 USD / year
…all applications and next steps. Our partner is looking for a GPU Infrastructure Deployment Program Manager based in the United…
Added 5 days ago
Director, Reliability Hardware Systems
IREN
Remote, United States
The Director, Reliability Hardware Systems owns end-to-end hardware reliability and failure analysis (FA) for IREN’s AI infrastructure, serving as the primary advocate for product stability…
Added 5 days ago
Principal Data Center & Cloud Engineering Lead and Strategist
TISTA Science and Technology Corporation
Remote-United States
Employment: Full-time | Proposed reporting: IE&O Program Manager
Added 6 days ago
Senior Technical Program Manager, Cloud Infrastructure
NVIDIA USA
CA · WA
As an Infrastructure Technical Program Manager, you'll be a key partner to our external CSP/NCP partners as well as key internal teams (Software Engineering, Production Engineering/SRE, and…
Added 6 days ago
PD
Senior DevSecOps Engineer
Pantheon Data
Reston, VA
- $100,000 to $150,000 USD / year
…service offerings have grown in the past ten years, including infrastructure resiliency, contact center operations, information technology, software engineering, program management,…
Added 6 days ago
Contracts Manager (Procurement)
Lynx Software Technologies, Inc.
Remote, United States
LYNX MOSA.ic.AI: LYNX MOSA.ic.AI is a unified CPU and GPU software platform that enables deterministic, certifiable deployment of AI and advanced workloads in mission-critical edge systems.…
Added 9 days ago
Staff Accountant
Lynx Software Technologies, Inc.
Campbell, CA
LYNX MOSA.ic.AI: LYNX MOSA.ic.AI is a unified CPU and GPU software platform that enables deterministic, certifiable deployment of AI and advanced workloads in mission-critical edge systems.…
Added 11 days ago
Startup Community Manager
Nebius
San Francisco Bay Area, CA · San Francisco, CA
Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model…
Added 13 days ago
Senior Project Manager – Network Infrastructure Design & Standards
IREN
Remote, United States
Reporting to the Director, Network Delivery, the Senior Project Manager – Network Infrastructure Design & Standards is the portfolio design authority for the passive and physical network…
Added 13 days ago
CI
Senior Vehicle Infrastructure Engineer
Cyngn, Inc.
Mountain View, CA
- $165,000 to $185,000 USD / year
As a Senior Vehicle Infrastructure Engineer, you are the architect of reliability and scale, owning the OS, provisioning, and release paths that ensure our autonomous fleet operates…
Added 16 days ago
Senior Technical Program Manager, Infrastructure Programs
Vultr
Remote, United States
We are looking for a Senior Technical Program Manager to lead the end-to-end turn-up, onboarding, and validation of data center infrastructure - from physical installation to a fully…
Added 18 days ago
M
Senior Technical Program Manager
Microsoft
WA · DC · GA · Redmond, WA · Washington, DC · Atlanta, GA · Redmond · Washington · Atlanta
- $119,800 to $261,000 USD / year
As a Senior Technical Program Manager in Region Health, you will turn complex technical and business signals into clear assessments, timely decisions, and coordinated action. You will…
Added 22 days ago
Senior Manager, AI Deployment
General Motors
Columbus, OH
We are looking for a Senior Manager, AI Deployment to lead the strategy and execution of model performance and on-vehicle inference for autonomous driving. You will lead engineering…
Added 22 days ago
Senior Manager, AI Deployment
General Motors
Sacramento, CA · Sunnyvale, CA
We are looking for a Senior Manager, AI Deployment to lead the strategy and execution of model performance and on-vehicle inference for autonomous driving. You will lead engineering…
Added 22 days ago
Senior Manager, AI Deployment
General Motors
Phoenix, AZ
We are looking for a Senior Manager, AI Deployment to lead the strategy and execution of model performance and on-vehicle inference for autonomous driving. You will lead engineering…
Added 22 days ago
Senior Manager, AI Deployment
General Motors
Washington, DC
We are looking for a Senior Manager, AI Deployment to lead the strategy and execution of model performance and on-vehicle inference for autonomous driving. You will lead engineering…
Added 22 days ago
Senior Manager, AI Deployment
General Motors
Madison, WI
We are looking for a Senior Manager, AI Deployment to lead the strategy and execution of model performance and on-vehicle inference for autonomous driving. You will lead engineering…
Added 22 days ago
Senior Manager, AI Deployment
General Motors
Charleston, WV
We are looking for a Senior Manager, AI Deployment to lead the strategy and execution of model performance and on-vehicle inference for autonomous driving. You will lead engineering…
Added 22 days ago
Senior Manager, AI Deployment
General Motors
Olympia, WA
We are looking for a Senior Manager, AI Deployment to lead the strategy and execution of model performance and on-vehicle inference for autonomous driving. You will lead engineering…
Added 22 days ago
Senior Manager, AI Deployment
General Motors
Richmond, VA
We are looking for a Senior Manager, AI Deployment to lead the strategy and execution of model performance and on-vehicle inference for autonomous driving. You will lead engineering…
Added 22 days ago
Senior Manager, AI Deployment
General Motors
Salt Lake City, UT
We are looking for a Senior Manager, AI Deployment to lead the strategy and execution of model performance and on-vehicle inference for autonomous driving. You will lead engineering…

AIDA Recruitment

Senior Machine Learning Engineer, Inference

Mountain View, United States
Mountain View, CA, United States

Apply About employer

Applications open in a new tab.

Job details

Apply by: Dec 16, 2026
Experience: 5+ years of experience as an ML inference or systems engineer, at senior level (Google L5 / Meta E5 or equivalent);
Posting language: English
Posted: Nov 4, 2026

Original job description

Senior Machine Learning Engineer, Inference

Job Summary

For our client, a fast-growing AI company building realtime voice and LLM technology, we are looking for a Senior Machine Learning Engineer with strong expertise in ML inference optimization to join its inference team.

In this role, you will own inference optimization end-to-end – taking models from research to production at consumer scale and solving latency and throughput problems for realtime AI products used by hundreds of millions of people.

Our client is a well-funded, venture-backed AI research lab and realtime inference provider with a small, senior engineering team.

Team

Inference: The team owns how our client’s models run in production – inference engines, GPU efficiency, model acceleration and the distributed serving infrastructure behind realtime voice and LLM products.

This is an opportunity for senior engineers who want to work deep inside modern inference engines on problems at real consumer scale.

Responsibilities

Own inference optimization end-to-end, from research models to production deployment;
Optimize latency and throughput of realtime voice and LLM inference at consumer scale;
Work inside inference engines such as vLLM, TRT-LLM and SGLang to improve performance;
Apply model acceleration techniques – quantization, distillation, speculative decoding, caching, continuous batching and paged attention;
Write high-performance code in C++, CUDA, Rust or optimized Python for GPU workloads;
Build and scale distributed multi-GPU and multi-node serving with Kubernetes, Ray and custom load balancing for high concurrency;
Collaborate with research and product teams to bring new models into production.

Requirements

5+ years of experience as an ML inference or systems engineer, at senior level (Google L5 / Meta E5 or equivalent);
Hands-on ML inference optimization inside vLLM or TRT-LLM (engine-level work, not only deployment);
Experience building backend/ML systems and serving models in production;
Systems programming and GPU optimization skills: C++, CUDA, Rust or optimized Python;
Experience with model acceleration: quantization, distillation, speculative decoding, caching, continuous batching, paged attention;
Distributed systems experience: Kubernetes, Ray, load balancing, multi-GPU/multi-node inference, high concurrency;
Based in the US, Canada, UK, Germany, Switzerland or Serbia;
Excellent communication skills in English.

Nice to have

A track record of fast promotions;
Public technical work – open-source inference engine contributions or technical write-ups;
PhD in Computer Science, Physics or Mathematics, or a degree from a top CS program;
Ability to commute to Mountain View, CA.

The offer

Project/Client: Fast-growing AI company (realtime voice and LLM)
Location: Onsite in Mountain View, CA (preferred), or remote in the US, Canada, UK, Germany, Switzerland or Serbia
Language: English
Engagement: Full-time
Contract: Permanent employment
Salary: $250K–$300K base + competitive equity
Visa and relocation: H-1B / OPT transfers supported; relocation assistance to the San Francisco Bay Area

Selection Process

Stage 1–3: AIDA Recruitment pre-selection

Stage 1: CV Screening. Your application will be reviewed within 24 hours of submission.
Stage 2: Pre-Screening. A short Q/A session to assess your experience and technical background. You can choose between an automated Q/A video session (recommended for faster feedback) or a recruiter interview.
Stage 3: Shortlisting. Candidates whose experience best matches the role will be shortlisted and presented to the hiring manager.

Client interview process

Stage 4: Recruiter interview. A 30-minute conversation with the client’s talent team.
Stage 5: Technical interview – ML exercise. 90 minutes, based on a real production problem; onsite in Mountain View preferred for local candidates, remote otherwise.
Stage 6: Hiring manager interview. 30 minutes.
Stage 7: ML system design interview. 45 minutes.
Stage 8: CTO interview. 45 minutes, mostly behavioural.
Stage 9: CEO interview. 30 minutes, culture and vision fit.

Offer and onboarding

Successful candidates will receive an offer and begin the onboarding process.

About Employer

AIDA Recruitment – a partner for technology-sector companies. We recruit IT specialists from all around the world for our clients. We use digital technology to work faster, be more efficient, and provide the best solutions for both clients and candidates.

Additional Information

We aim to keep candidates informed throughout the process and provide updates after each completed stage.

Information about the processing of your personal data is provided in our Privacy Policy.

Apply About employer

Report this job