Jobs in the United States

25+ jobs

Save this search

Added 2 mins ago
MTS Design Architect-Custom Layout, HBM
Micron Technology, Inc.
Richardson, TX · Boise, ID
As an HBM Design Architect-Custom Layout Lead, you will support the development of advanced analog, mixed‑signal, and digital circuits as well as full‑chip integration for next‑generation…
Added 12 mins ago
LEAD PRINCIPAL ENGINEER, ID1 ATE DE PROC
Micron Idaho Semiconductor Manufacturing (Triton) LLC
Boise, ID
…Additionally, Micron benefits include a robust paid time-off program and paid holidays. For additional information regarding the Benefit programs available, please see the Benefits Guide…
Added 14 mins ago
HBM Design Architect
Micron Technology, Inc.
Richardson, TX
As an HBM Design Architect, you will lead the technical enablement of novel memories and integration technologies - such as DRAM, gain-cell memory, stacked DRAM, and scaled-pitch hybrid…
Added 19 mins ago
J
Vibration Analyst
Jobgether
Remote, United States
- $71,000 to $80,000 USD / year
Prepare and lead operational review meetings with clients, presenting program achievements, performance results, challenges, and improvement opportunities.
Added 19 mins ago
J
Strategy & Operations Associate, GTM
Jobgether
Remote, United States
- $100,000 to $110,000 USD / year
Cross-Functional Program Management: Lead strategic go-to-market initiatives from planning and coordination through execution, measurement, and operational adoption.
Added 19 mins ago
J
Senior Project Manager, Scrum Master
Jobgether
Remote, United States
- $130,000 to $140,000 USD / year
End-to-End Project and Program Management: Lead the delivery of enterprise data platform, integration, analytics, and reporting initiatives from initial intake and discovery through…
Added 19 mins ago
J
Senior Machine Learning Engineer, Inference
Jobgether
Remote, United States
- $250,000 to $300,000 USD / year
You will lead end-to-end inference optimization, ensuring that advanced machine learning models perform efficiently and reliably in production environments. Your responsibilities will…
Added 19 mins ago
Director, Innovation
Jobgether
Remote, United States
Lead the strategy and execution of AI innovation across internal operations and client-facing services. As Director of Innovation, you will identify opportunities to leverage artificial…
Added 19 mins ago
Director, Global Services Operations & Excellence
Jobgether
Remote, United States
As the Director, Global Services Operations & Excellence, you will build and lead a global operations function responsible for optimizing training and advisory service delivery worldwide.…
Added 19 mins ago
J
Director, Customer Sales
Jobgether
Remote, United States
- $130,000 to $150,000 USD / year
We are seeking a strategic, results-driven Director of Customer Sales to lead and accelerate revenue growth within an established SaaS customer portfolio. In this leadership role, you will…
Added 23 mins ago
O
Lead Principal Data Hall Designer
Oracle
Seattle, WA
- $146,300 to $306,400 USD / year
Added 23 mins ago
O
Lead Principal Data Hall Designer
Oracle
Seattle, WA
- $146,300 to $306,400 USD / year
Added 23 mins ago
O
Senior Network Developer
Oracle
Seattle, WA · Nashville, TN · Redwood City, CA · Santa Clara, CA · Reston, VA
- $91,400 to $187,000 USD / year
-Serves as technical lead for test practices and strategies, providing guidance to the team and collaborating with other internal stakeholders in the development of robust testing protocols.
Added 38 mins ago
Senior Technical Program Manager I, Security and Compliance, Google Cloud
Google
Sunnyvale, CA
…whether down the street or across the globe. As a Technical Program Manager at Google, you’ll use your technical expertise to lead complex, multi-disciplinary projects from start to finish.…
Added 38 mins ago
Program Manager II, Software Quality Assurance and Testing, Platforms and Devices
Google
Mountain View, CA
…everyone, whether down the street or across the globe. As a Program Manager at Google, you’ll lead complex, multi-disciplinary projects from start to finish - working with stakeholders to…
Added 42 mins ago
EG
Sr Technical Project/Program Manager
Eliassen Group
Cheyenne, WY
- $48 to $53 USD / hour
Our client seeks a Sr Technical Project/Program Manager to lead a complex, multi-year Workday migration for affiliates covering benefits, payroll, learning, recruiting, HR, and finance. The…
Added 42 mins ago
EG
Operations - Process Manager - Sr
Eliassen Group
Cheyenne, WY
- $55 to $65 USD / hour
Our client seeks a senior process manager to lead Script Governance to ensure Intent = Execution for internal and legacy backbook scripts from a recent acquisition. The role will coordinate…
Added 46 mins ago
A
Sanitation Lead
Aerotek
Seatac, WA
- $25 to $30 USD / hour
Job Title: Sanitation Lead Shift 6pm-4am Monday - Thursday Pay $25-$30 Based on experience Job DescriptionThe Sanitation Lead oversees and works alongside the overnight sanitation team in a…
Added 46 mins ago
Executive Assistant
MongoDB
CO
Lead the planning and execution of events and offsites, from gathering requirements and securing venues to managing budgets, contracts, and payments
Added 47 mins ago
Equipment Engineer
Micron Technology, Inc.
Manassas, VA
…loss; ensure pass-down is accurate and up to date. Support and lead complex problem-solving efforts, ensuring effective and timely guidance for equipment issues. Contribute to a culture of…
Added 49 mins ago
Director, Sales Operations, GTS
Gartner
Fort Myers, FL · Arlington, VA · Irving, TX
…ability to influence across multiple stakeholders. They will lead key operating rhythms, forecasting, territory and quota planning, programs, and strategic initiatives while ensuring…
Added 49 mins ago
Enterprise Exhibitor Sales Executive, Destination Conferences
Gartner
Irving, TX · Stamford, CT
Strong prospecting skills and work collaboratively with lead gen
Added 49 mins ago
Senior Product Manager (AI Datacenter)
Keysight Technologies, Inc.
Santa Clara, CA · Calabasas, CA
Lead product launches and enable sales and pre-sales teams through technical messaging, demos, training, and competitive positioning.
Added 52 mins ago
J
Integrated Marketing Manager
Jobgether
Remote, United States
- $95,000 to $125,000 USD / year
We are seeking an experienced Integrated Marketing Manager to lead and coordinate strategic B2B marketing initiatives that strengthen brand visibility, generate qualified leads, and drive…
Added 52 mins ago
J
Director, CX Strategy
Jobgether
Remote, United States
- $128,000 to $152,000 USD / year
We are seeking an experienced Director of Customer Experience (CX) Strategy to build and lead a centralized Voice of Client (VoC) program from the ground up. In this strategic individual…

Jobgether

Senior Machine Learning Engineer, Inference

Remote, United States

$250,000 to $300,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $250,000 to $300,000 USD / year
Experience: At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.
Posting language: English
Posted: Nov 5, 2026

Original job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Machine Learning Engineer, Inference based in the United States.

Join a high-performing engineering team developing advanced real-time voice and large language model (LLM) technology. As a Senior Machine Learning Engineer, you will own inference optimization from research through production deployment, helping bring sophisticated models to consumer-scale applications. You will tackle complex challenges involving latency, throughput, GPU efficiency, and distributed serving infrastructure. Working directly with modern inference engines, you will apply cutting-edge acceleration techniques to improve performance and scalability. You will collaborate closely with research and product teams to turn innovative models into reliable production systems. This is an opportunity to make a significant technical impact on AI products serving hundreds of millions of users.

Accountabilities

You will lead end-to-end inference optimization, ensuring that advanced machine learning models perform efficiently and reliably in production environments. Your responsibilities will include:

• Own the optimization process from research models to production deployment.

• Improve latency and throughput for real-time voice and LLM inference at consumer scale.

• Work directly with inference engines such as vLLM, TensorRT-LLM (TRT-LLM), and SGLang to enhance performance.

• Implement model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Develop high-performance GPU workloads using C++, CUDA, Rust, or optimized Python.

• Build and scale distributed multi-GPU and multi-node inference systems using Kubernetes, Ray, and custom load-balancing solutions.

• Collaborate with research and product teams to bring new models into production.

Requirements

The ideal candidate is a senior-level machine learning inference or systems engineer with strong hands-on experience optimizing production inference engines and building scalable GPU infrastructure. You should bring:

• At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.

• Practical experience optimizing inference engines such as vLLM or TRT-LLM at the engine level, beyond basic model deployment.

• A proven background in developing backend and machine learning systems and serving models in production.

• Strong systems programming and GPU optimization skills using C++, CUDA, Rust, or optimized Python.

• Hands-on knowledge of model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Experience with distributed systems, Kubernetes, Ray, load balancing, multi-GPU and multi-node inference, and high-concurrency environments.

• Excellent English communication skills.

• Residence in the United States, Canada, the United Kingdom, Germany, Switzerland, or Serbia.

Additional advantages include a track record of rapid career progression, contributions to open-source inference engines or technical publications, and a PhD in Computer Science, Physics, or Mathematics, or a degree from a leading computer science program. The ability to commute to Mountain View, California, is also a plus.

Benefits

• Salary: $250,000–$300,000 annual base salary, plus competitive equity.

• Employment: Full-time, permanent position.

• Work arrangement: Onsite in Mountain View, California, preferred; remote opportunities available in the United States, Canada, the United Kingdom, Germany, Switzerland, and Serbia.

• Visa support: H-1B and OPT transfers supported.

• Relocation assistance: Available for candidates relocating to the San Francisco Bay Area.

• Language: English-speaking working environment.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

Apply About employer

Report this job