Jobs in the United States

25+ jobs

Save this search

Added 3 mins ago
Project Manager
Churchill County
Fallon, NV
Are you ready to lead projects that make a lasting impact on your community? Churchill County is seeking an experienced Project Manager to oversee capital improvement, infrastructure,…
Added 4 mins ago
Lead Culinary Assistant
Ebenezer
Hermantown, MN
The Lead Culinary Assistant is responsible for dining room meal service to residents.
Added 7 mins ago
Lead Field Engineer - Electrical
Bechtel
Reston, VA · Pecos, TX
…helping the customer progress early-stage development, that would lead to the start of full EPC delivery next…
Added 8 mins ago
SE
Assistant Teacher
Specialized Education Services
Mayfield, PA
- From $19 USD / hour
…healthcare benefits, 401(k) with employer match, employee assistance program, mental health support, fertility and family building, and…
Added 8 mins ago
SE
Assistant Teacher
Specialized Education Services
Luzerne, PA
- From $19 USD / hour
…healthcare benefits, 401(k) with employer match, employee assistance program, mental health support, fertility and family building, and…
Added 8 mins ago
Student Support Services Coordinator
Specialized Education Services
Harrisburg, PA
…healthcare benefits, 401(k) with employer match, employee assistance program, mental health support, fertility and family building, and…
Added 8 mins ago
Principal
Specialized Education Services
Philadelphia, PA
· Lead professional development and coaching initiatives to build teacher capacity.
Added 10 mins ago
MO
Vacation Package Sales, Encore- ($2,000 Sign-on Bonus* Potential)
Marriott Ownership Resorts, Inc.
United States
- $18 USD / hour
Where great benefits lead to a life fulfilled:
Added 12 mins ago
EVP, Client Leadership
Publicis Groupe Holdings B.V
New York, NY
Publicis Digital Experience is seeking an Executive Vice President, Client Service Leader to lead a $45M portfolio of client business. This executive will serve as a senior client partner,…
Added 12 mins ago
PG
Senior Account Executive
Publicis Groupe Holdings B.V
Philadelphia, PA
- $60,800 to $84,000 USD / year
Understands and articulates overall program strategy, objectives, measurement strategy, and relevant results for programs
Added 14 mins ago
J
Sr Data Analyst - Product Configuration
Jobgether
Remote, United States
- $80,000 to $107,800 USD / year
Lead complex projects while effectively balancing ongoing operational responsibilities and competing priorities.
Added 14 mins ago
Director of Managed Care
Jobgether
Remote, United States
The Director of Managed Care will lead the creation and development of a new managed care division within the workers’ compensation industry. This strategic leadership role will oversee the…
Added 16 mins ago
Vice President, Finance & Administration
Rezo Therapeutics
San Francisco, CA
Rezo is seeking a VP, Finance and Administration to lead its financial and administrative functions through the next stages of growth. This leader will be a strategic partner to the CEO and…
Added 17 mins ago
HC
Managing Attorney V
HEALTH CARE AUTHORITY
United States
- $137,500 USD / year
…Oklahomans with better health and care. The incumbent will lead efforts to ensure compliance, resolve legal disputes, and promote policy development while driving legal excellence across…
Added 17 mins ago
Project Manager (IT-IA-IM Prog/Proj Mgr II) (Government)
AT&T Technical Services Company, Inc.
Remote, United States
· Lead technical assessments across multiple disciplines, applying industry best practices to evaluate network or systems standard requirements and implementation feasibility.
Added 27 mins ago
Director of Nursing
PruittHealth
Atlanta, GA
PruittHealth is seeking an experienced Director of Nursing (DON) to lead our Nursing Services Department within our skilled nursing and rehabilitation center. This nursing leadership role…
Added 30 mins ago
UA
Civil Engineer
U.S. Army Corps of Engineers
Vicksburg, MS
- $99,554 to $127,443 USD / year
A. Degree: Bachelor's degree (or higher degree) in engineering. To be acceptable, the program must: (1) lead to a bachelor's degree (or higher degree) in a school of engineering with at…
Added 31 mins ago
MD
General Engineer
Missile Defense Agency
Schriever AFB, CO · Redstone Arsenal, AL
- $130,987 to $197,200 USD / year
A. Degree: Engineering. To be acceptable, the program must: (1) lead to a bachelor's degree in a school of engineering with at least one program accredited by ABET; or (2) include…
Added 31 mins ago
DF
SECURITY ASSISTANT
Defense Finance and Accounting Service
Cleveland, OH
- $42,535 to $55,296 USD / year
Defense Finance and Accounting Services (DFAS) mission is to lead the DoD in finance and accounting by ensuring the delivery of efficient, exceptional quality pay and financial information.
Added 31 mins ago
IA
Contract Specialist
Immigration and Customs Enforcement
Orlando, FL · Washington, DC · Irving, TX
- $106,437 to $158,322 USD / year
Advise program officials and senior leadership on acquisition strategies and contracting matters.
Added 31 mins ago
VH
Nurse (Clinical Resource - RN)
Veterans Health Administration
Mather AFB, CA
- $105,946 to $199,530 USD / year
This position is eligible for the Education Debt Reduction Program (EDRP), a student loan payment reimbursement program. You must meet specific eligibility requirements per VHA policy and…
Added 31 mins ago
US
SUPERVISORY MECHANICAL ENGINEER
United States Fleet Forces Command
Naval Shipyard, Portsmouth, VA
- $108,019 to $140,426 USD / year
Successful completion of a professional engineering degree. To be acceptable, the program must: (1) lead to a bachelor's degree (or higher) in a school of engineering with at least one…
Added 31 mins ago
VH
REGISTERED NURSE - OUTPATIENT MENTAL HEALTH (BHIP)
Veterans Health Administration
Togus, ME
- $79,904 to $139,497 USD / year
This position is eligible for the Education Debt Reduction Program (EDRP), a student loan payment reimbursement program. You must meet specific eligibility requirements per VHA policy and…
Added 31 mins ago
IR
Program Analyst (Bilingual-Spanish)
Internal Revenue Service
Florence, KY · Fresno, CA · Atlanta, GA · Bloomington, IL · Sacramento, CA · Lanham, MD · Richmond, VA · Ogden, UT · Baltimore, MD · Detroit, MI · Farmers Branch, TX · Austin, TX · Covington, KY · Chamblee, GA · Washington, DC
- $61,722 to $158,322 USD / year
Serves as an expert analyst responsible for developing and/or interpreting guidance on program
Added 31 mins ago
OO
Data and Policy Manager
Office of the Assistant Secretary for Administration and Management
Location Negotiable After Selection
- $133,007 to $197,200 USD / year
Lead a Department-wide data program for space utilization, occupancy, lease, and facility condition information.

Jobgether

Senior Machine Learning Engineer, Inference

Remote, United States

$250,000 to $300,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $250,000 to $300,000 USD / year
Experience: At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.
Posting language: English
Posted: Nov 5, 2026

Original job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Machine Learning Engineer, Inference based in the United States.

Join a high-performing engineering team developing advanced real-time voice and large language model (LLM) technology. As a Senior Machine Learning Engineer, you will own inference optimization from research through production deployment, helping bring sophisticated models to consumer-scale applications. You will tackle complex challenges involving latency, throughput, GPU efficiency, and distributed serving infrastructure. Working directly with modern inference engines, you will apply cutting-edge acceleration techniques to improve performance and scalability. You will collaborate closely with research and product teams to turn innovative models into reliable production systems. This is an opportunity to make a significant technical impact on AI products serving hundreds of millions of users.

Accountabilities

You will lead end-to-end inference optimization, ensuring that advanced machine learning models perform efficiently and reliably in production environments. Your responsibilities will include:

• Own the optimization process from research models to production deployment.

• Improve latency and throughput for real-time voice and LLM inference at consumer scale.

• Work directly with inference engines such as vLLM, TensorRT-LLM (TRT-LLM), and SGLang to enhance performance.

• Implement model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Develop high-performance GPU workloads using C++, CUDA, Rust, or optimized Python.

• Build and scale distributed multi-GPU and multi-node inference systems using Kubernetes, Ray, and custom load-balancing solutions.

• Collaborate with research and product teams to bring new models into production.

Requirements

The ideal candidate is a senior-level machine learning inference or systems engineer with strong hands-on experience optimizing production inference engines and building scalable GPU infrastructure. You should bring:

• At least 5 years of experience in ML inference or systems engineering, at a senior level equivalent to Google L5 or Meta E5.

• Practical experience optimizing inference engines such as vLLM or TRT-LLM at the engine level, beyond basic model deployment.

• A proven background in developing backend and machine learning systems and serving models in production.

• Strong systems programming and GPU optimization skills using C++, CUDA, Rust, or optimized Python.

• Hands-on knowledge of model acceleration techniques, including quantization, distillation, speculative decoding, caching, continuous batching, and paged attention.

• Experience with distributed systems, Kubernetes, Ray, load balancing, multi-GPU and multi-node inference, and high-concurrency environments.

• Excellent English communication skills.

• Residence in the United States, Canada, the United Kingdom, Germany, Switzerland, or Serbia.

Additional advantages include a track record of rapid career progression, contributions to open-source inference engines or technical publications, and a PhD in Computer Science, Physics, or Mathematics, or a degree from a leading computer science program. The ability to commute to Mountain View, California, is also a plus.

Benefits

• Salary: $250,000–$300,000 annual base salary, plus competitive equity.

• Employment: Full-time, permanent position.

• Work arrangement: Onsite in Mountain View, California, preferred; remote opportunities available in the United States, Canada, the United Kingdom, Germany, Switzerland, and Serbia.

• Visa support: H-1B and OPT transfers supported.

• Relocation assistance: Available for candidates relocating to the San Francisco Bay Area.

• Language: English-speaking working environment.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

Apply About employer

Report this job