Jobs in the United States

25+ jobs

Save this search

Added 4 mins ago
BA
Systems Engineer, Senior
Booz Allen Hamilton
Aurora, CO
- $86,800 to $198,000 USD / year
As a leader in systems engineering, we are looking for you to solve complex problems and shape national security space systems by leading agile systems engineering and integration efforts.…
Added 18 mins ago
SS
Senior Substation Structures & Equipment Engineer
Strategic Staffing Solutions
Tampa, FL
- $150,000 USD / year
We are seeking a Senior Electrical Engineer specializing in substation structures and equipment to support major capital projects and electric delivery infrastructure. This role provides…
Added 21 mins ago
Senior Software Engineer, Network Platform Security
Cisco
Milpitas, CA
Join the Infrastructure Engineering team as a Software Engineer and help redefine how networking problems are solved. You will develop innovative software for next-generation networking…
Added 21 mins ago
Senior Data Engineer, Network Platform
Cisco
San Jose, CA
Cisco is reimagining how IT infrastructure is managed through secure, cloud-managed solutions. The Network Platform Data Science team helps turn Cisco’s rich, multifaceted customer and…
Added 26 mins ago
S
Senior Energy Engineer
Siemens
Cromwell, CT
- $92,589 to $158,725 USD / year
The Senior Energy Engineer conducts facility site visits, analyzes the customer’s current situation, and produces plans for Facility Improvement Measures (FIMs). This position also assists…
Added 26 mins ago
P
Electrical Engineer Manager
Pfizer
Groton, CT
- $99,200 to $165,400 USD / year
Serve as SME or Site Engineer Lead for all site electrical infrastructure, including medium- and low-voltage distribution systems, switchgear, substations, UPS, and backup generation
Added 26 mins ago
P
Mechanical Engineer Manager
Pfizer
Groton, CT
- $99,200 to $165,400 USD / year
…engineering oversight for 24x7x365 delivery of critical site utility systems and services within highly technical laboratories and manufacturing environments in support of the R&D…
Added 26 mins ago
GA
Sr Staff Applications Operations Engineer – Engineering Tools Automation & AI Ops
GE Aerospace
Norwalk, CT
- $131,000 to $174,000 USD / year
Minimum 5 years of professional experience in Application Operations or systems administration supporting enterprise or engineering applications
Added 26 mins ago
AT
Machine Learning Senior Software Engineer
Akamai Technologies, Inc.
Hartford, CT
- $121,400 to $218,600 USD / year
As an ML Senior Software Engineer, you will build and operate systems responsible for model validation, quantization, and safety across the AIC. You'll develop pipelines that scan models…
Added 26 mins ago
Cloud Engineer
Maximus
Hartford, CT
Maximus is seeking a Cloud Engineer to support a defense client remotely.
Added 26 mins ago
Software Engineer, Machine Learning RecSys
Meta
Hartford, CT
Software Engineer, Machine Learning RecSys Responsibilities:
Added 26 mins ago
AT
Senior Software Engineer
Akamai Technologies, Inc.
Hartford, CT
- $121,400 to $218,600 USD / year
As a Software Engineer Senior, you will be responsible for:
Added 26 mins ago
Staff Software Architect
CVS Health
Hartford, CT
…enterprise-wide influence. You will define the long-term software and systems architecture vision for the Clinical Insights Engine platform, drive cross-functional alignment on engineering…
Added 26 mins ago
EG
Cloud Engineer
Eliassen Group
Hartford, CT
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…
Added 26 mins ago
EG
Databricks Data Engineer
Eliassen Group
Hartford, CT
- $150,000 to $154,000 USD / year
Our client seeks a Databricks Data Engineer to design, build, and maintain scalable, reliable, and secure data pipelines, infrastructure, and systems that support consulting services and…
Added 34 mins ago
Senior Combustion Systems Engineer
OGE Energy Corp.
Oklahoma City, OK
Job Title: Engineer Field Senior or Engineer Lead
Added 35 mins ago
EG
Databricks Data Engineer
Eliassen Group
Oklahoma City, OK
- $150,000 to $154,000 USD / year
Our client seeks a Databricks Data Engineer to design, build, and maintain scalable, reliable, and secure data pipelines, infrastructure, and systems that support consulting services and…
Added 35 mins ago
EG
Cloud Engineer
Eliassen Group
Oklahoma City, OK
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…
Added 46 mins ago
Cyber Security Infrastructure Engineer
APEX SYSTEMS INC
SUN PRAIRIE, WI
Added 46 mins ago
Senior Municipal Project Engineer (PE)
SEEK PROFESSIONALS LLC
APPLETON, WI
Added 47 mins ago
Construction Project Engineer Project
SRF CONSULTING GROUP INC
GREEN BAY, WI
Added 47 mins ago
Construction Project Engineer Project
SRF CONSULTING GROUP INC
GREEN BAY, WI
Added 47 mins ago
Engineer, Digital Identity Services
LABCORP EARLY DEVELOPMENT LABORATOR
MADISON, WI
Added 47 mins ago
Building Maintenance Engineer
JONES LANG LASALLE AMERICAS INC
MILWAUKEE, WI
Added 47 mins ago
EG
Databricks Data Engineer
Eliassen Group
Madison, WI
- $150,000 to $154,000 USD / year
Our client seeks a Databricks Data Engineer to design, build, and maintain scalable, reliable, and secure data pipelines, infrastructure, and systems that support consulting services and…

IntelliPro Group Inc.

Machine Learning Engineer, Inference & Serving (Speech LLM)

San Francisco, CA, United States

$170,000 to $320,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $170,000 to $320,000 USD / year
Apply by: Feb 2, 2027
Posting language: English
Posted: Nov 4, 2026

Original job description

Machine Learning Engineer, Inference & Serving (Speech LLM) - San Francisco, CA (Hybrid)

Overview

We are looking for a Machine Learning Engineer, Inference & Serving (Speech LLM) to build and deploy high-throughput, ultra-low-latency inference systems for large language models and foundational speech models.

You may be a good fit if you:

Have hands-on experience building and deploying high-throughput, ultra-low-latency inference engines for large language models or foundational speech models.
Understand the intricate tradeoffs between latency, throughput, and Time-To-First-Token (or Time-To-First-Audio) in real-time streaming environments.
Have practical experience with continuous batching, KV cache management (e.g., PagedAttention), and stateful connections necessary for real-time conversational AI.
Possess a deep understanding of GPU architectures (NVIDIA Ampere/Hopper) and the memory hierarchy, allowing you to identify and eliminate hardware bottlenecks.
Communicate clearly and collaborate effectively, as you will sit at the critical intersection between the core ML training team and the backend infrastructure team.
Thrive in fast-moving environments and genuinely enjoy the systems-engineering challenge of squeezing every last drop of performance out of a cluster of GPUs.
Are obsessed with building AI systems that natively understand and generate speech.

Strong candidates may also have experience with:

Frontier Serving Frameworks: Deep, under-the-hood familiarity with modern LLM serving frameworks like vLLM, TensorRT-LLM, SGLang, or NVIDIA Triton Inference Server (bonus points for active open-source contributions to these repositories).
Real-Time Audio Streaming: Experience handling continuous audio streams over WebSockets or WebRTC, deploying neural audio codecs, and managing chunked audio generation to minimize conversational latency.
Advanced Inference Techniques: Implementing cutting-edge generation algorithms such as speculative decoding, lookahead decoding, or chunked prefill.
Model Compression & Quantization: Hands-on experience with post-training quantization (PTQ), deploying models in FP8, INT8, AWQ, or GPTQ, without degrading audio naturalness or ASR accuracy.
Large-Scale Distributed Systems: Deploying multi-GPU (Tensor Parallelism) and multi-node inference pipelines, and managing autoscaling infrastructure using Kubernetes.

What We Offer

Competitive Compensation: $170K - $320K base salary + performance bonus + Equity.
Comprehensive Benefits: Top-tier healthcare for employees and dependents, including dental and vision, and a generous employer subsidy.
Retirement Planning: 401(k) plan for full-time employees with company matching.
Paid Time Off: Unlimited PTO, plus 13 paid holidays.
New Parent Leave: 12 weeks of paid time off to spend time with your new family, regardless of gender.
Hybrid Office: Minimum of 3x in-office per week to foster highly collaborative, fast-paced research.
Gear & Perks: Choice of top-of-the-line laptops/workstations, annual offsites, and a fully stocked office.

We are an equal opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristics. APN Job ID: 173624

About Us

IntelliPro Group Inc. is a global staffing and talent solutions company. We connect exceptional professionals with leading organizations across technology, engineering, and professional services. By partnering closely with both clients and candidates, we build long-term relationships that help businesses grow and careers thrive.