Jobs in the United States

25+ jobs

Group jobs by employerEmail me new jobs Save this search

Added just now
TT
Founding Senior Engineer
True Talent Solutions Partners
New York, NY
- $175,000 to $225,000 USD / year
Join an early-stage AI company building a growth platform for consumer brands. As the second engineer, you will build core product and infrastructure while helping shape the engineering…
Added just now
TT
Full Stack Engineer
True Talent Solutions Partners
San Francisco, CA
- $230,000 to $300,000 USD / year
Join a product engineering team building software that helps organizations improve the reliability of AI agents in production. This backend-leaning full-stack role combines…
Added just now
TT
Product Engineer
True Talent Solutions Partners
San Francisco Bay Area, CA
- $185,000 to $485,000 USD / year
On-site five days per week in the San Francisco Bay Area
Added 17 mins ago
OA
Engineer
Omni Amelia Island LLC
Fernandina Beach, FL
- From $24.57 USD / hour
Maintain all mechanical/structural items in public areas. Performs unskilled general maintenance repairs to building, plumbing, electrical, carpentry, painting, furniture etc. Receive…
Added 17 mins ago
DevSecOps Engineer
OFFICE OF MANAGEMENT AND ENTERPRISE SERV
United States
As a DevSecOps Engineer with OMES you will enjoy:
Added 22 mins ago
Director of Engineering
Hyatt
Rajasthan, IN
…required to the entire operation, and maintaining equipment, building, and grounds in optimum…
Added 31 mins ago
TT
Robotics Software Engineer
True Talent Solutions Partners
Watertown, MA
- $130,000 to $180,000 USD / year
Join an R&D team building software for AI-driven robots operating in real-world production environments. You will work across the robotics stack, helping deliver systems that make flexible…
Added 31 mins ago
J
Senior Marketing Operations Engineer
Jobgether
Remote, United States
- $149,000 to $195,000 USD / year
As a Senior Marketing Operations Engineer, you will take ownership of the systems, data infrastructure, and automation workflows that drive marketing performance and revenue growth. Working…
Added 32 mins ago
CAD Designer (Behind-The-Meter Power Infrastructure)
Tract Capital Management, LP
Alexandria, VA · Denver, CO · Seattle, WA
…civil, structural, controls, fire protection, EPC, and Owner’s Engineer teams to convert engineering direction, vendor information, field inputs, and design changes into clear, controlled…
Added 36 mins ago
SO
Senior Solutions Engineer (SASE) - TRANSPARENCY POSTING
State of Colorado
CO
- $110,000 to $125,000 USD / year
…all Coloradans through innovation and collaboration. We're building one of the nation's leading government IT organizations by reimagining how we support agencies, building…
Added 36 mins ago
Software Engineer II, Fintech
Twitch
San Francisco, CA
Twitch's Enterprise Platform & Technology (EPT) organization is looking for a Software Development Engineer II to build agentic AI systems on AWS that power Finance and enterprise functions…
Added 39 mins ago
Jr. Data Engineer
Amentum
Springfield, VA
As a Junior Data Engineer, you will support an exciting National Security mission to position NGA to be the enterprise and community GEOINT data provider, improving the way analysts,…
Added 40 mins ago
Software Development Engineer - Developer Platform
Workday, Inc.
CO
…collaborators who bring sun-drenched optimism and drive. Whether you're building smarter solutions, supporting customers, or creating a space where everyone belongs, you’ll do meaningful…
Added 40 mins ago
Software Development Engineer - US Federal
Workday Government, LLC
United States
…collaborators who bring sun-drenched optimism and drive. Whether you're building smarter solutions, supporting customers, or creating a space where everyone belongs, you’ll do meaningful…
Added 43 mins ago
Software Engineering Architect
Cisco Systems, Inc.
RTP, NC
About the Role: Senior DevOps Engineer, Cryptographic Services
Added 44 mins ago
Darwin Runtime Engineer, Core OS
Apple
Cupertino, CA
The Darwin Runtime team is responsible for building the low-level runtime technologies like Grand Central Dispatch (GCD), secure inter-process communication systems, memory allocator,…
Added 44 mins ago
Senior AI/ML Engineer
Node.Digital
Remote, United States
The AI/ML Engineer is the architect and guardian of intelligent automation solutions that incorporate generative AI and machine learning technologies. They ensure the operational efciency…
Added 44 mins ago
AI/ML Engineer (Midlevel)
Node.Digital
Remote, United States
The AI/ML Engineer is the architect and guardian of intelligent automation solutions that incorporate generative AI and machine learning technologies. They ensure the operational efciency…
Added 44 mins ago
DevOps Engineer/Systems Engineer (Mission Systems)
Node.Digital
McLean, VA
Must have an active TS/SCI FS Poly
Added 44 mins ago
DevSecOps Engineer
Node.Digital
Remote, United States
Hands-on experience building and managing CI/CD pipelines (Jenkins, Harness)
Added 44 mins ago
Intelligent Automation/AI-ML Engineer
Node.Digital
Remote, United States
The Intelligent Automation / AI-ML Engineer is the architect and guardian of intelligent automation solutions that incorporate AI/ML technologies, built on open-source AI models and the…
Added 44 mins ago
Intelligent Automation/AI-ML Engineer (Full Stack Engineer)
Node.Digital
Remote, United States
The engineer will also explore new ways to embed artificial intelligence and machine learning into applications, supporting continuous improvement, learning, and augmented decision making.…
Added 44 mins ago
Senior Data Engineer
Node.Digital
Remote, United States
Must have an Public Trust Clearance
Added 45 mins ago
Lead Analytics Engineer
The Knot Worldwide
Remote, United States
The Principal Analytics Engineer will architect the data and analytics infrastructure that lets our data science and analytics teams build on shared, trusted foundations across Growth &…
Added 49 mins ago
Field Service Engineer 1
GE HEALTHCARE
Remote, United States
Must have and maintain a valid Driver's License

LiteLLM

Staff Engineer, AI

San Francisco, CA, United States

$250,000 to $350,000 USD / year

Apply on jobs.ashbyhq.com About employer

Applications open in a new tab.

Job details

Pay: $250,000 to $350,000 USD / year
Experience: 3+ years of experience.
Posting language: English
Posted: Nov 9, 2026

Original job description

LiteLLM is the world’s most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We’ve grown ARR 6x in the last year to nearly $30M with a team of 20, and developers use LiteLLM to call 100+ LLM providers through one API.

We're looking for a Staff Engineer to lead our unified API team and make sure every new model and provider works with LiteLLM on day one.

ABOUT THE ROLE

This is a hands-on technical lead role. You'll own how LiteLLM unifies LLM APIs across the OpenAI and Anthropic specs, lead the engineers who build it, and set the bar for what good looks like.

Every week a provider ships something new: a new API, a new modality, a new feature. The promise of LiteLLM is that it works with all of them on day one. Your job is to keep that promise: new endpoints ship on day one, open source translation issues go down, and developers can count on LiteLLM to keep up.

You’ll lead our open source pod, where most issues are LLM translation issues. You’ll report to the CEO, and later to our Head of Engineering. This role is in person in San Francisco. We help with relocation and support H-1B transfers.

RESPONSIBILITIES

Lead the unified API team and own new model, endpoint, and provider rollouts end to end.
Design provider-agnostic features at the gateway level, such as session management for non-OpenAI models.
Triage open source issues and outside PRs (new providers, translation fixes) and get them merged, reviewed, or replaced with an internal fix.
Review the AI team's PRs and hold a high bar for code quality, including code written with AI.
Find the power users in your area and use what they need to decide what to build next.
Take on new unification bets with a customer who will use them and give feedback.
Own the developer experience for everyone who uses LiteLLM's Python SDK and proxy.

What is our tech stack

The tech stack includes Python, FastAPI, Redis, Postgres. We're moving the gateway to Rust.

WHAT WE'RE LOOKING FOR

You've been a machine learning engineer and now build applied AI products.
3+ years of experience. The scope you've owned matters more than a Staff title.
Deep expertise in LLM APIs. You can speak to the differences between /chat/completions and /responses, and to each provider's nuances.
Experience building or maintaining a unified API that sits in front of many providers.
Taste in developer experience. You can tell when an API or playground is bad and explain why.
Customer empathy. You ask why a user wants something and how big the use case is before you build it.
Ready to lead a team from day one and set the technical bar yourself.
Strong software engineering fundamentals in Python.

BONUS POINTS

Experience at a company built on a unified API, such as OpenRouter, Vercel AI SDK, Merge, Segment, or Fivetran.
You've built your own unified API or written about what a good one should do.
You've built evals for LLMs.
You've used LiteLLM in production.
Open source contributions, especially to LLM tooling.

WHY JOIN LITELLM?

Work directly with the founders every day.
Lead the team behind the core of the product: the unified API thousands of engineering teams depend on.
Own a whole area of the product. We don't have PMs: engineers talk to customers and decide what to build.
Your work ships in open source, used by engineering teams around the world.
Move incredibly fast and see your work in production immediately.
Competitive salary, equity, health, dental, and vision benefits.

ABOUT LITELLM

LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.

If you want to lead the team that keeps LiteLLM ahead of every model launch, we'd love to meet you.

Apply on jobs.ashbyhq.com About employer

More about this job

Skills

Translation
Python
Redis
Rust
Machine learning
Lead a team

Report this job

Work requirements

Jobs in the United States