Find work in the United States.

A simpler way to find your next job.

Jobs in the United States

25+ jobs

Save this search

Added just now
CI
Senior Full Stack Product Engineer
CubX Inc.
Lakewood, NJ
- $90,000 to $150,000 USD / year
CubX is looking for a Senior Full Stack Product Engineer who can take a business need from concept to production.
Added 16 mins ago
Gemini Enterprise for CX Sr. Engineer
Accenture
Morristown, NJ
A hands-on Senior Engineer with strong experience in Google’s Gemini Enterprise for Customer Experience (GECX) Solutions - now building deep expertise in Google Cloud Platform (GCP). You…
Added 16 mins ago
Senior Quality Engineer
Pearson
Trenton, NJ
As a Senior Quality Engineer, you will serve as a technical authority for quality across one or more product domains. You will lead quality strategy, test planning, automation initiatives,…
Added 16 mins ago
C
Senior Java Full Stack Engineer – Spring Boot & AWS
Cognizant
Trenton, NJ
- $86,000 to $99,000 USD / year
As a Senior Java Full Stack Engineer – Spring Boot & AWS , you will make an impact by designing and delivering scalable, secure, cloud-based applications using Java, Spring Boot, React, and…
Added 23 mins ago
Software Engineer, Infrastructure & Reliability
CrewAI
Remote, United States
…networking, and runtime reliability. Your job is to make the product and runtime teams faster while making customer’s production environments…
Added 23 mins ago
Forward Deployed Engineer - (East coast based)
CrewAI
Remote, United States
The Forward Deployed Engineer (FDE) at CrewAI is a pivotal, customer-facing role that bridges the gap between our cutting-edge AI technology and our clients' specific needs. We are looking…
Added 23 mins ago
Senior Full-Stack Engineer, Agent Management Platform
CrewAI
Remote, United States
This is a senior full-stack product engineering role with a strong frontend emphasis. You'll spend most of your time building rich, intuitive interfaces, while owning the backend changes…
Added 46 mins ago
C
Test and Evaluation Engineer II - Data Analyst
Credence
Aberdeen Proving Ground, MD
- $110,000 to $150,000 USD / year
Credence has an immediate need for a self-motivated Test and Evaluation Engineer II to support the development, testing, analysis, and evaluation of Positioning, Navigation, and Timing…
Added 1 hour ago
Software Engineer, Full Stack
Crazy Maple Studio
Sunnyvale, CA
…fast. The ones that work could become the company’s next big…
Added 1 hour ago
Software Engineer, Backend
Crazy Maple Studio
Sunnyvale, CA
…fast. The ones that work could become the company’s next big…
Added 1 hour ago
Engineer IV - Svcs RF
Ericsson
WA
Ericsson is looking for an experienced RF Engineer to join the MACS team in the USA. In this role, you will serve as a subject matter expert in RF optimization, lead engineering teams…
Added 1 hour ago
Principal Software Engineer (Prisma Access)
Palo Alto Networks, Inc.
CA
As a Principal Software Engineer for Prisma Access, you will lead the architecture, systems design, and performance optimization of cloud infrastructure underpinning Palo Alto Networks'…
Added 1 hour ago
Lead Software Engineer
Mojo AI
Sandy, UT
We are seeking an experienced and highly skilled Lead Software Engineer to join our team. As the team’s technical lead, you will guide general team processes and ensure quality across both…
Added 1 hour ago
C
Sales Solutions Engineer - Ed Tech
Coursedog
Remote, United States
- $120,000 to $140,000 USD / year
As a Solutions Engineer at Coursedog, you’ll lead the demos, scoping, and CX calls that align customers, Sales, and Customer Success before a deal is booked. You’ll work closely with…
Added 2 hours ago
Full Stack Engineer
True Talent Solutions Partners
San Francisco, CA
- Fix bugs and deliver product improvements across customer marketplace, supplier portal, and internal ERP tools.
Added 2 hours ago
Quality Engineer II
Twenty-Six Defense
Fort Worth, TX
Job Summary: The Quality Engineer I is responsible for supporting product and process quality throughout the manufacturing lifecycle in a highly regulated aerospace and defense environment.…
Added 2 hours ago
Principal AI translation architect 200 languages
Travoom
Remote, United States
Added 2 hours ago
Agentic Context Engineer
Wisdom AI
Remote, United States
The Role: As an Agentic Context Engineer at WisdomAI, you will work within a Field Engineering team to guide customers from early solution shaping through scaled deployment. You will help…
Added 2 hours ago
Mojo Libraries Engineer (Copy)
Modular
Remote, United States
We are looking for a motivated engineer to join the Hardware Enablement team at Modular. In this role you will work across the Modular software stack, from Mojo kernels and the graph…
Added 2 hours ago
TT
Software Engineer, iOS
True Talent Solutions Partners
New York, NY
- $130,000 to $230,000 USD / year
Join a product-focused mobile team building and scaling a native iOS app for a creator marketplace. You will own features end to end and help shape the app's architecture and engineering…
Added 2 hours ago
C|
Senior Software Engineer III, Backend
Connexity | Skimlinks, a Taboola company
Remote, United States
- $175,000 to $200,000 USD / year
We are seeking a skilled and motivated Senior Software Engineer III, Backend to join our Internal Tools team. Our team owns the design and implementation of our next-generation internal…
Added 3 hours ago
Software Engineer - Product
doe
San Francisco, CA
Added 3 hours ago
Staff Software Engineer
Conga
Boston, MA · Houston, TX
As a Staff Software Engineer, you will work with Cassandra, Redis, Azure, and event-driven patterns to deliver high-throughput backend solutions. You will collaborate with an international…
Added 3 hours ago
Software Engineer, Runtime Infrastructure
Nominal
NY
Join Nominal as a Software Engineer, Runtime Infrastructure
Added 3 hours ago
RF/Microwave Design Engineer
Communications and Power Industries, Inc.
State College, PA
We are seeking an experienced RF/Microwave Design Engineer who can both develop advanced RF hardware and lead focused engineering development projects. This is a hands-on technical role for…

TrueFoundry

Senior AI/ML Engineer - LLM & Agent Stack (Customer Facing)

NY, United States
San Mateo, CA, United States

Apply About employer

Applications open in a new tab.

Job details

Experience: 5–10 years of software engineering with substantial experience building distributed systems, infra, or ML platforms.
Posting language: English
Posted: Nov 6, 2026

Original job description

About TrueFoundry

Every production AI system, whether it's powering customer support, writing code, analysing financial data, or diagnosing medical conditions, needs the same foundational infrastructure.A way to route between models. A way to manage tools and integrate them securely. A way to orchestrate agents and enforce governance. A unified compute layer to run it all.

That infrastructure layer is being built right now.

We are looking for a Senior AI/ML Engineer - LLM & Agent Stack (Customer-Facing) to join the team.

The Problem We're Solving

Companies are moving beyond simple chatbots to production agentic systems. These systems route between OpenAI, Anthropic, Google, and self-hosted models. They integrate dozens of tools via protocols like MCP. They orchestrate multi-agent workflows where agents coordinate with other agents.

The infrastructure to support this doesn't exist yet. You can't just duct-tape together a few API calls and call it production-ready.

You need a control plane that handles:

Intelligent routing with observability, cost policies, and fallback logic
Centralized tool and MCP server management with security and lifecycle controls
Agent orchestration with governance and guardrails
A unified compute layer to run self-hosted models, custom tools, and agents

AI Gateway is the control plane: five composable components (Prompts, LLM Gateway, MCP Gateway, Guardrails, Agent Gateway) that handle routing, orchestration, and governance.

We're Series A, backed by Intel Capital and Sequoia. Companies like CVS, Mastercard, Siemens, Paytm, Synopsys, and Zscaler run production AI workloads on our platform.

Role summary

You’ll design and own core components that enable enterprise customers to run production agentic AI safely and efficiently on TrueFoundry. This includes building robust orchestration for multi-step agents (graph/stateful workflows), model/routing logic, observability and policy enforcement (cost, data residency, rate limiting), and integrating upstream tooling like LangGraph, LangChain, vector stores, and specialized LLM runtimes. This is a customer-facing role where you'll work closely with TrueFoundry's enterprise customers. You may also need to write code in their environments.

What you’ll do

• Architect and implement scalable agent orchestration patterns (graph-based executors, state management, multi-agent coordination) for production workloads.

• Own critical integrations: model adapters, LLM gateway hooks, vector DBs, tools & external APIs, and the platform’s LLMops flows.

• Build and improve tracing, benchmarking and observability for LLMs and agents - token/cost accounting, latency p95, throughput, and correctness checks.

• Drive design for safety/guardrails: moderation hooks, human-in-the-loop checkpoints, replayable audit trails and policy enforcement.

• Mentor junior engineers, run design reviews, and improve engineering practices (testing, CI/CD, chaos testing for agents).

• Work directly with strategic customers to prototype complex agentic solutions and translate them into product features.

Must-have

• 5–10 years of software engineering with substantial experience building distributed systems, infra, or ML platforms.

• Deep practical experience integrating and deploying LLMs in production (RAG, retrieval, embeddings pipelines).

• Hands-on experience with agent orchestration frameworks (LangGraph / LangChain or custom agent runtimes) and stateful workflow design.

• Strong systems knowledge: Kubernetes, container orchestration, service meshes, and performance tuning.

• Proven track record building observability, cost controls, and policy enforcement for production services.

Preferred / differentiators

• Experience building or contributing to open-source LLM orchestration tools (LangGraph, LangChain, or similar).

• Familiarity with enterprise constraints: on-prem/cloud hybrid deployments, data residency, compliance requirements.

• Background in security, privacy, or model governance for LLMs.

• Demonstrated leadership in cross-functional projects and direct customer engagement.

Traits we are looking for: ownership, ability to execute, hustle and thinking out of the box, data-driven decision making, be comfortable with more unknowns than knowns.

Perks of Working at TrueFoundry

Join a fast-growing Series A, Bay Area-based startup building cutting-edge AI infrastructure.
Comprehensive health insurance for you and your family, including medical, dental, and vision coverage.
401(k) retirement plan.
Flexible hybrid work, 2 days a week in the office (Tuesday & Wednesday), with flexibility around the schedule.
Lunch and snacks are on us whenever you come into the office.
Work from another TrueFoundry office for up to 1 month each year, whether that's our London or India office, if you'd like a change of scenery.

Apply About employer

More about this job

Skills

ML
LangChain
Cost accounting
CI/CD
Workflow
Kubernetes
Regulatory compliance
Leadership
Decision making

Report this job