Find work in the United States.

6,265,094 jobs across our US network. How we count

Jobs in the United States

25+ jobs

Save this search

Added 7 mins ago
G
Engineer I - Forward Deployed Engineer
GSK
Cambridge, MA
- $95,700 to $159,500 USD / year
The Engineer I is a mid-level individual contributor in the FDE team. This role contributes to FDE engagements under the direction of more senior FDEs, learning the practice through…
Added 8 mins ago
ZC
Principal AI Security Engineer
Zip Co Limited
United States
- $203,000 to $254,000 USD / year
Architect and build scalable security controls for LLM applications, RAG systems, and agentic AI platforms.
Added 13 mins ago
Software Engineer 1, Full-Stack
Cook Group
Bloomington, IN · Indianapolis, IN · West Lafayette, IN
The Software Engineer, Full-Stack develops, implements and documents software and programs that provide the technical solutions to meet specifications and business requirements defined by…
Added 16 mins ago
System Development Engineer, GenAI and Agentic ADC
Amazon Development Center U.S., Inc.
Arlington, VA
The GenAI and Agentic ADC Developer Experience team is at the forefront of delivering AWS Agentic AI cloud services to our customers in classified environments. We are dedicated to pushing…
Added 16 mins ago
Software Dev Engineer, Amazon WorkSpaces Core Manged Instances
Amazon Web Services, Inc.
Sunnyvale, CA · Seattle, WA
…infrastructure that power the next generation of intelligent agentic AI systems and virtual desktop experiences. You'll work across the full technology stack - from intuitive end-user…
Added 20 mins ago
Senior Full Stack Product Engineer
CubX Inc.
Lakewood, NJ
CubX is looking for a Senior Full Stack Product Engineer who can take a business need from concept to production.
Added 21 mins ago
IG
TS/SCI Full Stack Software Engineer
Insight Global
Beavercreek, OH
- From $68 USD / hour
Hands on experience with AI augmented development workflows or agentic tools, such as Codex, Claude Code, or OpenCode or other multi-agent approach
Added 22 mins ago
Senior Analyst, Agentic AI Engineer
Dell
Hopkinton, MA
Join us to do the best work of your career and make a profound social impact as a Senior Analyst, Agentic AI Engineer on our Services Operations AI Transformation team in Hopkinton,…
Added 31 mins ago
UG
Lead AI/ML Engineer - Office Based - Eden Prairie, MN
UnitedHealth Group
Eden Prairie, MN
- $145,500 to $249,500 USD / year
As a Lead AI/ML Engineer on the Optum Technology team, you will drive the design, development, and deployment of enterprise-grade machine learning models and artificial intelligence…
Added 34 mins ago
F
AI-Native Detection and Triage Engineer
Fly.io
Remote, United States
- $180,000 to $225,000 USD / year
…breaking our own hypervisor and kernel stack. A Platform Security Engineer, hiring in parallel with this role, will own isolation on the hosts. The seat we are adding will own the signal:…
Added 37 mins ago
Senior Analyst, Agentic AI Engineer
Hopkinton, MA
Join us to do the best work of your career and make a profound social impact as a Senior Analyst, Agentic AI Engineer on our Services Operations AI Transformation team in Hopkinton,…
Added 39 mins ago
RU
Technical Lead - Simulation Engineer
Randstad USA
Remote, United States
- $70 to $110 USD / hour
We are seeking an execution-focused Technical Lead & Omniverse Platform Engineer to anchor a dedicated 6-person delivery squad building a common, scalable Simulation Foundation Platform. In…
Added 41 mins ago
BS
Developer Support Engineer, Open API
Buildertrend Solutions, Inc.
Remote, United States
- $90,000 to $120,000 USD / year
As a Developer Support Engineer for the Open API, you’ll help shape the future of construction technology from day one. You’ll be the go-to technical expert for builders and developers who…
Added 41 mins ago
W
AI Full Stack Engineer
Wavestone
Pittsburgh, PA
- $90,000 to $120,500 USD / year
As an AI Engineer, you will contribute to the delivery of enterprise AI, Generative AI, Agentic AI, and data-driven solutions across a variety of industries. You will gain hands-on…
Added 46 mins ago
Senior Full Stack AI Engineer (US Citizen)
Remote, United States
Serve as a senior, hands-on full-stack AI engineer, leading the design, development, and delivery of large-scale mission-critical AI systems.
Added 48 mins ago
Systems Development Engineer II, US Amazon Dedicated Cloud Security Engineering
Amazon.com Services LLC
Herndon, VA
AWS Security is looking for a driven Systems Development Engineer to build and maintain the automation that enables security assurance at scale. You will work among a larger team to…
Added 53 mins ago
IG
REMOTE Data Scientist
Insight Global
Remote, United States
- From $55 USD / hour
Our client is investing heavily in Generative AI and Agentic AI initiatives to enhance business operations and improve access to organizational knowledge. They are seeking a GenAI Engineer…
Added 55 mins ago
Staff Machine Learning Engineer
ServiceNow
Santa Clara, CA
It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy. That moment inspired Fred to build a company that could…
Added 55 mins ago
Distinguished Platform Engineer
ServiceNow
Santa Clara, CA
As a Distinguished Engineer in HRSD, you set the technical direction for model-driven capability across the HR domain, the agentic and conversational experiences that interpret employee,…
Added 55 mins ago
Sr Enterprise Account Exec ( Armis / Veza )
ServiceNow
Remote, United States
It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy. That moment inspired Fred to build a company that could…
Added 58 mins ago
Applied AI Architect
Databricks
Remote, United States
AI Engineering: Working with LLMs and agentic systems, including vector databases, fine-tuning, AI guardrails, and frameworks like LangChain, Hugging Face, or OpenAI APIs
Added 58 mins ago
TT
Forward Deployed Engineer
True Talent Solutions Partners
New York, NY
- $165,000 to $215,000 USD / year
…opportunity suits either a hands-on individual contributor or an engineer ready to build and lead a…
Added 59 mins ago
Business Analyst - AI Prompts - Owner & Operator Portal
IHG
Atlanta, GA · GA
…enablement efforts. This person does not need to be a deep AI engineer or data scientist, but should be curious, proactive, process-oriented, and comfortable learning new AI concepts,…
Added 1 hour ago
Senior Manager, AI Enablement Engineer
Scotiabank
Dallas, TX
Partner with business leaders to identify high-value opportunities across GenAI, agentic AI, machine learning and automation.
Added 1 hour ago
Research Software Engineer
Dartmouth College
NH
The Research Software Engineer at the Center for Open Neuroscience (CON) helps build infrastructure that makes neuroscience data FAIR, open, and reproducible, working on open-source…

TrueFoundry

Senior AI/ML Engineer - LLM & Agent Stack (Customer Facing)

NY, United States
San Mateo, CA, United States

Apply About employer

Applications open in a new tab.

Job details

Experience: 5–10 years of software engineering with substantial experience building distributed systems, infra, or ML platforms.
Posting language: English
Posted: Nov 6, 2026

Original job description

About TrueFoundry

Every production AI system, whether it's powering customer support, writing code, analysing financial data, or diagnosing medical conditions, needs the same foundational infrastructure.A way to route between models. A way to manage tools and integrate them securely. A way to orchestrate agents and enforce governance. A unified compute layer to run it all.

That infrastructure layer is being built right now.

We are looking for a Senior AI/ML Engineer - LLM & Agent Stack (Customer-Facing) to join the team.

The Problem We're Solving

Companies are moving beyond simple chatbots to production agentic systems. These systems route between OpenAI, Anthropic, Google, and self-hosted models. They integrate dozens of tools via protocols like MCP. They orchestrate multi-agent workflows where agents coordinate with other agents.

The infrastructure to support this doesn't exist yet. You can't just duct-tape together a few API calls and call it production-ready.

You need a control plane that handles:

Intelligent routing with observability, cost policies, and fallback logic
Centralized tool and MCP server management with security and lifecycle controls
Agent orchestration with governance and guardrails
A unified compute layer to run self-hosted models, custom tools, and agents

AI Gateway is the control plane: five composable components (Prompts, LLM Gateway, MCP Gateway, Guardrails, Agent Gateway) that handle routing, orchestration, and governance.

We're Series A, backed by Intel Capital and Sequoia. Companies like CVS, Mastercard, Siemens, Paytm, Synopsys, and Zscaler run production AI workloads on our platform.

Role summary

You’ll design and own core components that enable enterprise customers to run production agentic AI safely and efficiently on TrueFoundry. This includes building robust orchestration for multi-step agents (graph/stateful workflows), model/routing logic, observability and policy enforcement (cost, data residency, rate limiting), and integrating upstream tooling like LangGraph, LangChain, vector stores, and specialized LLM runtimes. This is a customer-facing role where you'll work closely with TrueFoundry's enterprise customers. You may also need to write code in their environments.

What you’ll do

• Architect and implement scalable agent orchestration patterns (graph-based executors, state management, multi-agent coordination) for production workloads.

• Own critical integrations: model adapters, LLM gateway hooks, vector DBs, tools & external APIs, and the platform’s LLMops flows.

• Build and improve tracing, benchmarking and observability for LLMs and agents - token/cost accounting, latency p95, throughput, and correctness checks.

• Drive design for safety/guardrails: moderation hooks, human-in-the-loop checkpoints, replayable audit trails and policy enforcement.

• Mentor junior engineers, run design reviews, and improve engineering practices (testing, CI/CD, chaos testing for agents).

• Work directly with strategic customers to prototype complex agentic solutions and translate them into product features.

Must-have

• 5–10 years of software engineering with substantial experience building distributed systems, infra, or ML platforms.

• Deep practical experience integrating and deploying LLMs in production (RAG, retrieval, embeddings pipelines).

• Hands-on experience with agent orchestration frameworks (LangGraph / LangChain or custom agent runtimes) and stateful workflow design.

• Strong systems knowledge: Kubernetes, container orchestration, service meshes, and performance tuning.

• Proven track record building observability, cost controls, and policy enforcement for production services.

Preferred / differentiators

• Experience building or contributing to open-source LLM orchestration tools (LangGraph, LangChain, or similar).

• Familiarity with enterprise constraints: on-prem/cloud hybrid deployments, data residency, compliance requirements.

• Background in security, privacy, or model governance for LLMs.

• Demonstrated leadership in cross-functional projects and direct customer engagement.

Traits we are looking for: ownership, ability to execute, hustle and thinking out of the box, data-driven decision making, be comfortable with more unknowns than knowns.

Perks of Working at TrueFoundry

Join a fast-growing Series A, Bay Area-based startup building cutting-edge AI infrastructure.
Comprehensive health insurance for you and your family, including medical, dental, and vision coverage.
401(k) retirement plan.
Flexible hybrid work, 2 days a week in the office (Tuesday & Wednesday), with flexibility around the schedule.
Lunch and snacks are on us whenever you come into the office.
Work from another TrueFoundry office for up to 1 month each year, whether that's our London or India office, if you'd like a change of scenery.

Apply About employer

More about this job

Skills

ML
LangChain
Cost accounting
CI/CD
Workflow
Kubernetes
Regulatory compliance
Leadership
Decision making

Report this job