Find work in the United States.

A simpler way to find your next job.

Jobs in the United States

25+ jobs

Save this search

Added 1 min ago
T
Senior Desktop Test Automation Engineer
TEKsystems
Round Rock, TX
- $55 to $60 USD / hour
Dell is seeking a Senior Desktop Test Automation Engineer / SDET to own and architect automated testing for Elevation Builder, a Windows desktop application used by Dell's pre-sales…
Added 1 min ago
Principal Software Engineer - Simulation Data, Validation & Infrastructure
Caterpillar, Inc.
Irving, TX
…intelligent automation, and rigorous validation. This Principal Engineer role is a hands-on technical leadership position responsible for architecture, critical implementation, engineering…
Added 1 min ago
Enterprise Architecture Manager, Senior Vice President
Citigroup
Irving, TX
…structural impact assessments on core operating platforms to engineer proactive systemic…
Added 1 min ago
IS Technical Specialist/Back-end Tech Lead
Huntington National Bank
Dallas, TX
Certifications like cloud architect/engineer/developer are strongly preferred.
Added 1 min ago
IS Technical Specialist/Back-end Tech Lead
Huntington National Bank
Houston, TX
Certifications like cloud architect/engineer/developer are strongly preferred.
Added 2 mins ago
IS Technical Specialist/Back-end Tech Lead
Huntington National Bank
Austin, TX
Certifications like cloud architect/engineer/developer are strongly preferred.
Added 2 mins ago
Sr Principal Application Engineer
Cadence Design Systems, Inc.
Austin, TX
The Architect will serve as a technical leader within Cadence’s North America Field Applications Team, driving strategic customer engagements and influencing next-generation EDA &…
Added 2 mins ago
C
AI Data Engineer
Cognizant
Austin, TX
- $100,000 to $115,000 USD / year
AWS certifications such as AWS Certified Data Engineer, AWS Certified Developer, or AWS Certified Solutions Architect.
Added 2 mins ago
C
AI Data Engineer
Cognizant
Austin, TX
- $100,000 to $115,000 USD / year
AWS certifications such as AWS Certified Data Engineer, AWS Certified Developer, or AWS Certified Solutions Architect.
Added 2 mins ago
GRC Architect/ Information Security Manager- US
DXC Technology
Austin, TX
Minimum 5+ years of professional experience as an Archer Administrator or Archer Engineer
Added 6 mins ago
C
Finance & Business Engineer
Calder
Redwood City, CA
- $105,000 to $241,000 CAD / year
As our first Finance / Business Engineer, you will build the infrastructure to provide us with a live view of our economics, data supply, and customer demand. This infrastructure will be…
Added 6 mins ago
C
Senior Software Engineer - Platform
Calder
Redwood City, CA
- $179,000 to $250,500 USD / year
You'll architect and scale the infrastructure that processes terabytes of 3D data daily, ensuring reliability, cost efficiency, and fast iteration for the engineering teams that depend on…
Added 58 mins ago
CU
Part-Time Online Course Facilitator: AI/ML Technology and Architecture
Cornell University
Remote, United States
- Part-time
Brings substantial professional experience as a data scientist, machine learning engineer, NLP engineer, AI engineer, or AI/software architect, with a track record of building and deploying…
Added 1 hour ago
SI
Senior Manager, Competitive Intelligence PACE & Agentforce
Salesforce, Inc.
Remote, United States
- $150,100 to $227,000 USD / year
Must have 5+ years of pre-sales, technical or implementation experience (e.g. solutions engineer, enterprise architect, technical architect, implementation specialist, solutions consultant).
Added 1 hour ago
SH
Business Intelligence Engineer III, Workday and AI Copilot
Sutter Health
Remote, United States
- $93,953.6 to $176,155.2 USD / year
A specialized mid-level technical professional who exercises independent judgment to architect, engineer, and optimize full-stack data products. This role acts as a technical authority,…
Added 1 hour ago
Senior AI Engineer, AI Safety
NVIDIA USA
Remote, United States
Serving as an AI Engineer on our AI Safety Engineering team, you will have a key and adaptable role in scaling methods to secure and align advanced AI systems. Your early work will center…
Added 1 hour ago
IC
Senior AI Software Development Engineer
Intel Corporation
OR · TX
- $133,410 to $240,710 USD / year
…Computing (HPC) workloads. As a Senior AI Software Development Engineer, you will architect, develop, and optimize the oneAPI Collective Communications Library (oneCCL), enabling scalable,…
Added 2 hours ago
O
Principal Core Infrastructure Engineer
Oracle
Austin, TX
- $114,600 to $234,600 USD / year
Oracle Cloud Infrastructure (OCI) is hiring a Principal Core Infrastructure Engineer to join the Next Gen Network Observability team. Help build cloud-scale intelligence systems that enable…
Added 2 hours ago
O
Principal Core Infrastructure Engineer
Oracle
Nashville, TN · Seattle, WA · Santa Clara, CA
- $114,600 to $234,600 USD / year
–Lead the development and implementation, and begin to architect, components of scalable distributed systems that support horizontal and vertical scaling to meet system demands, including…
Added 3 hours ago
Principal Software Engineer - Simulation Data, Validation & Infrastructure
Irving, TX
…intelligent automation, and rigorous validation. This Principal Engineer role is a hands-on technical leadership position responsible for architecture, critical implementation, engineering…
Added 3 hours ago
Solution Architect (AWS / AI)
CapNexus
NY
CapNexus is looking for a Solutions Architect to translate client problems into technical solutions and own the architecture the engineering team builds against.
Added 3 hours ago
GV
Senior Manager - Engineering Capability & Transformation Leader (m/f)
GE Vernova
Charleroi, PA
- $162,900 to $244,000 CAD / year
GE Vernova is executing its most significant engineering talent transformation in a generation. Engineer 2030 is GE Vernova's strategy to double engineering productivity while ensuring the…
Added 3 hours ago
Lead Engineer, IAM Platform Engineering
AmerisourceBergen
Conshohocken, PA
Added 3 hours ago
Director, Data & Information Architecture
Pivot Bio
Minnetonka, MN
This role is not primarily a cloud infrastructure architect, integration engineer, or BI/reporting architect position. Success requires deep information architecture capability, including…
Added 3 hours ago
Solutions Engineer, DroneDeploy
Procore Technologies, Inc.
TX
We are looking for a Solutions Engineer, DroneDeploy to own enterprise accounts end-to-end and scale reality capture adoption across physical asset portfolios. As the Solutions Engineer,…

TrueFoundry

Senior AI/ML Engineer - LLM & Agent Stack (Customer Facing)

NY, United States
San Mateo, CA, United States

Apply About employer

Applications open in a new tab.

Job details

Experience: 5–10 years of software engineering with substantial experience building distributed systems, infra, or ML platforms.
Posting language: English
Posted: Nov 6, 2026

Original job description

About TrueFoundry

Every production AI system, whether it's powering customer support, writing code, analysing financial data, or diagnosing medical conditions, needs the same foundational infrastructure.A way to route between models. A way to manage tools and integrate them securely. A way to orchestrate agents and enforce governance. A unified compute layer to run it all.

That infrastructure layer is being built right now.

We are looking for a Senior AI/ML Engineer - LLM & Agent Stack (Customer-Facing) to join the team.

The Problem We're Solving

Companies are moving beyond simple chatbots to production agentic systems. These systems route between OpenAI, Anthropic, Google, and self-hosted models. They integrate dozens of tools via protocols like MCP. They orchestrate multi-agent workflows where agents coordinate with other agents.

The infrastructure to support this doesn't exist yet. You can't just duct-tape together a few API calls and call it production-ready.

You need a control plane that handles:

Intelligent routing with observability, cost policies, and fallback logic
Centralized tool and MCP server management with security and lifecycle controls
Agent orchestration with governance and guardrails
A unified compute layer to run self-hosted models, custom tools, and agents

AI Gateway is the control plane: five composable components (Prompts, LLM Gateway, MCP Gateway, Guardrails, Agent Gateway) that handle routing, orchestration, and governance.

We're Series A, backed by Intel Capital and Sequoia. Companies like CVS, Mastercard, Siemens, Paytm, Synopsys, and Zscaler run production AI workloads on our platform.

Role summary

You’ll design and own core components that enable enterprise customers to run production agentic AI safely and efficiently on TrueFoundry. This includes building robust orchestration for multi-step agents (graph/stateful workflows), model/routing logic, observability and policy enforcement (cost, data residency, rate limiting), and integrating upstream tooling like LangGraph, LangChain, vector stores, and specialized LLM runtimes. This is a customer-facing role where you'll work closely with TrueFoundry's enterprise customers. You may also need to write code in their environments.

What you’ll do

• Architect and implement scalable agent orchestration patterns (graph-based executors, state management, multi-agent coordination) for production workloads.

• Own critical integrations: model adapters, LLM gateway hooks, vector DBs, tools & external APIs, and the platform’s LLMops flows.

• Build and improve tracing, benchmarking and observability for LLMs and agents - token/cost accounting, latency p95, throughput, and correctness checks.

• Drive design for safety/guardrails: moderation hooks, human-in-the-loop checkpoints, replayable audit trails and policy enforcement.

• Mentor junior engineers, run design reviews, and improve engineering practices (testing, CI/CD, chaos testing for agents).

• Work directly with strategic customers to prototype complex agentic solutions and translate them into product features.

Must-have

• 5–10 years of software engineering with substantial experience building distributed systems, infra, or ML platforms.

• Deep practical experience integrating and deploying LLMs in production (RAG, retrieval, embeddings pipelines).

• Hands-on experience with agent orchestration frameworks (LangGraph / LangChain or custom agent runtimes) and stateful workflow design.

• Strong systems knowledge: Kubernetes, container orchestration, service meshes, and performance tuning.

• Proven track record building observability, cost controls, and policy enforcement for production services.

Preferred / differentiators

• Experience building or contributing to open-source LLM orchestration tools (LangGraph, LangChain, or similar).

• Familiarity with enterprise constraints: on-prem/cloud hybrid deployments, data residency, compliance requirements.

• Background in security, privacy, or model governance for LLMs.

• Demonstrated leadership in cross-functional projects and direct customer engagement.

Traits we are looking for: ownership, ability to execute, hustle and thinking out of the box, data-driven decision making, be comfortable with more unknowns than knowns.

Perks of Working at TrueFoundry

Join a fast-growing Series A, Bay Area-based startup building cutting-edge AI infrastructure.
Comprehensive health insurance for you and your family, including medical, dental, and vision coverage.
401(k) retirement plan.
Flexible hybrid work, 2 days a week in the office (Tuesday & Wednesday), with flexibility around the schedule.
Lunch and snacks are on us whenever you come into the office.
Work from another TrueFoundry office for up to 1 month each year, whether that's our London or India office, if you'd like a change of scenery.

Apply About employer

More about this job

Skills

ML
LangChain
Cost accounting
CI/CD
Workflow
Kubernetes
Regulatory compliance
Leadership
Decision making

Report this job