Full-Stack Engineer, Agent Evaluation & Reliability

ABOUT THE ROLE

Join an AI team building infrastructure for agent evaluation and continuous improvement. This backend-leaning full-stack role combines ownership of core systems with the opportunity to ship product features and work directly with enterprise customers.

WHAT YOU'LL DO

• Build backend systems and data models for evaluation datasets, experiment runs, agent traces, knowledge versions, findings, and customer-defined quality criteria.
• Develop and support enterprise integrations, including authentication, OAuth, webhooks, incremental syncs, backfills, rate limits, retries, and monitoring.
• Own features from technical design and implementation through deployment, monitoring, customer feedback, and iteration.
• Work with customers to understand their systems, diagnose issues, and turn specific needs into reusable product capabilities.
• Contribute across the stack, building product experiences that make underlying systems useful.

WHAT WE'RE LOOKING FOR

• At least 2 years of experience building and shipping production systems as a backend or full-stack engineer.
• Production experience with TypeScript and Node.js or Bun, PostgreSQL, and job queues or worker systems.
• Experience at a fast-paced startup, and a track record of owning projects end-to-end from design through deployment and iteration.
• Hands-on machine learning engineering experience, including model development.
• Experience building enterprise integrations, including OAuth flows, webhooks, incremental syncs, backfills, and rate-limit handling.
• Production experience with agent infrastructure, LLM evaluation, tracing, or agent memory systems is valuable.

COMPENSATION & BENEFITS

Base salary: $120,000 to $180,000 annually. Visa sponsorship is available.

LOCATION

On-site in San Francisco, California, United States.