Jobs in the United States

25+ jobs

Save this search

Added 1 min ago
Sr AI Engineer (Emerging AI)
DAT Solutions, LLC
Seattle, WA
…and business users use to ship models: a model gateway for LLM access, inference endpoints for real-time and batch scoring, feature storage, vector search, and a common…
Added 2 mins ago
Senior Scientist, Clinical AI Research & Evaluation (Regulatory & Responsible AI)
AstraZeneca
Cambridge, MA · Cambridge
…identity as an AI researcher, you design and run evaluations of LLM-based and agentic clinical systems such as benchmarks, evaluation harnesses, LLM-as-judge methods, failure analysis, and…
Added 2 mins ago
Manager, Sales Engineering Specialists
Fivetran
Remote, United States
Added 4 mins ago
Senior Software Engineer, Search Platform
NY · Frisco, TX · Eagan, MN
Design retrieval interfaces for products and AI agents with predictable contracts, explicit latency budgets, and result payloads sized for LLM context windows.
Added 4 mins ago
Staff Software Engineer, Search Retrieval Platform
NY · Eagan, MN
Build evaluation into the platform: offline evaluation, search grading, LLM-as-judge scoring, and online experiments, so every change to retrieval can be measured.
Added 4 mins ago
Senior Software Engineer - AI, CoCounsel FDE
Frisco, TX · NY · Washington, DC · Ann Arbor, MI · Eagan, MN
Implement monitoring, logging, and tracing solutions to track LLM performance, latency, token usage, and system health in production.
Added 7 mins ago
A
Principal Software Engineer, AI Inference Cloud
ARM
Seattle, WA
- $262,700 to $355,400 USD / year
Familiarity with frameworks such as PyTorch, Ray, vLLM, SGLang, or TensorRT-LLM, or experience qualifying accelerators and tuning distributed workloads.
Added 7 mins ago
A
Staff Software Engineer, AI Compute Infrastructure
ARM
Seattle, WA
- $209,100 to $282,900 USD / year
…engineers to improve reliability, performance, scalability, and developer…
Added 7 mins ago
A
Staff Software Engineer, AI Inference Cloud
ARM
Seattle, WA
- $209,100 to $282,900 USD / year
Familiarity with frameworks such as PyTorch, Ray, vLLM, SGLang, or TensorRT-LLM, or experience qualifying accelerators and tuning distributed workloads.
Added 10 mins ago
AI/ML Engineering Director
GD Information Technology, Inc.
Remote, United States
Added 11 mins ago
Senior AI Engineer
ARM
Seattle, WA
Our team is building the open-source foundations and developer tools to make Physical AI more accessible, scalable, and reliable. We are working to simplify how AI agents interact with…
Added 11 mins ago
Sr. Manager, Recruiting Operations
Samsara
Remote, United States
Working knowledge of LLM APIs, prompt engineering, or AI-augmented workflows, enough to know where AI genuinely helps versus where it's just novelty
Added 11 mins ago
Principal Machine Learning Engineer
Cushman & Wakefield
Creve Coeur, MO
Added 21 mins ago
A
Principal Software Engineer, AI Compute Infrastructure
ARM
Seattle, WA
- $262,700 USD / year
…engineers to improve reliability, performance, scalability, and developer…
Added 21 mins ago
Manager, Organic Search
WPP Media
NY
Run technical SEO audits covering overall website health and performance and turn findings into prioritized developer tickets.
Added 22 mins ago
Principal AI Engineer - Blue Ring
Blue Origin LLC
Seattle, WA
Develop agent tooling, prompt templates, and orchestration logic for LLM service integrations
Added 23 mins ago
Sr Data Scientist
UST Global Inc
Bellevue, WA
Deep Generative AI Mastery: 3+ years of specialized experience in LLM development, including the design of autonomous agents, architectural design of foundation models, and production-grade…
Added 28 mins ago
AI Solution Deployment Engineer
FlightSafety International Inc
Seattle, WA
Maintain strong knowledge of the latest developments in LLM capabilities, implementation patterns, and AI product development stacks
Added 28 mins ago
Senior Engineer - Semantic &
Cambia Health Solutions
Burlington, WA
You will serve as a technical lead, combining deep dimensional modeling expertise with modern AI/LLM engineering, mentoring engineers, driving technical standards, and contributing to…
Added 30 mins ago
Senior Product Manager - Estate Planning
Mercer Advisors
Remote, United States
LLM evaluation and human-in-the-loop design: you've built an eval set, run it, and changed the product because of what it told you.
Added 31 mins ago
Principal Machine Learning Engineer
Amgen
Washington D.C., DC
Architect LLM/RAG with prompt management, safety guardrails, and optimized inference.
Added 31 mins ago
Senior AWS Generative AI Solution Engineer
Leidos
Washington, DC
At least 3 years of Generative AI OR LLM application development experience.
Added 34 mins ago
I
Senior AI/Machine Learning Engineer - Python | TheLoops
IFS
Palo Alto, CA
- $170,000 to $185,000 USD / year
Experience with AI evaluation frameworks, LLM observability, AI governance, and responsible AI practices.
Added 35 mins ago
Technical Architect
Las Vegas, NV
…libraries, build and production systems, server integrations, developer tools, and automation supporting multiple studios and…
Added 35 mins ago
Staff AI Engineer
ARM
Seattle, WA
Our team is building the open-source foundations and developer tools to make Physical AI more accessible, scalable, and reliable. We are working to simplify how AI agents interact with…

ClickUp

Senior AI Developer

Remote, United States

$200,000 to $250,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $200,000 to $250,000 USD / year
Experience: 5+ years of software engineering experience, including 2+ years building production LLM or ML systems.
Posting language: English
Posted: Apr 17, 2026

Original job description

At ClickUp, we're building the future of work: the first truly converged AI workspace unifying tasks, docs, chat, calendar, and enterprise search, all supercharged by context-driven AI. We are an AI-native company. Every team member is expected to leverage AI daily, and we evaluate AI fluency as part of our hiring process. Join us and help redefine what's possible. 🚀

We're looking for a highly skilled and experienced Senior AI Engineer to join our ClickUp Engineering team, with a focus on AI evaluations. You'll own how we measure and improve the quality of ClickUp's AI: building the eval systems that tell us how well our AI is performing, the core agent harness, and the AI that performs well on those evals. You'll work on backend systems that make AI-powered capabilities scalable, reliable, and secure, while working hands-on with LLMs to solve real user problems and drive product innovation.

Key Responsibilities:

Design, build, and own ClickUp's AI evaluation system, including golden datasets, LLM-as-judge and automated scorers, regression detection, and quality tracking across AI features.
Build and evolve the core agent harness, and the AI that performs well on those evals, partnering closely with product and engineering to define what "great" looks like.
Build self-improvement loops where agents modify other agents or prompts, rerun evals, and iterate automatically.
Benchmark new models as they're released and own model selection, routing, and fallback strategies across providers (e.g., OpenAI, Anthropic, Google, open-weight), balancing quality, latency, and cost.
Architect, design, and implement scalable AI platform services that support the deployment, orchestration, and lifecycle management of LLMs and other AI models.
Build and maintain robust APIs and backend systems that integrate AI-powered features into ClickUp's core platform.
Develop infrastructure for model serving, monitoring, logging, and automated evaluation to ensure high reliability and performance of AI services in production.
Drive best practices in AI privacy, security, and compliance, including data anonymization, secure data handling, and regulatory adherence.
Collaborate cross-functionally with product, frontend, and data teams to deliver seamless, reliable, and user-centric AI experiences.

Qualifications:

5+ years of software engineering experience, including 2+ years building production LLM or ML systems.
Hands-on experience building LLM evaluation systems in production (golden datasets, LLM-as-judge, judge calibration, offline and online evals), tied to real product quality.
Strong experiment design and statistical rigor, including A/B testing, offline vs. online metrics, and separating real regressions from noisy or variable results.
Proven track record of applying LLMs and AI models to real-world, customer-facing product features.
Proven experience integrating and managing multiple LLMs, including benchmarking, routing, and cost/latency/quality tradeoffs.
Deep expertise in backend engineering, distributed systems, and cloud-native technologies (e.g., Kubernetes, Docker, AWS/GCP/Azure).
Strong programming skills in Python (preferred), Go, TypeScript, or similar languages used for backend and AI platform development.
Proficiency in orchestration frameworks and workflow engines (e.g., LangGraph, Airflow, Ray, or similar).
Familiarity with search and retrieval technologies and their integration into AI-driven applications.
Excellent collaboration and communication skills, with a track record of working effectively in cross-functional teams.
Passion for staying at the forefront of AI and applying new technologies to solve real-world problems at scale.

Nice to Have:

Background in data science, applied science, or machine learning engineering.
Experience with eval tooling (e.g., Braintrust, LangSmith, Weave, Arize, or in-house frameworks).
Experience with model routing, AI gateways, or inference optimization.

Equal Opportunity Employer

ClickUp is an Equal Opportunity Employer, and qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, or national origin.

Privacy Notice

ClickUp collects and processes personal data in accordance with applicable data protection laws. You can find further details by viewing our Global Candidate Privacy Notice. https://clickup.com/careers-terms/candidate-privacy-notice

If you are a Philippine Job Applicant, please also see our Philippine Data Privacy Notice https://t333.s.clickup-attachments-stg.com/t333/d9a53ce2-6d2c-48cd-84b1-ed4e525f9613/Philippine%20Data%20Privacy%20Notice_2024.pdf?view=open for further details.

Visa Sponsorship

Please note we are unable to sponsor or take over sponsorship of an employment visa for roles outside of engineering and product at this time. Sponsorship for engineering and product roles is not guaranteed, but is instead based on the business needs for that specific role at that time. Please reach out to the recruiter with any questions.

Fraud Alert

ClickUp Talent Acquisition will only initiate contact via an @clickup.com http://clickup.com email or through our official careers portal on clickup.com http://clickup.com. We will never request fees, payments, or sensitive personal information. Please disregard any offers received outside these channels and report them to support@clickup.com.

AI Processing Notice

ClickUp may use artificial intelligence and machine learning technologies to help review and screen candidates' employment applications against role-related criteria. These tools support, but do not replace, human decision‑making. If you have questions or need an accommodation in the recruitment process, please contact us at AskPeople@ClickUp.com.

Apply About employer

Report this job