Jobs in the United States

25+ jobs

Group jobs by employerEmail me new jobs Save this search

Added just now
Director of Engineering, Technical Infrastructure
Compass
Manhattan, NY
As Director of Engineering for Technical Infrastructure, you will own the platform that every engineer at Compass builds on. Tech Infra's mission is to empower our engineers to build, test,…
Added just now
Sr. Applications Developer (58812)
ApolloMD
ATLANTA, GA
We develop with AI. Every engineer has a Claude Enterprise seat, and we build our software through
Added just now
IG
REMOTE- Full Stack Web/ AI Engineer
Insight Global
Remote, United States
- From $60 USD / hour
5-10 years experience in full stack web development
Added just now
Manager of AI Integration & Agentic Analytics Engineering
Insight Global
Alpharetta, GA
2+ years of direct people management or formal engineering leadership experience, including responsibility for engineers' delivery, development, prioritization, and performance.
Added just now
DO
Senior Safety Engineer, Research and Standards Health Unit
Department of Industrial Relations
CA
- $11,427 to $14,298 USD / month
Under the direction of the Principal Safety Engineer (Industrial), the SSE handles the more varied, complex, and sensitive health and safety issues in the evaluation and development of…
Added just now
Research Scientist/Engr 3
University of Washington
Seattle, WA
Department of Biochemistry has an outstanding opportunity for Research Scientist/Engineer 3 to join their team.
Added just now
Research Scientist/Engineer Assistant
University of Washington
Seattle, WA
The Department of Biology has an outstanding opportunity for a Research Scientist/Engineer Assistant to join their team.
Added 1 min ago
DevSecOps Engineer
SAIC
Hampton, VA
SAIC is looking for a full-time onsite DevSecOps Engineer to join our team in Hampton, VA in support of the Air Operations Center Weapons System (AOC WS) Falconer Program's Application…
Added 1 min ago
Quality Engineer - Federal Ammunition
Anoka, MN
Federal Ammunition is seeking a Quality Engineer to join the team! In this role you will be responsible for providing pro-active hands-on Quality Engineering expertise and Quality…
Added 2 mins ago
Principal Engineer
Allstate Insurance Co.
Remote, United States
…shape the organization as the industry changes. As a Principal Engineer, this role will have leadership for all engineered solutions for how we think of AI based control implementation…
Added 2 mins ago
Senior Software Support Specialist, Tier-2 Platform Support
Xometry
North Bethesda, MD · Boston, MA
Xometry is looking for a Staff Software Engineer to join our Core Platform team. This role is a strategic technical leadership position focused on the architectural evolution of our…
Added 2 mins ago
Principal Radar Systems Engineer
STR
Dayton, OH · Woburn, MA
The Systems Development Division (SDD) within STR delivers technology advantage into users’ hands. We are is seeking a Principal Radar Systems Engineer to lead Systems Engineering…
Added 2 mins ago
Principal Radar Systems Engineer
STR
Woburn, MA · Dayton, OH
The Systems Development Division (SDD) within STR delivers technology advantage into users’ hands. We are is seeking a Principal Radar Systems Engineer to lead Systems Engineering…
Added 2 mins ago
LBNFDUNE-US Sr. Engineer (BP)
Fermi National Accelerator Laboratory
Lead, SD
WHAT YOUR DAY-TO-DAY WILL LOOK LIKE AS A SENIOR ENGINEER:
Added 3 mins ago
Engineering Manager, Materials Engineering
Aalo Atomics
Idaho Falls, ID
…levels, through regular 1:1s, performance evaluations, career development, and succession…
Added 3 mins ago
MS
Director, Quality Assurance Engineer
Morgan Stanley
Alpharetta, GA · Alpharetta
- $157,000 USD / year
Telecommuting permitted up to 3 days per week
Added 3 mins ago
DevOps Engineer
Bespoke Technologies
Reston, VA
This is a DEVOPS focused development position. Assist with maintenance of existing legacy applications and support the transition to a new system architecture.
Added 4 mins ago
Managing Consultant, Environmental Geologist/Hydrogeologist/Scientist or Engineer
Environmental Resources Management Southwest, Inc.
New Orleans, LA · Baton Rouge, LA
…Consultant, Environmental Geologist/Hydrogeologist/Scientist or Engineer based in New Orleans and Baton Rouge, you will combine technical expertise, client leadership, and strategic…
Added 4 mins ago
AI/ML Engineer
BCMC
Arlington, VA
The AI/ML Engineer will develop and implement automation solutions to support machine learning technology integration activities, focusing on agentic workflow development, automated…
Added 5 mins ago
Electrical Engineer III
Western/Scott Fetzer Company
United States
Perform complex engineering and analytical work for new product design and development.
Added 6 mins ago
State Revolving Fund (SRF) Program Manager
MassCareers
MA
MassDEP seeks applicants for the position of Environmental Engineer VI within the Bureau of Water Resources, Division of Water Investment (DWI). The Division is charged with implementing…
Added 7 mins ago
LI
Project Engineer (Geotechnical / Tunnel)
LJB Inc.
Columbus, OH
- $95,000 to $144,000 USD / year
LJB Inc. is currently seeking a qualified candidate to fill a full-time Project Engineer (Geotechnical/Tunnel) role in our Columbus, OH, office. The ideal candidate will have 5-8 years of…
Added 9 mins ago
Full Stack Software Engineer Q4
Alethios
San Francisco, CA
As our first Software Engineer, you will play a critical role in the development of our full stack web application. You'll have the opportunity to work across both frontend and backend…
Added 9 mins ago
OS
Mechanical Engineer - New Graduate 2027
Observable Space
Los Angeles, CA
- $100,000 to $110,000 USD / year
Observable Space is seeking a New Graduate Mechanical Engineer to join our engineering team in Los Angeles in Summer 2027. This is an opportunity for an early-career engineer to contribute…
Added 9 mins ago
RR
Senior Mechanical Engineer
REV Robotics
Carrollton, TX
- $100,000 to $115,000 USD / year
As a Senior Mechanical Engineer, you will drive innovation and design within our groundbreaking ION and DUO product lines, influencing how students and teams worldwide interact with REV…

Bask Health

Software Engineer, AI Quality & Evaluation

Remote, United States

Apply on apply.workable.com About employer

Applications open in a new tab.

Job details

Experience: 3+ years of professional software engineering experience, preferably in backend, platform, infrastructure, or developer tooling roles.
Posting language: English
Posted: Nov 12, 2026

Original job description

About Bask Health Bask Health is a software platform that enables entrepreneurs, doctors, and healthcare businesses to launch, manage, and grow direct-to-consumer telehealth businesses. Our platform brings together patient experiences, clinical workflows, pharmacy operations, and commerce tools in one place. We're an entrepreneurial, product-focused engineering team that values ownership, technical excellence, and building software that solves real problems. Engineers work closely with product teams and company leadership, take features from idea to production, and have a direct role in shaping the platform. Engineering at Bask is AI-first and builder-led. We use tools like Cursor and Claude Code throughout development while maintaining high standards for reliability, testing, and software quality. About the Role We're looking for a Software Engineer, AI Quality & Evaluation to build the engineering systems that help Bask Health test, evaluate, and improve AI-powered applications throughout their development and production lifecycles. Bask Health supports direct-to-consumer telehealth businesses through a platform that connects patient experiences, merchant operations, clinical workflows, pharmacy coordination, and commerce tools. As we introduce more AI-powered capabilities across these areas, we need reliable software infrastructure that makes it easy for engineering teams to understand how those systems behave. You'll help develop the internal tools, backend services, testing frameworks, and automation that support AI quality assurance across the platform. This is a hands-on software engineering role focused on building reusable systems rather than evaluating individual models in isolation. You'll work with APIs, databases, automated testing infrastructure, model integrations, and developer tools to make AI evaluation more efficient, consistent, and accessible. Your work may include evaluation execution services, test dataset management tools, automated regression pipelines, result comparison systems, and interfaces that help engineers investigate AI failures. You'll collaborate with applied AI engineers, machine learning engineers, AI evaluation specialists, and backend engineers to understand their testing needs and translate those requirements into dependable software capabilities. You'll also help integrate AI evaluation into normal engineering workflows. This includes making it easier to run tests during development, compare model or prompt changes, inspect failures, and identify regressions before production releases. Because Bask operates in healthcare-related environments, you'll help ensure evaluation systems handle sensitive information appropriately, respect access permissions, and support testing for privacy, safety, and approved operational boundaries. This position emphasizes strong software engineering fundamentals, developer experience, and production reliability. You'll contribute to technical architecture, write maintainable code, improve infrastructure performance, and own services that other engineering teams rely on. We're looking for an engineer who enjoys building tools for other developers, understands the challenges of testing nondeterministic AI systems, and wants to create reliable infrastructure that improves software quality across the organization. What You'll Do

Design, build, and maintain software infrastructure that supports AI quality and evaluation across Bask Health.
Develop backend services that execute and manage automated AI evaluations.
Build reusable testing tools for large language model applications.
Create APIs that allow engineering teams to submit evaluation jobs and retrieve results.
Develop systems for managing evaluation datasets, test cases, and expected outcomes.
Build automated workflows for comparing prompts, models, and application configurations.
Implement regression testing infrastructure for AI-powered features.
Integrate AI evaluation checks into continuous integration and deployment pipelines.
Develop services that record and organize evaluation results over time.
Build tools that help engineers inspect AI responses, failures, and test histories.
Implement structured result storage and comparison capabilities.
Develop internal dashboards or interfaces for reviewing evaluation outcomes.
Create reusable software libraries that simplify AI testing across multiple applications.
Build systems that support both deterministic checks and model-based evaluations.
Implement automated testing for tool-calling behavior and structured model outputs.
Develop infrastructure for evaluating retrieval-augmented generation applications.
Build asynchronous processing systems for large evaluation workloads.
Implement job scheduling, retries, timeouts, and error handling for evaluation services.
Develop monitoring and logging for evaluation infrastructure.
Optimize evaluation execution speed, reliability, and infrastructure costs.
Work with AI evaluation engineers to translate testing requirements into reusable software tools.
Collaborate with machine learning engineers to support model and prompt comparison workflows.
Implement appropriate access controls and secure handling of evaluation data.
Ensure evaluation infrastructure respects tenant boundaries and data privacy requirements.
Investigate infrastructure failures and resolve issues affecting evaluation reliability.
Improve developer documentation and internal tooling for AI testing.
Participate in code reviews, technical planning, and architecture discussions.
Own assigned AI quality engineering projects from design through deployment, monitoring, and continuous improvement.

Requirements

3+ years of professional software engineering experience, preferably in backend, platform, infrastructure, or developer tooling roles.
Experience building and maintaining production backend services.
Strong programming skills in TypeScript, JavaScript, Python, or comparable languages.
Experience designing and developing APIs and service integrations.
Familiarity with automated testing frameworks and software quality practices.
Understanding of continuous integration and deployment workflows.
Experience building reusable software components or internal engineering tools.
Familiarity with large language models and modern AI application development.
Understanding of the challenges involved in testing nondeterministic AI systems.
Experience working with relational databases and structured application data.
Familiarity with asynchronous processing and background job systems.
Understanding of distributed systems fundamentals and service reliability.
Experience developing automated testing pipelines.
Familiarity with cloud-based application deployment.
Understanding of authentication, authorization, and secure service communication.
Experience implementing logging, monitoring, and production diagnostics.
Ability to troubleshoot backend services and infrastructure issues.
Familiarity with configuration management and software release processes.
Experience writing maintainable, well-tested production code.
Understanding of API error handling, retries, and failure recovery.
Experience working with Git and collaborative engineering workflows.
Ability to translate technical requirements into reusable engineering systems.
Strong analytical thinking and problem-solving skills.
Ability to collaborate effectively with software engineers, AI engineers, and machine learning specialists.
Ability to independently own engineering projects from technical design through deployment.

Nice to Have

Experience building infrastructure for AI evaluation or machine learning testing.
Familiarity with OpenAI, Anthropic, or comparable model APIs.
Experience with LangSmith, DeepEval, Ragas, promptfoo, or comparable evaluation tools.
Familiarity with LLM-as-a-judge evaluation approaches.
Experience building evaluation execution services or automated benchmark systems.
Familiarity with AI regression testing and prompt comparison workflows.
Experience developing internal developer platforms or SDKs.
Experience building testing infrastructure for distributed applications.
Familiarity with TypeScript and Node.js backend development.
Experience with React or Next.js for internal tooling interfaces.
Familiarity with tRPC, Prisma, Drizzle, or comparable development tools.
Experience working with AWS Lambda, SQS, EventBridge, or related cloud services.
Familiarity with serverless infrastructure and infrastructure-as-code tools.
Experience with SST or comparable application deployment frameworks.
Experience building scalable asynchronous job processing systems.
Familiarity with embeddings, vector databases, and retrieval-augmented generation.
Experience implementing model observability or AI request tracing.
Understanding of multi-tenant SaaS architecture and data isolation.
Familiarity with HIPAA and healthcare data privacy considerations.
Experience using AI-assisted development tools such as Cursor or Claude Code.

Apply on apply.workable.com About employer

Report this job

Work requirements

Jobs in the United States