Jobs in the United States

25+ jobs

Group jobs by employerEmail me new jobs Save this search

Added 3 mins ago
Lead AI/ML Engineer
Kendra Scott
Austin, TX
Kendra Scott is seeking a Lead AI/ML Engineer to advance how we use artificial intelligence to improve business performance and reduce manual work.
Added 3 mins ago
AWS Senior DevOps Engineer
NTTD Ser Fed Govt, Inc.
Herndon (REMOTE)
NTT DATA is seeking an AWS Senior DevOps Engineer to support a large-scale modernization initiative focused on cloud automation, infrastructure-as-code, CI/CD pipeline engineering, secure…
Added 3 mins ago
Senior Windows Endpoint Engineer
NTT DATA Americas, Inc.
Plano
Must Reside in the US
Added 3 mins ago
Broadcast Engineer
News-Press & Gazette Company
Bend, OR
NPG of Oregon is seeking a full-time Broadcast Engineer that will be responsible for assisting the Chief Engineer in insuring proper technical operation of multiple broadcast television…
Added 3 mins ago
O
Core Infrastructure Engineer 2
Oracle
Nashville, TN
- $70,000 to $166,100 USD / year
We are looking for a Software Engineer 2 with strong programming fundamentals and an interest in backend and cloud-service development. You will contribute to existing services, write…
Added 4 mins ago
Enterprise Software Engineer
Wolters Kluwer DXG U.S., Inc.
Waltham, MA
Wolters Kluwer Health is seeking an Enterprise Software Engineer – Cloud Systems to help build, automate, monitor, and improve the cloud infrastructure and engineering platforms that…
Added 4 mins ago
Product Software Engineer
Wolters Kluwer DXG U.S., Inc.
Waltham, MA
Wolters Kluwer Health is seeking a Product Software Engineer to help design, build, test, automate, and improve software used by healthcare professionals and our internal engineering teams.
Added 4 mins ago
Manufacturing Engineer
Superior Essex
Hoisington, KS
ESSENTIAL PURPOSE OF THIS POSITION: Under the general supervision and guidance of the Engineering Manager or senior engineer to whom assigned, perform a variety of functions in the…
Added 4 mins ago
P
ECU Test Engineer
PACCAR
Mount Vernon, WA
- $90,400 to $141,800 USD / year
The ECU Test Engineer will be responsible for Hardware in the Loop (HiL) testing of ECUs with PACCAR Electronics developed software. The successful candidate will coordinate with the…
Added 4 mins ago
Engineer Manufacturing/Principal Manufacturing Engineer -1st shift
CORP-Corporate Office
United States
Must have fluency in MS Office software applications
Added 6 mins ago
AF
Senior Software Engineer
Atomic Fi
Remote, United States
- $150,000 to $180,000 USD / year
We're looking for a Senior Software Engineer to to join our team. You'll be building innovative solutions using a variety of technologies including Node.js, TypeScript, Vue, Temporal,…
Added 8 mins ago
Thermal Engineer (Senior or Staff)
True Anomaly
Denver, CO · Long Beach, CA
Work with a product focused team including mechanical, electrical, software, and automation engineers to rapidly develop revolutionary thermal designs
Added 8 mins ago
O
Federal Oracle Health Automation Engineer - Eggplant
Oracle
Dover, DE
- $23.8 to $56.83 USD / hour
The Federal Test Automation team is seeking a Staff Automation Engineer to support the Federal VA project. This role is responsible for designing, developing, and executing automated…
Added 8 mins ago
Senior Front-End and Agentic-UI Engineer
Evolent
Dover, DE
The Senior Software Engineer leads the design, development, and deployment of complex features in the web user experience for the Evolent Platform. This role builds high-performance React…
Added 8 mins ago
Sr. Staff Applied AI Engineer
Qualified Health PBC
Palo Alto, CA
We’re hiring a Sr. Staff Applied AI Engineer to set the technical direction for how Qualified Health builds agentic AI systems across multiple product lines. You’ll define shared…
Added 8 mins ago
Core Senior .NET Software Engineer
Evolent
Dover, DE
The Senior Software Engineer leads the design, development, and deployment of complex software solutions, ensuring scalability and maintainability. This role architects and implements…
Added 8 mins ago
Senior AI Engineer
Qnity
Wilmington, DE
Qnity is accepting applications for a full-time Senior AI Engineer position at one of Qnity’s main campuses in Wilmington, Delaware. This is an exciting opportunity for an experienced…
Added 8 mins ago
Senior AI Engineer
Qnity
Wilmington, DE
The Senior AI Engineer will also plan delivery, lead technical work, communicate with business stakeholders, integrate with data engineering and software teams, deploy production solutions,…
Added 8 mins ago
EG
Automated Test Engineer
Eliassen Group
Dover, DE
- $40 to $50 USD / hour
Our client seeks an Automated Test Engineer to support Hivemind by monitoring and maintaining large volumes of automated tests, troubleshooting failures, and driving bug resolution across…
Added 10 mins ago
Domain Consultant, Southwest
Palo Alto Networks, Inc.
Remote, United States
Experience: 5+ years of experience as a Sales Engineer, Systems Engineer, Solution Architect, or Technical Consultant in enterprise cybersecurity software.
Added 10 mins ago
Mechanical Engineer IV, Robotics
Applied Materials
Santa Clara, CA · Santa Clara
Support automation systems engineering projects that have a substantial mix of electrical, mechanical, and software design, and understand the underlying system implications.
Added 10 mins ago
B
IT Support Engineer - NJ/NY
BETSOL
New York, NY
- $70,000 to $80,000 USD / year
Must have experience providing onsite support at customer locations · Must have current enterprise (mid to large size organizations) experience in IT support or experience working with an MSP provider
Added 10 mins ago
A
Field Service Engineer
Actalent
Racine, WI
- $30 to $55 USD / hour
Load and configure building automation software, including setting up trends, alarms, and reports to support system monitoring and performance analysis.
Added 12 mins ago
X
Senior Site Reliability Engineer
Xplor
Remote, United States
- $150,000 to $180,000 USD / year
Xplor Technologies powers the experiences at the heart of everyday life. Through modern vertical software, embedded payments, and AI-powered capabilities, we help businesses in fitness,…
Added 12 mins ago
Senior Software Engineer
E-Infosol LLC
Washington, DC
E-INFOSOL LLC is seeking a motivated and results-driven Senior Software Engineer to be a full-time employee in Quantico, VA to join our innovative and customer solutions focused team.

Bask Health

Software Engineer, AI Quality & Evaluation

Remote, United States

Apply on apply.workable.com About employer

Applications open in a new tab.

Job details

Experience: 3+ years of professional software engineering experience, preferably in backend, platform, infrastructure, or developer tooling roles.
Posting language: English
Posted: Nov 12, 2026

Original job description

About Bask Health Bask Health is a software platform that enables entrepreneurs, doctors, and healthcare businesses to launch, manage, and grow direct-to-consumer telehealth businesses. Our platform brings together patient experiences, clinical workflows, pharmacy operations, and commerce tools in one place. We're an entrepreneurial, product-focused engineering team that values ownership, technical excellence, and building software that solves real problems. Engineers work closely with product teams and company leadership, take features from idea to production, and have a direct role in shaping the platform. Engineering at Bask is AI-first and builder-led. We use tools like Cursor and Claude Code throughout development while maintaining high standards for reliability, testing, and software quality. About the Role We're looking for a Software Engineer, AI Quality & Evaluation to build the engineering systems that help Bask Health test, evaluate, and improve AI-powered applications throughout their development and production lifecycles. Bask Health supports direct-to-consumer telehealth businesses through a platform that connects patient experiences, merchant operations, clinical workflows, pharmacy coordination, and commerce tools. As we introduce more AI-powered capabilities across these areas, we need reliable software infrastructure that makes it easy for engineering teams to understand how those systems behave. You'll help develop the internal tools, backend services, testing frameworks, and automation that support AI quality assurance across the platform. This is a hands-on software engineering role focused on building reusable systems rather than evaluating individual models in isolation. You'll work with APIs, databases, automated testing infrastructure, model integrations, and developer tools to make AI evaluation more efficient, consistent, and accessible. Your work may include evaluation execution services, test dataset management tools, automated regression pipelines, result comparison systems, and interfaces that help engineers investigate AI failures. You'll collaborate with applied AI engineers, machine learning engineers, AI evaluation specialists, and backend engineers to understand their testing needs and translate those requirements into dependable software capabilities. You'll also help integrate AI evaluation into normal engineering workflows. This includes making it easier to run tests during development, compare model or prompt changes, inspect failures, and identify regressions before production releases. Because Bask operates in healthcare-related environments, you'll help ensure evaluation systems handle sensitive information appropriately, respect access permissions, and support testing for privacy, safety, and approved operational boundaries. This position emphasizes strong software engineering fundamentals, developer experience, and production reliability. You'll contribute to technical architecture, write maintainable code, improve infrastructure performance, and own services that other engineering teams rely on. We're looking for an engineer who enjoys building tools for other developers, understands the challenges of testing nondeterministic AI systems, and wants to create reliable infrastructure that improves software quality across the organization. What You'll Do

Design, build, and maintain software infrastructure that supports AI quality and evaluation across Bask Health.
Develop backend services that execute and manage automated AI evaluations.
Build reusable testing tools for large language model applications.
Create APIs that allow engineering teams to submit evaluation jobs and retrieve results.
Develop systems for managing evaluation datasets, test cases, and expected outcomes.
Build automated workflows for comparing prompts, models, and application configurations.
Implement regression testing infrastructure for AI-powered features.
Integrate AI evaluation checks into continuous integration and deployment pipelines.
Develop services that record and organize evaluation results over time.
Build tools that help engineers inspect AI responses, failures, and test histories.
Implement structured result storage and comparison capabilities.
Develop internal dashboards or interfaces for reviewing evaluation outcomes.
Create reusable software libraries that simplify AI testing across multiple applications.
Build systems that support both deterministic checks and model-based evaluations.
Implement automated testing for tool-calling behavior and structured model outputs.
Develop infrastructure for evaluating retrieval-augmented generation applications.
Build asynchronous processing systems for large evaluation workloads.
Implement job scheduling, retries, timeouts, and error handling for evaluation services.
Develop monitoring and logging for evaluation infrastructure.
Optimize evaluation execution speed, reliability, and infrastructure costs.
Work with AI evaluation engineers to translate testing requirements into reusable software tools.
Collaborate with machine learning engineers to support model and prompt comparison workflows.
Implement appropriate access controls and secure handling of evaluation data.
Ensure evaluation infrastructure respects tenant boundaries and data privacy requirements.
Investigate infrastructure failures and resolve issues affecting evaluation reliability.
Improve developer documentation and internal tooling for AI testing.
Participate in code reviews, technical planning, and architecture discussions.
Own assigned AI quality engineering projects from design through deployment, monitoring, and continuous improvement.

Requirements

3+ years of professional software engineering experience, preferably in backend, platform, infrastructure, or developer tooling roles.
Experience building and maintaining production backend services.
Strong programming skills in TypeScript, JavaScript, Python, or comparable languages.
Experience designing and developing APIs and service integrations.
Familiarity with automated testing frameworks and software quality practices.
Understanding of continuous integration and deployment workflows.
Experience building reusable software components or internal engineering tools.
Familiarity with large language models and modern AI application development.
Understanding of the challenges involved in testing nondeterministic AI systems.
Experience working with relational databases and structured application data.
Familiarity with asynchronous processing and background job systems.
Understanding of distributed systems fundamentals and service reliability.
Experience developing automated testing pipelines.
Familiarity with cloud-based application deployment.
Understanding of authentication, authorization, and secure service communication.
Experience implementing logging, monitoring, and production diagnostics.
Ability to troubleshoot backend services and infrastructure issues.
Familiarity with configuration management and software release processes.
Experience writing maintainable, well-tested production code.
Understanding of API error handling, retries, and failure recovery.
Experience working with Git and collaborative engineering workflows.
Ability to translate technical requirements into reusable engineering systems.
Strong analytical thinking and problem-solving skills.
Ability to collaborate effectively with software engineers, AI engineers, and machine learning specialists.
Ability to independently own engineering projects from technical design through deployment.

Nice to Have

Experience building infrastructure for AI evaluation or machine learning testing.
Familiarity with OpenAI, Anthropic, or comparable model APIs.
Experience with LangSmith, DeepEval, Ragas, promptfoo, or comparable evaluation tools.
Familiarity with LLM-as-a-judge evaluation approaches.
Experience building evaluation execution services or automated benchmark systems.
Familiarity with AI regression testing and prompt comparison workflows.
Experience developing internal developer platforms or SDKs.
Experience building testing infrastructure for distributed applications.
Familiarity with TypeScript and Node.js backend development.
Experience with React or Next.js for internal tooling interfaces.
Familiarity with tRPC, Prisma, Drizzle, or comparable development tools.
Experience working with AWS Lambda, SQS, EventBridge, or related cloud services.
Familiarity with serverless infrastructure and infrastructure-as-code tools.
Experience with SST or comparable application deployment frameworks.
Experience building scalable asynchronous job processing systems.
Familiarity with embeddings, vector databases, and retrieval-augmented generation.
Experience implementing model observability or AI request tracing.
Understanding of multi-tenant SaaS architecture and data isolation.
Familiarity with HIPAA and healthcare data privacy considerations.
Experience using AI-assisted development tools such as Cursor or Claude Code.

Apply on apply.workable.com About employer

Report this job

Work requirements

Jobs in the United States