Jobs in the United States

25+ jobs

Group jobs by employerEmail me new jobs Save this search

Added just now
Domain Consultant, Southwest
Palo Alto Networks, Inc.
Remote, United States
…are looking for a high-performing Solution Architect / Sales Engineer to join our team of global…
Added just now
Software Engineer- Experiences
Vurvey Labs, Inc.
New York, NY · Cincinnati, OH
…through AI-powered insights and storytelling. As a Software Engineer on our Experiences team, you will help design and build custom AI agent applications that bring Vurvey to life at major…
Added just now
Mechanical Engineer IV, Robotics
Applied Materials
Santa Clara, CA · Santa Clara
As a Mechanical Engineer, you’ll leverage your strong foundation in physics, mathematics, and materials science to process and resolve mechanical problems, design and implement custom…
Added just now
B
IT Support Engineer - NJ/NY
BETSOL
New York, NY
- $70,000 to $80,000 USD / year
Must have experience providing onsite support at customer locations · Must have current enterprise (mid to large size organizations) experience in IT support or experience working with an MSP provider
Added just now
VC
Associate Director - Sales Engineer
Verizon Corp Rsrcs Group LLC
Annapolis Junction, MD · NY · Blue Bell, PA · Basking Ridge, NJ
- $159,500 to $278,000 USD / year
Interfacing directly with client personnel at all levels as required to provide consistent, high quality technical support and to develop sales/service opportunities.
Added 1 min ago
A
Mechatronics Engineer
Actalent
Oakland, NJ
- $48.08 to $55.29 USD / hour
Job Title: Mechatronics EngineerJob DescriptionAs a Mechatronics Engineer, you will lead the design and assembly of custom machinery and packaging equipment using SolidWorks. You will…
Added 1 min ago
A
Mechanical Engineer
Actalent
Grand Rapids, MI
- $40.87 to $57.69 USD / hour
Job DescriptionThis MEP Mechanical Engineer role focuses on leading mechanical design projects within a consulting engineering environment, coordinating closely with project managers and…
Added 1 min ago
A
Field Service Engineer
Actalent
Racine, WI
- $30 to $55 USD / hour
…HVAC, energy monitoring, demand response, lighting, indoor air quality, humidity, temperature, and elevator…
Added 1 min ago
T
Sr. Enterprise Systems Engineer
TEKsystems
Mason, MI
- $57 to $70 USD / hour
Collaborate with team members and other technical teams to ensure high quality technology implementations are done in accordance with the design and defined technical standards
Added 1 min ago
Senior Staff Engineer - AI Cloud Platform
Exelixis Inc
Alameda, CA
The Senior Staff Engineer – Cloud Platform will support the design and creation of cloud-based products and services to meet the technology needs of Exelixis. This position will help define…
Added 2 mins ago
Supervisor - Maintenance Department - 2nd shift
Clopay
Troy, OH
Responsible for the quality of repairs, methods applications, scheduling of work, determination of malfunctions, and extent and nature of repairs, and type of materials or parts needed.
Added 2 mins ago
X
Senior Site Reliability Engineer
Xplor
Remote, United States
- $150,000 to $180,000 USD / year
We're looking for a hands-on Site Reliability Engineer to own how our agent platform behaves in production. AI workloads bring new reliability problems: long streaming responses, background…
Added 3 mins ago
Data Engineer III
Preferred Travel Group
United States
We are seeking a highly organized, proactive, and technically skilled Data Engineer III to design, build, and optimize scalable data solutions that power business operations across…
Added 4 mins ago
Director of Engineering
MANSON WESTERN LLC
Torrance, CA
Build an AI software factory: shared workflows, tools, and agent instructions that every engineer uses across planning, development, testing, and delivery.
Added 5 mins ago
Senior Staff Design Verification Engineer
MSI - (Marvell Semiconductor Inc.) US
Santa Clara, CA
- Mindset for high quality and attention to detail
Added 5 mins ago
Field Engineer
Megaport
United States
We are looking for a Field Engineer to act directly on this physical infrastructure. This is a hands-on role: you will deploy, maintain, troubleshoot and repair GPU servers and their…
Added 6 mins ago
Specialist
Hino Motors MFG USA Inc
Mineral Wells, WV
We are currently seeking an onsite mid-level Controls Engineer for our truck assembly plant located in Mineral Wells, WV. This position will report directly to a member of our SLT (site…
Added 6 mins ago
R
Traffic & Signals Civil Engineer Intern
RailPros
Irvine, CA
- $20 to $25 USD / hour
Our mission is to enhance mobility, safety, and quality of life for residents, passengers, and partner companies. We do more than just provide services; we are constantly innovating and…
Added 6 mins ago
CE
Stationary Engineer II
Constellation Energy Generation, LLC.
Nashville, TN
- $30.72 to $34.13 USD / hour
Must be able to work 12-hour shifts, including nights, weekends, and forced overtime
Added 6 mins ago
Product Sustainability Engineer
Werfen
Norcross, GA
…commitment to customers, and our dedication to innovation and quality. We’re passionate about providing healthcare professionals the most valuable and complete solutions to improve hospital…
Added 7 mins ago
WA
ML Infrastructure and Performance Engineer, AI Expert (Remote)
Weekday AI
Remote, United States
- $90 to $120 USD / hour
We are seeking an experienced ML Infrastructure and Performance Engineer to contribute to the development and advancement of next-generation Generative AI systems. This role is focused on…
Added 8 mins ago
Civil Engineer - Senior Technical
BL COMPANIES INC
Charlotte, NC
Our growth offers an exciting opportunity for a Senior Technical Engineer to oversee land development projects from start to finish. This role requires direct project execution, and ensure…
Added 8 mins ago
Civil Engineer - Senior Project Manager
BL COMPANIES INC
Charlotte, NC
PE License required
Added 8 mins ago
Utility Project Engineer
Quality Technology Services, LLC
United States
The Utility Development Project Engineer will support the overall planning and execution of QTS utility infrastructure. This role will support the delivery of utility capacity at each…
Added 8 mins ago
Senior Software Quality Engineer
Delta Dental
San Francisco, CA · Rancho Cordova, CA
The Senior Quality Engineer will work alongside both business and technical team members to ensure the usability and functionality of products, services and systems. This role will…

Bask Health

Machine Learning Engineer, Evaluation & Reliability

Remote, United States

Apply on apply.workable.com About employer

Applications open in a new tab.

Job details

Experience: 3+ years of professional experience in machine learning engineering, software engineering, applied AI, or a closely related technical field.
Posting language: English
Posted: Nov 12, 2026

Original job description

About Bask Health Bask Health is a software platform that enables entrepreneurs, doctors, and healthcare businesses to launch, manage, and grow direct-to-consumer telehealth businesses. Our platform brings together patient experiences, clinical workflows, pharmacy operations, and commerce tools in one place. We're an entrepreneurial, product-focused engineering team that values ownership, technical excellence, and building software that solves real problems. Engineers work closely with product teams and company leadership, take features from idea to production, and have a direct role in shaping the platform. Engineering at Bask is AI-first and builder-led. We use tools like Cursor and Claude Code throughout development while maintaining high standards for reliability, testing, and software quality. About the Role We're looking for a Machine Learning Engineer, Evaluation & Reliability to help ensure that AI-powered features across Bask Health are accurate, dependable, and ready for real-world use. Bask Health uses software to connect patient experiences, merchant operations, clinical workflows, pharmacy coordination, and commerce capabilities. As AI becomes more integrated into these systems, we need reliable ways to measure model performance, identify failures, and verify that changes improve the user experience without introducing new risks. You'll help develop the evaluation infrastructure, testing workflows, and performance measurements used to assess large language models, retrieval systems, AI assistants, and automated workflows. This is a hands-on engineering role that combines machine learning evaluation, software development, data analysis, and production quality assurance. You'll work with model outputs, evaluation datasets, automated testing tools, and application telemetry to understand how AI systems perform under realistic conditions. Your work may include creating evaluation datasets, implementing automated benchmarks, measuring response quality, testing retrieval accuracy, analyzing model failures, and monitoring production behavior. You'll collaborate with applied AI engineers, machine learning engineers, backend engineers, product managers, and other stakeholders to define what successful AI behavior looks like for different workflows. You'll help translate those expectations into measurable tests and actionable engineering improvements. Because Bask operates in healthcare-related environments, AI evaluation must account for accuracy, privacy, appropriate permissions, and the consequences of unreliable responses. You'll help identify situations where AI systems produce unsupported information, expose restricted data, attempt unauthorized actions, or operate outside approved clinical and operational boundaries. This position emphasizes practical implementation and continuous improvement. You'll contribute to evaluation methodologies and engineering standards while working with senior engineers on broader reliability strategies and more complex technical decisions. We're looking for an engineer who enjoys investigating how AI systems behave, can turn ambiguous quality problems into measurable tests, and understands that reliable AI products require ongoing evaluation - not just successful demonstrations. What You'll Do

Build and maintain evaluation systems for AI-powered applications across Bask Health.
Develop automated testing frameworks for large language models and AI application workflows.
Create and maintain representative datasets for evaluating model behavior.
Implement benchmarks that measure response accuracy, relevance, completeness, and consistency.
Develop evaluation pipelines for prompts, retrieval systems, and model configurations.
Test AI assistants and agents against realistic user scenarios and workflow requirements.
Build automated regression tests to detect performance changes between releases.
Measure hallucination rates, unsupported claims, and other model quality failures.
Evaluate retrieval-augmented generation systems for document relevance and answer grounding.
Develop tests for structured model outputs and schema compliance.
Evaluate tool-calling accuracy and agent action selection.
Test AI workflows for unauthorized actions, incorrect permissions, and unsafe behavior.
Implement evaluation checks for sensitive patient and operational information.
Build dashboards and reports that communicate AI quality metrics to engineering teams.
Analyze evaluation results and identify recurring failure patterns.
Investigate production incidents involving inaccurate or unreliable AI outputs.
Collaborate with applied AI engineers to improve prompts, retrieval logic, and application behavior.
Support model comparisons and controlled experiments.
Evaluate tradeoffs between model quality, latency, reliability, and inference cost.
Develop automated quality checks for CI/CD and AI feature release workflows.
Implement monitoring and alerting for production AI performance.
Build tools for reviewing, labeling, and analyzing model responses.
Help maintain evaluation datasets as products and user behavior evolve.
Document evaluation methodologies, test cases, and known model limitations.
Work with product teams to define measurable acceptance criteria for AI features.
Collaborate with senior engineers on evaluation standards and reliability improvements.
Participate in code reviews, technical discussions, and engineering planning.
Own assigned evaluation and reliability projects from implementation through deployment and ongoing improvement.

Requirements

3+ years of professional experience in machine learning engineering, software engineering, applied AI, or a closely related technical field.
Experience building and maintaining production software or machine learning applications.
Strong programming skills in Python, TypeScript, or comparable languages.
Familiarity with large language models and modern generative AI applications.
Experience testing or evaluating machine learning models or AI-powered software.
Understanding of machine learning evaluation metrics and experimental methodologies.
Experience developing automated tests and validation pipelines.
Familiarity with prompt engineering and model output analysis.
Ability to analyze structured and unstructured datasets.
Experience writing scripts or services for data processing and evaluation.
Understanding of model accuracy, precision, recall, and other performance measures where applicable.
Familiarity with API integrations and backend application development.
Experience working with relational databases or analytical data systems.
Ability to identify patterns in model failures and translate findings into engineering improvements.
Understanding of regression testing and software quality assurance.
Familiarity with logging, monitoring, and production troubleshooting.
Experience using Git and collaborative software development workflows.
Understanding of the limitations and failure modes of large language models.
Ability to design representative test cases and evaluation scenarios.
Familiarity with cloud-based development and deployment environments.
Experience writing maintainable, well-tested production code.
Strong analytical thinking and attention to detail.
Ability to communicate technical evaluation results clearly.
Experience collaborating with engineers, product managers, and cross-functional teams.
Ability to independently own assigned technical projects.

Nice to Have

Experience building evaluation frameworks for large language models.
Familiarity with OpenAI, Anthropic, or comparable model APIs.
Experience with tools such as LangSmith, DeepEval, Ragas, or comparable AI evaluation frameworks.
Familiarity with LLM-as-a-judge evaluation techniques.
Experience creating human-labeled evaluation datasets.
Understanding of inter-rater agreement and evaluation consistency.
Experience evaluating retrieval-augmented generation systems.
Familiarity with embeddings, semantic search, and vector databases.
Experience evaluating AI agents and tool-calling workflows.
Familiarity with prompt injection testing and AI security evaluations.
Experience implementing automated regression testing for AI applications.
Familiarity with experiment tracking and model comparison tools.
Experience building dashboards for machine learning performance monitoring.
Understanding of statistical analysis and experiment design.
Experience working with Python data analysis libraries.
Familiarity with TypeScript and Node.js application development.
Experience working with AWS or serverless infrastructure.
Experience evaluating AI systems used in healthcare or other sensitive environments.
Understanding of HIPAA and healthcare data privacy considerations.
Experience using AI-assisted development tools such as Cursor or Claude Code.

Apply on apply.workable.com About employer

Report this job

Work requirements

Jobs in the United States