Jobs in the United States

25+ jobs

Group jobs by employerEmail me new jobs Save this search

Added 3 mins ago
IG
RCDD Project Engineer
Insight Global
Brownsville, TX
- From $54 USD / hour
A client of Insight Global is seeking a highly technical, road-warrior RCDD Project Engineer to serve as the primary on-site technical authority during the execution phase of large-scale…
Added 3 mins ago
AI Finops Development Engineer
Charles Schwab
Southlake, TX
As an AI FinOps Development Engineer within Schwab Technology Services, you’ll help shape how AI is adopted and scaled across the enterprise by building capabilities that connect AI…
Added 3 mins ago
Assistant Electrical Engineer, Power (Kansas City)
Burns & McDonnell
Kansas City, MO
The Assistant Electrical Engineer will assist project teams to create world class designs for new projects, alterations and redevelopments on a variety of projects including power, process,…
Added 4 mins ago
E093 Construction Inspector I or II
TEXAS DEPARTMENT OF TRANSPORTATION
Sterling City, TX
…improvement projects. Responsible to a licensed professional engineer who has full authority for approval of all work. Work requires contact with contractors. May perform materials tests…
Added 4 mins ago
Operations Performance Engineer
Dow
Deer Park, TX
Must have obtained a bachelor's degree in engineering by May 2027
Added 4 mins ago
E093 Construction Inspector I-III (Dumas AE)
TEXAS DEPARTMENT OF TRANSPORTATION
Dumas, TX
…projects. May train others. Responsible to a licensed professional engineer who has full authority for approval of all work. Work requires contact with contractors. May perform materials…
Added 4 mins ago
E093 Construction Inspector I or II - Graham Area Office
TEXAS DEPARTMENT OF TRANSPORTATION
GRAHAM, TX
…improvement projects. Responsible to a licensed professional engineer who has full authority for approval of all work. Work requires contact with contractors. May perform materials tests…
Added 4 mins ago
Manufacturing Engineer
Chart Industries
Beasley, TX
Chart, Inc is looking for a Manufacturing Engineer to join our Manufacturing Engineering Department. The role will support the manufacturing process of Chart's Air-Cooled Heat Exchanger and…
Added 4 mins ago
Data Center Specialist (Chief Engineer)
CBRE
Burlington, TX
We do not use artificial intelligence (AI) tools to makehiring decisions, and we ask that candidates disclose any use of AI in theapplication and interview process.
Added 4 mins ago
Major Projects Electrical Engineer
Marathon Petroleum Corporation
Texas City, TX
The Electrical Engineer will be responsible for supporting Midcap and Major projects from early conceptual engineering through detailed design, construction, and project completion.
Added 4 mins ago
Sr. Project Engineer
Smurfit Westrock
Evadale, TX
Reporting to the Sr Manager, Project Engineering, the Sr Engineer, Project Engineering manages and completes numerous projects that span multiple engineering disciplines. This position…
Added 4 mins ago
E093 Construction Inspector I or II - Weatherford
TEXAS DEPARTMENT OF TRANSPORTATION
Weatherford, TX
…improvement projects. Responsible to a licensed professional engineer who has full authority for approval of all work. Work requires contact with contractors. May perform materials tests…
Added 5 mins ago
Process Engineer
Delek US Holdings
Tyler, TX
No Licensure or Certification Required
Added 5 mins ago
Principal Software Engineer (Platform Team)
SpaceX
Bastrop, TX · Starbase, TX
As a Principal Software Engineer for SpaceX's AI platform , you will set the technical vision and serve as a senior leader and entrepreneurial force for the leanest and most effective…
Added 5 mins ago
Software Engineer (Platform Team)
SpaceX
Starbase, TX · Bastrop, TX
As a Software Engineer for SpaceX's AI platform, you will act as an entrepreneurial builder focused on the leanest and most effective applied use of AI at SpaceX. You will design platforms…
Added 5 mins ago
Principal Site Reliability Engineer (Vehicle Engineering)
SpaceX
Bastrop, TX
…satellites. This role exists to put a real Site Reliability Engineer operating model on these capabilities and accelerating the world class engineering at SpaceX: toil reduction,…
Added 5 mins ago
Systems Development Engineer 2
Dell Technologies
Round Rock, TX
…speed and scale. AI is embedded throughout our development process, helping us move faster, learn quicker, and deliver greater impact. Yet the most important contribution remains uniquely…
Added 5 mins ago
Associate Manager, Systems Integration
Lockheed Martin
Grand Prairie, TX
We're looking for a seasoned and collaborative Integration, Test, and Evaluation Engineer Lead to join our team. As an ideal candidate, you have a strong background in system integration…
Added 5 mins ago
College Student - Quality Engineer Intern - Dallas Texas
Lockheed Martin
Grand Prairie, TX
Contribute to the preparation and execution of quality hardware production including documentation, test reports, inspection records, and process flow.
Added 5 mins ago
Manufacturing Robotics Engineer Stf
Lockheed Martin
Grand Prairie, TX
Advanced Manufacturing Technology is looking for a highly motivated Manufacturing Robotics Engineer Staff to help transform Lockheed Martin MFC’s manufacturing and development processes…
Added 5 mins ago
Manufacturing Robotics Engineer - E2
Lockheed Martin
Grand Prairie, TX
Advanced Manufacturing Technology is looking for a highly motivated Manufacturing Robotics Engineer to help improve Lockheed Martin MFC’s manufacturing and development processes through…
Added 5 mins ago
Software Development Engineer – Agentic AI
Trellix
Frisco, TX
…products. We're looking for a highly skilled Software Development Engineer with a passion for building robust, scalable, and secure AI solutions that operate at real-world…
Added 5 mins ago
Manager Systems Engineering
L3Harris
Richardson, TX
…role and systems engineering leader. In the role of systems engineer, the applicant interacts with other systems engineers, and collaborates with our mechanical, electrical, and software…
Added 5 mins ago
AI Processor Hardware/Software Integration Engineer (2027 New College Graduate)
Global Foundries
Richardson, TX
Must have at least an overall 3.0 GPA and proven good academic standing
Added 5 mins ago
AI Processor Hardware/Software Integration Engineer Intern (Summer 2027)
Global Foundries
Richardson, TX
Must have at least an overall 3.0 GPA and be in good academic standing

Bask Health

Machine Learning Engineer, Evaluation & Reliability

Remote, United States

Apply on jobs.workable.com About employer

Applications open in a new tab.

Job details

Experience: 3+ years of professional experience in machine learning engineering, software engineering, applied AI, or a closely related technical field.
Posting language: English
Posted: Nov 12, 2026

Original job description

About Bask Health Bask Health is a software platform that enables entrepreneurs, doctors, and healthcare businesses to launch, manage, and grow direct-to-consumer telehealth businesses. Our platform brings together patient experiences, clinical workflows, pharmacy operations, and commerce tools in one place. We're an entrepreneurial, product-focused engineering team that values ownership, technical excellence, and building software that solves real problems. Engineers work closely with product teams and company leadership, take features from idea to production, and have a direct role in shaping the platform. Engineering at Bask is AI-first and builder-led. We use tools like Cursor and Claude Code throughout development while maintaining high standards for reliability, testing, and software quality. About the Role We're looking for a Machine Learning Engineer, Evaluation & Reliability to help ensure that AI-powered features across Bask Health are accurate, dependable, and ready for real-world use. Bask Health uses software to connect patient experiences, merchant operations, clinical workflows, pharmacy coordination, and commerce capabilities. As AI becomes more integrated into these systems, we need reliable ways to measure model performance, identify failures, and verify that changes improve the user experience without introducing new risks. You'll help develop the evaluation infrastructure, testing workflows, and performance measurements used to assess large language models, retrieval systems, AI assistants, and automated workflows. This is a hands-on engineering role that combines machine learning evaluation, software development, data analysis, and production quality assurance. You'll work with model outputs, evaluation datasets, automated testing tools, and application telemetry to understand how AI systems perform under realistic conditions. Your work may include creating evaluation datasets, implementing automated benchmarks, measuring response quality, testing retrieval accuracy, analyzing model failures, and monitoring production behavior. You'll collaborate with applied AI engineers, machine learning engineers, backend engineers, product managers, and other stakeholders to define what successful AI behavior looks like for different workflows. You'll help translate those expectations into measurable tests and actionable engineering improvements. Because Bask operates in healthcare-related environments, AI evaluation must account for accuracy, privacy, appropriate permissions, and the consequences of unreliable responses. You'll help identify situations where AI systems produce unsupported information, expose restricted data, attempt unauthorized actions, or operate outside approved clinical and operational boundaries. This position emphasizes practical implementation and continuous improvement. You'll contribute to evaluation methodologies and engineering standards while working with senior engineers on broader reliability strategies and more complex technical decisions. We're looking for an engineer who enjoys investigating how AI systems behave, can turn ambiguous quality problems into measurable tests, and understands that reliable AI products require ongoing evaluation - not just successful demonstrations. What You'll Do

Build and maintain evaluation systems for AI-powered applications across Bask Health.
Develop automated testing frameworks for large language models and AI application workflows.
Create and maintain representative datasets for evaluating model behavior.
Implement benchmarks that measure response accuracy, relevance, completeness, and consistency.
Develop evaluation pipelines for prompts, retrieval systems, and model configurations.
Test AI assistants and agents against realistic user scenarios and workflow requirements.
Build automated regression tests to detect performance changes between releases.
Measure hallucination rates, unsupported claims, and other model quality failures.
Evaluate retrieval-augmented generation systems for document relevance and answer grounding.
Develop tests for structured model outputs and schema compliance.
Evaluate tool-calling accuracy and agent action selection.
Test AI workflows for unauthorized actions, incorrect permissions, and unsafe behavior.
Implement evaluation checks for sensitive patient and operational information.
Build dashboards and reports that communicate AI quality metrics to engineering teams.
Analyze evaluation results and identify recurring failure patterns.
Investigate production incidents involving inaccurate or unreliable AI outputs.
Collaborate with applied AI engineers to improve prompts, retrieval logic, and application behavior.
Support model comparisons and controlled experiments.
Evaluate tradeoffs between model quality, latency, reliability, and inference cost.
Develop automated quality checks for CI/CD and AI feature release workflows.
Implement monitoring and alerting for production AI performance.
Build tools for reviewing, labeling, and analyzing model responses.
Help maintain evaluation datasets as products and user behavior evolve.
Document evaluation methodologies, test cases, and known model limitations.
Work with product teams to define measurable acceptance criteria for AI features.
Collaborate with senior engineers on evaluation standards and reliability improvements.
Participate in code reviews, technical discussions, and engineering planning.
Own assigned evaluation and reliability projects from implementation through deployment and ongoing improvement.
3+ years of professional experience in machine learning engineering, software engineering, applied AI, or a closely related technical field.
Experience building and maintaining production software or machine learning applications.
Strong programming skills in Python, TypeScript, or comparable languages.
Familiarity with large language models and modern generative AI applications.
Experience testing or evaluating machine learning models or AI-powered software.
Understanding of machine learning evaluation metrics and experimental methodologies.
Experience developing automated tests and validation pipelines.
Familiarity with prompt engineering and model output analysis.
Ability to analyze structured and unstructured datasets.
Experience writing scripts or services for data processing and evaluation.
Understanding of model accuracy, precision, recall, and other performance measures where applicable.
Familiarity with API integrations and backend application development.
Experience working with relational databases or analytical data systems.
Ability to identify patterns in model failures and translate findings into engineering improvements.
Understanding of regression testing and software quality assurance.
Familiarity with logging, monitoring, and production troubleshooting.
Experience using Git and collaborative software development workflows.
Understanding of the limitations and failure modes of large language models.
Ability to design representative test cases and evaluation scenarios.
Familiarity with cloud-based development and deployment environments.
Experience writing maintainable, well-tested production code.
Strong analytical thinking and attention to detail.
Ability to communicate technical evaluation results clearly.
Experience collaborating with engineers, product managers, and cross-functional teams.
Ability to independently own assigned technical projects.

Nice to Have

Experience building evaluation frameworks for large language models.
Familiarity with OpenAI, Anthropic, or comparable model APIs.
Experience with tools such as LangSmith, DeepEval, Ragas, or comparable AI evaluation frameworks.
Familiarity with LLM-as-a-judge evaluation techniques.
Experience creating human-labeled evaluation datasets.
Understanding of inter-rater agreement and evaluation consistency.
Experience evaluating retrieval-augmented generation systems.
Familiarity with embeddings, semantic search, and vector databases.
Experience evaluating AI agents and tool-calling workflows.
Familiarity with prompt injection testing and AI security evaluations.
Experience implementing automated regression testing for AI applications.
Familiarity with experiment tracking and model comparison tools.
Experience building dashboards for machine learning performance monitoring.
Understanding of statistical analysis and experiment design.
Experience working with Python data analysis libraries.
Familiarity with TypeScript and Node.js application development.
Experience working with AWS or serverless infrastructure.
Experience evaluating AI systems used in healthcare or other sensitive environments.
Understanding of HIPAA and healthcare data privacy considerations.
Experience using AI-assisted development tools such as Cursor or Claude Code.

Apply on jobs.workable.com About employer

More about this job

Skills

Machine learning
Process improvement
Workflow
Regulatory compliance
Statistical quality control
CI/CD
Industrial software
Python
TypeScript
Process data
Quality assurance
Troubleshooting
Git
Software development
Analytical skills
Attention to detail
Statistics
Data analysis
Node.js
AWS

Report this job

Work requirements

Jobs in the United States