Find work in the United States.

6,407,318 jobs across our US network. How we count

Jobs in the United States

25+ jobs

Save this search

Added 2 mins ago
Marketing Data Lead Carbon
Bayer CropScience LLC
Saint Louis, MO
…compliance; plan data modeling for carbon assets; implement automation techniques for process improvement; leverage data & analytics to inform marketing initiatives; train internal…
Added 8 mins ago
Infrastructure Specialist and Data Analyst
Range USA
BLUE ASH, OH
Scripting experience with Python or PowerShell for automation and data processing.
Added 10 mins ago
Sr. Engineer - Dev Experience Sensor
CrowdStrike, Inc.
Redmond, WA
…and UI. The tools engineer owns development of our build and test tools and works closely with the product engineering teams. As a tools engineer, you will use your strong technical ability…
Added 15 mins ago
IR
U.S Finance Manager Strategic Finance
IDC Research Inc.
United States
- $95,800 to $119,800 USD / year
…design, build and run AI-enabled automations, using Claude and Python-based agents, so the team spends its time onjudgment and insight rather than manual preparation. We are looking for a…
Added 17 mins ago
DEVOPS ENGINEER – GIT/Linux- 5+ yrs of Experience - TS/SCI w/Poly clearance is required- RC - 323
Halogen Engineering Group, Inc
Columbia, MD
Ability to automate release deployments across development, test, staging, Quality Assurance and production stacks using a combination of scripting languages and other automation toolkits
Added 25 mins ago
Software Engineer (Associate, Experienced or Lead) - El Segundo CA
Military Spouse Jobs & VetJobs
United States
In this role you will design, implement, test, and maintain software models and system-level simulators that reproduce operational conditions (i.e., simulated scenarios) to enable mission…
Added 56 mins ago
CI
Software Verification & Test Engineer
Crown Innovations, Inc.
Remote, United States
- $100,000 to $150,000 USD / year
Crown Innovations is seeking an experienced Aviation Software Verification & Test Engineer to support the development, verification, and certification of advanced aviation navigation…
Added 56 mins ago
🌎 Hardware Expert (MSc. or PhD), Remote- Contract
Xperteez Technology
Remote, United States
Use tools such as Python, MATLAB, Simulink, SPICE, Julia, C/C++, test automation platforms, or equivalent engineering software to validate results when relevant.
Added 1 hour ago
UG
Advisory Services Analyst, Consultant Development Program - AI/ML Engineering Track - Multiple Locations
UnitedHealth Group
Eden Prairie, MN
- $60,200 to $107,400 USD / year
Apply and integrate AI tools into client workflows - research, analysis, reporting, dashboards, and automation - building and optimizing prompts along the way
Added 1 hour ago
Software Engineer Intern (Summer 2027)
ENFOS, Inc.
Durham, NC
As a Software Engineering Intern at ENFOS, you will work alongside experienced engineers to design, build, test, and improve production software used by global enterprises to manage complex…
Added 1 hour ago
Software Engineer Intern (Summer 2027)
ENFOS, Inc.
Chicago, IL
As a Software Engineering Intern at ENFOS, you will work alongside experienced engineers to design, build, test, and improve production software used by global enterprises to manage complex…
Added 2 hours ago
EI
RF Test & Automation Engineer
Elve Inc
San Francisco, CA
- $85,000 to $150,000 USD / year
…cutting-edge RF technology. If you are passionate about RF systems, test automation, hardware, and building tools that directly improve how products are tested and manufactured, we want to…
Added 2 hours ago
EI
Test Engineer
Elve Inc
Davis, CA
- $85,000 to $125,000 USD / year
A Test engineer at Elve is responsible for the characterization of the performance of Elve products and systems, as well as the design, development, deployment of test and quality…
Added 2 hours ago
RF Design Engineer
Elve Inc
Davis, CA
Coding experience, particularly Python (for automation and data-processing/analysis), ideally with hardware communication
Added 2 hours ago
Design/SDC Engineer
Inabia Software & Consulting Inc.
San Jose, CA
…Proficient in industry-standard SDC/STA tools and scripting for automation, you excel at identifying and resolving timing issues across all design levels. You will collaborate with…
Added 2 hours ago
EA
Software Engineer - AI & Workflow Automation
Elevation Autism Center
Remote, United States
- $83,200 to $124,800 USD / year
Software Engineer – AI & Workflow Automation | $40–$60/hour | Hybrid – Alpharetta, GA
Added 2 hours ago
ES
Senior ATE Test Engineer
Elevate Semiconductor
San Diego, CA
- $125,000 to $180,000 USD / year
Develop automation tools using Python, JMP, and data analytics to improve engineering productivity and manufacturing quality.
Added 2 hours ago
ES
Product Engineer
Elevate Semiconductor
San Diego, CA
- $85,000 to $100,000 USD / year
Familiarity with Python or MATLAB for data analysis, scripting, or test automation.
Added 2 hours ago
ES
Senior Staff Applications Engineer
Elevate Semiconductor
San Diego, CA
- $150,000 to $180,000 USD / year
Experience using programming languages or tools for test automation and data analysis such as python, C, JMP, Excel
Added 2 hours ago
ES
Senior Applications Engineer
Elevate Semiconductor
San Diego, CA
- $110,000 to $130,000 USD / year
Experience using programming languages or tools for test automation and data analysis such as python, C, JMP, Excel
Added 2 hours ago
ES
Applications Engineer
Elevate Semiconductor
San Diego, CA
- $85,000 to $100,000 USD / year
Experience using programming languages or tools for test automation and data analysis such as python, C, JMP, Excel
Added 3 hours ago
WW
Associate Engineer - Infrastructure & Integrations Support
World Wide Technology
Maryland Heights, MO
- $73,200 to $91,500 USD / year
+ Develop, maintain, and enhance automation solutions using shell scripting, Python, Ansible, and AWX.
Added 3 hours ago
Lead Software Engineer
JPMC page
Plano, TX
Build and maintain reusable libraries, frameworks, and APIs in Python and/or Java, ensuring strong unit, integration, and data validation test coverage.
Added 3 hours ago
J
Senior Software Engineer, Secret Scanning
Jobgether
Remote, United States
- $127,800 to $339,000 USD / year
…sensitive information. In this role, you will design, develop, test, and deliver scalable software solutions that help identify, remediate, and prevent security vulnerabilities caused by…
Added 3 hours ago
J
Senior Analytics Engineer
Jobgether
Remote, United States
- $155,000 to $170,000 USD / year
Working knowledge of Python for automation and validation, although the role is primarily focused on SQL and dbt.

Closed listing

Baylor Scott & White Health

Quality Engineer, AI & Test Automation

Annapolis, MD, United States

This opening has closed.

The original listing is kept below for reference.

Find open jobs More jobs with this employer

About employer

Job details

Experience: · 5–8+ years of experience in quality engineering, software testing, test automation, SDET, software engineering, AI quality, or related technology delivery roles.
Posting language: English
Posted: Oct 21, 2026

Similar jobs hiring now

Added 2 hours ago
Super SWE - AI Factory
Jobgether · Remote
$200,000 to $275,000 USD / year
Added 2 hours ago
Software Development Engineer in Test (SDET)
Jobgether · Remote
$135,000 to $160,000 USD / year
Added 2 hours ago
Senior Software Engineer - US
IRIS · Remote
Added 3 hours ago
Senior Software Engineer, Secret Scanning
Jobgether · Remote
$127,800 to $339,000 USD / year

Search current openings

Original job description

Archived listing. The details below describe a past opening.

JOB SUMMARY

· The Quality Engineer, AI & Test Automation helps modernize BSWH’s quality approach by moving beyond traditional manual testing toward automation-first, engineering-integrated, and AI-enabled quality practices.

· This role designs, builds, executes, and maintains automated test suites, validation utilities, evaluation assets, and quality reporting that improve release confidence and speed of delivery across digital products, enterprise applications, and AI-enabled use cases.

· The role partners closely with Product, Engineering, Architecture, Data & Analytics, AI Foundation, Ontology, Security, Privacy, Clinical, Operations, and other delivery teams to define quality expectations early and embed quality practices throughout the development lifecycle.

· This role is expected to combine strong testing discipline with technical skills, including automation, API validation, data validation, CI/CD integration, quality metrics, defect triage, and emerging AI-enabled testing practices.

· The Quality Engineer, AI & Test Automation reports to the Director of Quality Engineering and helps establish reusable practices that support safe, reliable, efficient, and scalable delivery.

ESSENTIAL FUNCTIONS OF THE ROLE

Quality Engineering & Test Strategy

· Develop test strategies, test plans, acceptance criteria, and quality approaches for software and AI-enabled capabilities in partnership with Product, Engineering, Architecture, and business stakeholders.

· Translate requirements, user stories, workflows, APIs, data dependencies, and operational expectations into clear test scenarios and quality validation plans.

· Identify quality risks early in the delivery lifecycle and recommend appropriate validation approaches, including automated, manual, exploratory, integration, regression, performance, accessibility, or AI-specific evaluation methods.

· Provide clear release-readiness input based on test evidence, defect trends, quality metrics, risk assessment, and stakeholder expectations.

Test Automation & Engineering Practices

· Design, build, maintain, and improve automated test suites for API, UI, integration, end-to-end, regression, data, and workflow validation.

· Integrate automated tests into CI/CD pipelines and delivery workflows so quality signals are available earlier and more consistently throughout the development lifecycle.

· Create reusable test data, utilities, fixtures, scripts, and automation patterns that can be used across multiple teams and products.

· Improve test reliability, maintainability, execution time, coverage, and signal-to-noise ratio by reducing brittle scripts and eliminating repetitive manual validation where practical.

AI-Enabled Testing & Evaluation

· Support testing and evaluation of AI-enabled experiences, including agent workflows, generated responses, retrieval behavior, tool/API calls, escalation paths, guardrail behavior, and human-in-the-loop patterns.

· Help define evaluation datasets, expected behaviors, failure modes, scoring rubrics, regression scenarios, and quality thresholds for AI-enabled capabilities.

· Use AI-enabled testing tools where appropriate to generate test cases, analyze logs, triage defects, identify coverage gaps, summarize results, and accelerate quality workflows.

· Partner with AI Quality, Architecture, Engineering, and Product teams to validate that AI-enabled capabilities are useful, reliable, explainable enough for the use case, and aligned to defined quality expectations.

Defect Management, Root Cause & Continuous Improvement

· Identify, document, reproduce, triage, and communicate defects with sufficient technical detail to support efficient resolution by engineering teams.

· Analyze defect patterns, escaped defects, quality trends, release issues, and production feedback to identify root causes and improvement opportunities.

· Collaborate with engineering teams to improve testability, observability, logging, error handling, and diagnostic capabilities across applications and AI-enabled workflows.

· Contribute to retrospectives, quality reviews, and process improvements that reduce rework, improve release confidence, and increase delivery velocity.

Cross-Functional Partnership & Release Readiness

· Work closely with Product Managers, Senior AI Product Managers, Software Engineers, AI Engineers, Data Product Owners, Architects, Designers, Clinical and Operational stakeholders, and vendors/partners to align on quality expectations and release readiness.

· Ensure quality criteria are embedded in requirements, design reviews, backlog refinement, development, testing, implementation, and post-release monitoring.

· Support production validation, monitoring handoffs, post-release assessment, incident follow-up, and quality reporting for assigned products and use cases.

· Communicate quality status, risks, defects, test results, and recommendations clearly to technical and non-technical stakeholders.

Quality Standards, Documentation & Enablement

· Create and maintain test documentation, automation standards, quality playbooks, release-readiness checklists, defect triage practices, and reusable testing patterns.

· Help teams adopt automation-first and AI-enabled quality practices while clarifying where manual validation remains necessary due to risk, ambiguity, or workflow complexity.

· Share knowledge with other quality, product, engineering, and business stakeholders to raise BSWH’s overall quality engineering capability.

· Stay current on modern testing approaches, automation frameworks, AI evaluation practices, test data management, observability, and quality engineering methods.

KEY SUCCESS FACTORS

· Demonstrated ability to build and maintain meaningful automated tests rather than relying primarily on late-stage manual testing.

· Strong technical judgment across API testing, UI testing, integration testing, data validation, regression testing, defect triage, CI/CD integration, and release readiness.

· Ability to test AI-enabled systems where behavior may be probabilistic, workflow-dependent, or context-sensitive rather than purely deterministic.

· Ability to use AI-enabled productivity tools responsibly to improve test generation, analysis, defect triage, and quality reporting while maintaining human judgment over release quality.

· Strong collaboration with product and engineering teams to define quality expectations early and build quality into delivery practices rather than inspect quality at the end.

· Strong analytical and communication skills, including the ability to explain quality risks, evidence, tradeoffs, and release recommendations to technical and non-technical stakeholders.

· Comfort operating in a regulated or high-trust environment where safety, privacy, security, compliance, auditability, and customer trust are critical.

BENEFITS

Our competitive benefits package includes the following

Immediate eligibility for health and welfare benefits
401(k) savings plan with dollar-for-dollar match up to 5%
Tuition Reimbursement
PTO accrual beginning Day 1

Note: Benefits may vary based upon position type and/or level

MINIMUM REQUIREMENTS

Education

· Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, or related technical field.

· Equivalent combination of education and relevant technical experience may be considered.

Experience

· 5–8+ years of experience in quality engineering, software testing, test automation, SDET, software engineering, AI quality, or related technology delivery roles.

· Hands-on experience designing and implementing automated tests for APIs, web or mobile applications, workflows, data validation, integrations, or end-to-end product experiences.

· Experience working with engineering teams in agile, DevSecOps, CI/CD, or modern product-delivery environments.

· Experience with defect triage, root-cause analysis, test evidence documentation, release readiness, and quality metrics.

· Exposure to AI-enabled products, machine learning systems, large language models, conversational experiences, agentic workflows, automation, or decision-support technologies preferred.

· Healthcare, life sciences, financial services, or other regulated-industry experience preferred but not required.

Required Technical Expertise

· Strong understanding of software testing concepts, including test design, test coverage, functional testing, regression testing, integration testing, data validation, exploratory testing, and release validation.

· Hands-on experience with test automation frameworks, scripting, test data, CI/CD integration, and defect management tools.

· Ability to validate APIs, backend services, user interfaces, data flows, workflows, and enterprise integrations.

· Programming, scripting, or data analysis skills, preferably Python, JavaScript/TypeScript, Java, SQL, or comparable languages used to build or maintain automated test assets.

· Familiarity with AI-enabled testing and evaluation concepts, including prompt/response validation, model-output evaluation, RAG or retrieval testing, agent workflow testing, hallucination risk, guardrails, and human-in-the-loop workflows.

· Ability to use logs, traces, telemetry, monitoring, dashboards, test artifacts, and production feedback to investigate quality issues.

PREFERRED QUALIFICATIONS

· Experience as a Software Development Engineer in Test (SDET), Quality Engineer, Test Automation Engineer, Software Quality Engineer, AI Quality Engineer, or similar technically oriented quality role.

· Experience building or maintaining automation frameworks using tools such as Playwright, Cypress, Selenium, Appium, PyTest, Postman/Newman, JUnit, TestNG, or comparable frameworks.

· Experience testing AI agents, copilots, chatbots, LLM-powered applications, workflow automation, RAG systems, tool-calling workflows, or other AI-enabled capabilities.

· Experience creating evaluation suites, golden datasets, scoring rubrics, regression tests, synthetic test data, or quality dashboards for AI-enabled systems.

· Experience with cloud, APIs, microservices, event-driven systems, data platforms, analytics, observability tools, or modern application architectures.

· Experience supporting quality engineering transformation, reducing manual testing dependence, or introducing AI-enabled testing practices into product teams.

As a health care system committed to improving the health of those we serve, we are asking our employees to model the same behaviours that we promote to our patients. As of January 1, 2012, Baylor Scott & White Health no longer hires individuals who use nicotine products. We are an equal opportunity employer committed to ensuring a diverse workforce. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law.

About employer

More about this job

Skills

Test automation
CI/CD
Hazard assessment
Workflow
Process improvement
Reporting
Documentation
Data management
SuccessFactors
Collaboration
Communication skills
Computer science
Root cause analysis
Machine learning
Data analysis
Python
JavaScript
TypeScript
Oracle Java
SQL
Software development
Selenium
Appium
Postman
JUnit
TestNG
Microservices
Health care system

Report this job