Jobs in the United States

25+ jobs

Group jobs by employerEmail me new jobs Save this search

Added just now
Advanced Quality Engineer
Re:Build Manufacturing
Kalamazoo, MI
The Advanced Quality Engineer completes tasks as guided by Re:Build Kalamazoo's quality assurance framework. This supports New Product Development and helps ensure product safety, efficacy,…
Added just now
Senior Vehicle Fluids Engineer (Cert/Customer)
Relativity Space
Long Beach, CA
…functioning rockets! The team has full ownership across design, production, test, and flight, maintaining a holistic view of Terran R, focused not on isolated parts but integrated…
Added 2 mins ago
Plant Engineer Intern
Granite Construction Company
Sacramento, CA
Determine and calculate production quantities and communicate to management to ensure their understanding of our cost to produce.
Added 2 mins ago
Mechanical Engineer
Intuitive
Sunnyvale, CA
The Senior Mechanical Engineer works in and/or leads cross-functional teams to maintain and improve the design, production, and service of the da Vinci® Surgical System. They will determine…
Added 2 mins ago
TF
Industrial Maintenance Reliability Technician II
Toppan Flexible Packaging Inc
Morristown, TN
- $33.58 USD / hour
…reliability, minimize downtime, and support safe, efficient production…
Added 2 mins ago
Senior Machine Learning Engineer
Atlassian
Remote, United States
Atlassian is seeking a Senior Machine Learning Engineer to join our Central AI team.
Added 3 mins ago
Field Service Engineer IV
Xylem Services USA LLC
Groveport, OH · Columbus, OH
The Field Service Engineer IV is responsible for designing and optimizing processes for efficient operations, troubleshooting and solutioning Electrical & Instruments (E&I) issues at an…
Added 4 mins ago
Senior Front-End and Agentic-UI Engineer
Evolent
Pierre, SD
The Senior Software Engineer leads the design, development, and deployment of complex features in the web user experience for the Evolent Platform. This role builds high-performance React…
Added 4 mins ago
Core Senior .NET Software Engineer
Evolent
Pierre, SD
The Senior Software Engineer leads the design, development, and deployment of complex software solutions, ensuring scalability and maintainability. This role architects and implements…
Added 4 mins ago
EG
Automated Test Engineer
Eliassen Group
Pierre, SD
- $40 to $50 USD / hour
Our client seeks an Automated Test Engineer to support Hivemind by monitoring and maintaining large volumes of automated tests, troubleshooting failures, and driving bug resolution across…
Added 5 mins ago
C
🚀 Senior Backend Engineer, Growth
Clubhouse
Remote, United States
- $225,000 to $260,000 USD / year
We’re hiring a Senior Backend Engineer (IC4) for our Growth squad on Clubhouse. Our mission is to get people into a room with their friends: more new users, more returning users and more…
Added 6 mins ago
R
Electronic Assembler-Weekend Shift
Ralliant
Hollister, CA · Hollister
- $20 to $28 USD / hour
As an Electronic Assembler you can expect to be our go-to for driving continuous improvement in the electronics production process. More specifically, in this role, you:
Added 6 mins ago
Senior Automation Engineer
Ralliant
Hollister, CA · Hollister
Pacific Scientific EMC is expanding and seeking a multidisciplinary Senior Automation Engineer to design and advance our automation systems. This role serves as the technical authority…
Added 6 mins ago
C
Full-Stack Software Engineer, Reinforcement Learning
Clera
San Francisco, CA
- $130,000 to $225,000 USD / year
- At least 3 years of full-stack engineering experience building and shipping production systems, with technical field study or equivalent technical fundamentals.
Added 6 mins ago
C
Product Engineer
Clera
Remote, United States
- $180,000 to $250,000 USD / year
- Based in or relocating to New York City, with availability to work in the office three days per week · The role works in the office three days per week.
Added 6 mins ago
C
Founding Engineer
Clera
Remote, United States
- $200,000 to $400,000 USD / year
…banking infrastructure for digital assets and AI. As a founding engineer, you will help develop banking systems and services from the ground up, with ownership across design,…
Added 6 mins ago
C
Forward Deployed Engineer
Clera
San Francisco, CA
- $180,000 to $220,000 USD / year
- Willingness to travel 50 to 75 percent and work from the San Francisco office about three days per week
Added 6 mins ago
C
Founding Engineer, Agents
Clera
San Francisco, CA
- $200,000 to $300,000 USD / year
On-site in San Francisco, California, five days per week.
Added 6 mins ago
C
Founding Engineer, Environments and Data
Clera
San Francisco, CA
- $200,000 to $300,000 USD / year
…engineering role focuses on agent capability assessment and production readiness, shaping how agent competence is…
Added 6 mins ago
C
Founding Product Engineer
Clera
San Francisco, CA
- $140,000 to $180,000 USD / year
On-site in San Francisco, California, six days per week
Added 6 mins ago
C
Founding Product Engineer
Clera
San Francisco, CA
- $200,000 to $250,000 USD / year
Candidates must be based in the area or willing to relocate.
Added 6 mins ago
C
Founding Engineer
Clera
Remote, United States
- $156,000 to $182,000 USD / year
On-site in New York, New York, five days per week
Added 6 mins ago
C
Founding Engineer
Clera
Remote, United States
- $180,000 to $250,000 USD / year
On-site, five days per week in New York, New York.
Added 6 mins ago
C
Research Engineer, Privacy and Anonymization
Clera
San Francisco, CA
- $130,000 to $225,000 USD / year
- Build production pipelines that anonymize raw data before it reaches processing, training, evaluation, or synthetic data workflows.
Added 6 mins ago
Z
Contract Student Worker - Machine Learning Engineer
Zoox
Boston, MA · Foster City, CA · Seattle, WA · San Diego, CA
- $30 USD / hour
…validate model performance against rigorous benchmarks to ensure production readiness, reliability, and accuracy before…

Transform9

Automation Test Engineer

Remote, United States

Apply on jobs.workable.com About employer

Applications open in a new tab.

Job details

Work location: If you're in the Birmingham, AL area, this role is hybrid from our office (3 days in office / 2 remote)
Posting language: English
Posted: Jun 29, 2026

Original job description

Calling your doctor shouldn't be harder than seeing your doctor. But at most practices, patients wait on hold, front-office staff drown in ring queues, and revenue walks out the door with every missed call.

Transform9 builds AI agents that answer every call for physician practices - scheduling appointments, routing callers, and resolving routine requests in seconds, around the clock. Our agents integrate directly with each practice's EHR, practice management, and phone systems, and adapt to how their front office actually works.

Our agents have handled millions of patient calls for thousands of providers, cut average hold times by 90%, and decreased call abandonment by 80%. We're headquartered in Birmingham, AL, and growing fast.

About the role

At Transform9, a broken call flow means a patient can't reach their doctor. Quality isn't just a process concern - it's a patient safety concern. As a senior automation testing engineer, you'll own the test strategy and automation infrastructure for a real-time voice AI platform, ensuring that every agent behavior, integration point, and call flow performs exactly as expected before it ever reaches a live patient.

This is testing where the system under test doesn't give you the same answer twice. Our agents are LLM-driven, so correctness is a range of acceptable behaviors rather than a single expected string. You'll build the frameworks that make that range measurable - and make regressions obvious.

What you'll do

Design, build, and maintain the automated test infrastructure for Transform9's voice AI platform - unit, integration, end-to-end, and load/performance testing
Build evaluation and regression harnesses for non-deterministic agent behavior - scoring conversation outcomes and intent fulfillment rather than exact output matching
Generate synthetic conversation data and de-identified patient scenarios to expand coverage of edge cases that occur rarely in production
Develop test frameworks and tooling that enable the broader engineering team to write and run reliable tests efficiently
Define and enforce quality standards and testing best practices across engineering teams
Build simulation and regression frameworks for real-time voice and conversational AI scenarios
Partner with platform, provisioning, and integrations teams to ensure test coverage across all system boundaries
Own test environments and CI/CD pipeline integration for automated test execution
Investigate and triage production quality issues; drive root cause analysis and prevention
Develop testing approaches that satisfy HIPAA and healthcare compliance requirements

Location

Remote (US). If you're in the Birmingham, AL area, this role is hybrid from our office (3 days in office / 2 remote).

10+ years in software quality engineering, with a strong focus on test automation
Proven experience designing and owning test automation frameworks from the ground up
Proficiency in Python, TypeScript, or equivalent; strong scripting and tooling skills
Experience with CI/CD integration (GitHub Actions, Jenkins, or equivalent)
Deep understanding of testing strategies across unit, integration, and end-to-end layers
Experience testing AI-powered applications - LLM- or model-backed features, including prompt and model regression testing
Experience testing non-deterministic conversational flows, where the same input can yield different valid responses - designing assertions and evaluation criteria that tolerate variation without masking real regressions
Experience generating synthetic data for test coverage at scale - realistic conversation transcripts, edge-case inputs, and de-identified patient scenarios
Strong analytical and debugging skills - able to diagnose failures in complex distributed systems
Experience testing APIs, backend services, and event-driven architectures
Track record of raising quality standards across a team, not just writing tests

Nice to have

Experience testing real-time systems, telephony, or voice platforms
Familiarity with LLM evaluation tooling and prompt/model versioning workflows
Experience evaluating speech-to-text or text-to-speech quality
Load/performance testing experience for high-throughput systems
HIPAA-regulated or compliance-heavy environment experience
Experience with contract testing or service virtualization
Top-tier health coverage: medical, dental & vision
401(k)
Paid time off + holidays, and paid parental leave

If you want to fix the front door of healthcare, we'd love to hear from you. Transform9 is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status. Note: the Transform9 team will only email you from a transform9.com email address.

Apply on jobs.workable.com About employer

Report this job

Work requirements

Jobs in the United States