Jobs in the United States

25+ jobs

Group jobs by employerEmail me new jobs Save this search

Added just now
CF
Principal Software Engineer - Payments
Citizens Financial Group, Inc.
Pittsburgh, PA · Johnston, RI · Short Hills, NJ · Westwood, MA
- $147,000 to $192,000 USD / year
The Principal Software Engineer will be responsible for:
Added 1 min ago
Cybersecurity Engineer - Cloud
SAIC
Flexwork, CO · Chantilly, VA · Beale AFB, CA
SAIC is seeking a Cloud Cybersecurity Engineer to support the security, accreditation, and continuous monitoring of cloud environments that enable development, integration, testing, and…
Added 1 min ago
Senior Machine Learning Engineer
Atlassian
Remote, United States
Atlassian is seeking a Senior Machine Learning Engineer to join our Central AI team.
Added 3 mins ago
Lead Information Security Engineer - Red Team
Lumen
Pierre, SD
At Lumen, you’ll work on infrastructure customers rely on today and build for what’s next, where performance, security, and resilience matter.
Added 3 mins ago
O
Federal Oracle Health Automation Engineer - Eggplant
Oracle
Pierre, SD
- $23.8 to $56.83 USD / hour
The Federal Test Automation team is seeking a Staff Automation Engineer to support the Federal VA project. This role is responsible for designing, developing, and executing automated…
Added 3 mins ago
EG
Automated Test Engineer
Eliassen Group
Pierre, SD
- $40 to $50 USD / hour
Our client seeks an Automated Test Engineer to support Hivemind by monitoring and maintaining large volumes of automated tests, troubleshooting failures, and driving bug resolution across…
Added 4 mins ago
Senior Software Engineer, Consumer Revenue
Discord
San Francisco, CA
…to polished, user-facing interfaces. You’ll be supported by infrastructure, platform, and product teams on your mission to build the best premium…
Added 4 mins ago
Senior Network Engineer
Govcio LLC
Tampa, FL
Must possess an Active Secret
Added 4 mins ago
Senior Systems Engineer
Govcio LLC
Tampa, FL
Must have a valid US Passport and be prepared for up to 40% international travel to customer locations in Eastern Europe, Africa, and South America
Added 4 mins ago
Mid Systems Engineer
Govcio LLC
Tampa, FL
Must have a valid US Passport and be prepared for up to 40% international travel to customer locations in Eastern Europe and South America
Added 5 mins ago
Technician 2
Nissan North America, Inc. (NNA)
Farmington Hills, MI
Universal EPA 608 Certification required
Added 5 mins ago
C
Full-Stack Software Engineer, Reinforcement Learning
Clera
San Francisco, CA
- $130,000 to $225,000 USD / year
- Design backend services and APIs that connect task authoring, data collection, evaluation, quality assurance, and training infrastructure.
Added 5 mins ago
C
Founding Engineer
Clera
Remote, United States
- $200,000 to $400,000 USD / year
Join an early-stage financial technology team building core banking infrastructure for digital assets and AI. As a founding engineer, you will help develop banking systems and services from…
Added 5 mins ago
C
Founding Engineer, Environments and Data
Clera
San Francisco, CA
- $200,000 to $300,000 USD / year
- Hands-on experience with synthetic data pipelines, benchmarks, evaluations, or post-training; this is a research and engineering role, not a pure infrastructure position.
Added 5 mins ago
C
Founding Engineer
Clera
Remote, United States
- $156,000 to $182,000 USD / year
On-site in New York, New York, five days per week
Added 5 mins ago
Z
Contract Student Worker – Firmware Engineer (FW Core System Services)
Zoox
Foster City, CA · San Diego, CA · Seattle, WA
- $30 USD / hour
Zoox is seeking a motivated Firmware Engineer student worker to join our team, focusing on diagnostic infrastructure for the Core Firmware System Services team. This is an opportunity to…
Added 5 mins ago
Engineer Staff/Sr/III - Electrical - Power West
Williams WPC-I, LLC.
United States
As a Electrical Engineer-Staff, you’ll lead large-scale projects that power critical infrastructure while driving innovation in energy systems. You’ll design and optimize electrical…
Added 6 mins ago
Data Platform Engineer
Kforce
Conshohocken, PA
We are seeking a hands-on Senior Data Platform Engineer to help build and evolve a modern cloud data platform. This is not a traditional ETL-focused role. We are looking for an experienced…
Added 7 mins ago
O
Federal Oracle Health Automation Engineer - Eggplant
Oracle
Juneau, AK
- $23.8 to $56.83 USD / hour
The Federal Test Automation team is seeking a Staff Automation Engineer to support the Federal VA project. This role is responsible for designing, developing, and executing automated…
Added 7 mins ago
EG
Automated Test Engineer
Eliassen Group
Juneau, AK
- $40 to $50 USD / hour
Our client seeks an Automated Test Engineer to support Hivemind by monitoring and maintaining large volumes of automated tests, troubleshooting failures, and driving bug resolution across…
Added 7 mins ago
Lead Vulnerability Research Engineer
Raymond James & Associates, Inc.
Saint Petersburg, FL · Southfield, MI
This position follows a hybrid work model, with an expectation to be in the office 3 days per week in a Raymond James Corporate Office location (St
Added 8 mins ago
L
Application Security Engineer
LangChain
San Francisco, CA
- $175,000 to $215,000 USD / year
- Own product & platform security: Design and drive application/infrastructure security controls across LangSmith, LangGraph, and the LangChain SDK ecosystem (Python/TS/Go).
Added 8 mins ago
Control System engineer HMI Engineer - FMCS SCADA Controls Systems
Hanwha Convergence
Round Rock, TX
…systems, primarily using WinCC OA, to support critical facility infrastructure. The engineer will work closely with controls engineers, facility operations teams, and customer stakeholders…
Added 8 mins ago
Design Engineer - 7010801
Department of Natural Resources
Jefferson City, MO
Plan, design, and oversee engineering projects for Missouri State Parks facilities, including site improvements, utilities, buildings, and infrastructure.
Added 8 mins ago
C
Senior Software Engineer (.NET Ecosystem)
ClickHouse
Remote, United States
- $167,000 to $238,000 USD / year
- Open-source contributions to .NET or data infrastructure.

Transform9

Automation Test Engineer

Remote, United States

Apply on jobs.workable.com About employer

Applications open in a new tab.

Job details

Work location: If you're in the Birmingham, AL area, this role is hybrid from our office (3 days in office / 2 remote)
Posting language: English
Posted: Jun 29, 2026

Original job description

Calling your doctor shouldn't be harder than seeing your doctor. But at most practices, patients wait on hold, front-office staff drown in ring queues, and revenue walks out the door with every missed call.

Transform9 builds AI agents that answer every call for physician practices - scheduling appointments, routing callers, and resolving routine requests in seconds, around the clock. Our agents integrate directly with each practice's EHR, practice management, and phone systems, and adapt to how their front office actually works.

Our agents have handled millions of patient calls for thousands of providers, cut average hold times by 90%, and decreased call abandonment by 80%. We're headquartered in Birmingham, AL, and growing fast.

About the role

At Transform9, a broken call flow means a patient can't reach their doctor. Quality isn't just a process concern - it's a patient safety concern. As a senior automation testing engineer, you'll own the test strategy and automation infrastructure for a real-time voice AI platform, ensuring that every agent behavior, integration point, and call flow performs exactly as expected before it ever reaches a live patient.

This is testing where the system under test doesn't give you the same answer twice. Our agents are LLM-driven, so correctness is a range of acceptable behaviors rather than a single expected string. You'll build the frameworks that make that range measurable - and make regressions obvious.

What you'll do

Design, build, and maintain the automated test infrastructure for Transform9's voice AI platform - unit, integration, end-to-end, and load/performance testing
Build evaluation and regression harnesses for non-deterministic agent behavior - scoring conversation outcomes and intent fulfillment rather than exact output matching
Generate synthetic conversation data and de-identified patient scenarios to expand coverage of edge cases that occur rarely in production
Develop test frameworks and tooling that enable the broader engineering team to write and run reliable tests efficiently
Define and enforce quality standards and testing best practices across engineering teams
Build simulation and regression frameworks for real-time voice and conversational AI scenarios
Partner with platform, provisioning, and integrations teams to ensure test coverage across all system boundaries
Own test environments and CI/CD pipeline integration for automated test execution
Investigate and triage production quality issues; drive root cause analysis and prevention
Develop testing approaches that satisfy HIPAA and healthcare compliance requirements

Location

Remote (US). If you're in the Birmingham, AL area, this role is hybrid from our office (3 days in office / 2 remote).

10+ years in software quality engineering, with a strong focus on test automation
Proven experience designing and owning test automation frameworks from the ground up
Proficiency in Python, TypeScript, or equivalent; strong scripting and tooling skills
Experience with CI/CD integration (GitHub Actions, Jenkins, or equivalent)
Deep understanding of testing strategies across unit, integration, and end-to-end layers
Experience testing AI-powered applications - LLM- or model-backed features, including prompt and model regression testing
Experience testing non-deterministic conversational flows, where the same input can yield different valid responses - designing assertions and evaluation criteria that tolerate variation without masking real regressions
Experience generating synthetic data for test coverage at scale - realistic conversation transcripts, edge-case inputs, and de-identified patient scenarios
Strong analytical and debugging skills - able to diagnose failures in complex distributed systems
Experience testing APIs, backend services, and event-driven architectures
Track record of raising quality standards across a team, not just writing tests

Nice to have

Experience testing real-time systems, telephony, or voice platforms
Familiarity with LLM evaluation tooling and prompt/model versioning workflows
Experience evaluating speech-to-text or text-to-speech quality
Load/performance testing experience for high-throughput systems
HIPAA-regulated or compliance-heavy environment experience
Experience with contract testing or service virtualization
Top-tier health coverage: medical, dental & vision
401(k)
Paid time off + holidays, and paid parental leave

If you want to fix the front door of healthcare, we'd love to hear from you. Transform9 is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status. Note: the Transform9 team will only email you from a transform9.com email address.

Apply on jobs.workable.com About employer

Report this job

Work requirements

Jobs in the United States