Jobs in the United States

25+ jobs

Group jobs by employerEmail me new jobs Save this search

Added just now
CF
Principal Software Engineer - Payments
Citizens Financial Group, Inc.
Pittsburgh, PA · Johnston, RI · Short Hills, NJ · Westwood, MA
- $147,000 to $192,000 USD / year
The Principal Software Engineer will be responsible for:
Added 3 mins ago
O
Federal Oracle Health Automation Engineer - Eggplant
Oracle
Pierre, SD
- $23.8 to $56.83 USD / hour
The Federal Test Automation team is seeking a Staff Automation Engineer to support the Federal VA project. This role is responsible for designing, developing, and executing automated…
Added 3 mins ago
Core Senior .NET Software Engineer
Evolent
Pierre, SD
The Senior Software Engineer leads the design, development, and deployment of complex software solutions, ensuring scalability and maintainability. This role architects and implements…
Added 3 mins ago
EG
Automated Test Engineer
Eliassen Group
Pierre, SD
- $40 to $50 USD / hour
Our client seeks an Automated Test Engineer to support Hivemind by monitoring and maintaining large volumes of automated tests, troubleshooting failures, and driving bug resolution across…
Added 3 mins ago
Senior Software Engineer, Consumer Revenue
Discord
San Francisco, CA
We're looking for talented Senior Software Engineers to join our Consumer Revenue squads, the teams at the heart of premium experiences at Discord. You’ll be building out a premium Discord…
Added 5 mins ago
C
Founding Engineer
Clera
Remote, United States
- $200,000 to $400,000 USD / year
…banking infrastructure for digital assets and AI. As a founding engineer, you will help develop banking systems and services from the ground up, with ownership across design,…
Added 5 mins ago
C
Forward Deployed Engineer
Clera
San Francisco, CA
- $180,000 to $220,000 USD / year
- Willingness to travel 50 to 75 percent and work from the San Francisco office about three days per week
Added 5 mins ago
Z
Contract Student Worker – Firmware Engineer (FW Core System Services)
Zoox
Foster City, CA · San Diego, CA · Seattle, WA
- $30 USD / hour
…to everyone. At Zoox, innovation, collaboration, and a bold vision for the future drive everything we…
Added 6 mins ago
Data Platform Engineer
Kforce
Conshohocken, PA
Kforce has a client that is seeking a Data Platform Engineer in Conshohocken, PA.
Added 6 mins ago
O
Federal Oracle Health Automation Engineer - Eggplant
Oracle
Juneau, AK
- $23.8 to $56.83 USD / hour
The Federal Test Automation team is seeking a Staff Automation Engineer to support the Federal VA project. This role is responsible for designing, developing, and executing automated…
Added 6 mins ago
Core Senior .NET Software Engineer
Evolent
Juneau, AK
The Senior Software Engineer leads the design, development, and deployment of complex software solutions, ensuring scalability and maintainability. This role architects and implements…
Added 7 mins ago
F-22 Strategic Mission Planner Sr
Lockheed Martin
Elmendorf AFB, AK
Systems/Software/Test Engineer directly supporting fighter avionics, tactical datalinks, or mission planning ground systems.
Added 7 mins ago
EG
Automated Test Engineer
Eliassen Group
Juneau, AK
- $40 to $50 USD / hour
Our client seeks an Automated Test Engineer to support Hivemind by monitoring and maintaining large volumes of automated tests, troubleshooting failures, and driving bug resolution across…
Added 7 mins ago
Lead Vulnerability Research Engineer
Raymond James & Associates, Inc.
Saint Petersburg, FL · Southfield, MI
This position follows a hybrid work model, with an expectation to be in the office 3 days per week in a Raymond James Corporate Office location (St
Added 7 mins ago
Quality Engineer
Weiss-Aug - East Hanover, NJ
East Hanover, NJ
For incoming inspection must have general knowledge and training in the principles related to metals or resins
Added 7 mins ago
Systems Engineer (5840)
SMX
Patuxent River, MD · Hollywood, MD
Must reside local to Pax River NAS and able to make scheduled and adhoc meetings in person
Added 7 mins ago
Acquisition Software Engineer (5840)
SMX
Patuxent River, MD · Hollywood, MD
Must reside local to Pax River NAS and able to make scheduled and adhoc meetings in person
Added 7 mins ago
L
Application Security Engineer
LangChain
San Francisco, CA
- $175,000 to $215,000 USD / year
- 5+ years in security engineering with strong software skills (Python or Go; TypeScript a plus).
Added 8 mins ago
Shipping and Fulfillment Team Lead -2nd Shift
Harvey Performance participates in E-Verify.
Cuyahoga Falls, OH
…met; resolve labeling issues in coordination with the Process…
Added 8 mins ago
M
Lead Software Engineer
modis
Phoenix, AZ
- $120 to $140 USD / hour
Modis is seeking a Lead Software Engineer for a Contract with a client in Phoenix, AZ (Hybrid). The ideal candidate will drive SoC performance analysis by developing monitoring tools,…
Added 8 mins ago
M
AI Data Engineer
modis
Redmond, WA
- $85 to $90 USD / hour
Modis is seeking an AI Data Engineer for a Contract with a client in Redmond, WA. The ideal candidate will be experienced in building and optimizing Python-based data pipelines for…
Added 8 mins ago
M
Principal Software Engineer
modis
Phoenix, AZ
- $110 to $120 USD / hour
Modis is seeking a Principal Software Engineer for a Contract with a client in Phoenix, AZ (Hybrid). The ideal candidate will lead performance characterization and bandwidth optimization…
Added 9 mins ago
Engineer II
Custom Metal Designs LLC
Oakland, FL
We are seeking a motivated and experienced Mechanical Engineer II to join our team on-site. This position specializes in the mechanical design and integration of industrial automation…
Added 9 mins ago
WW
EUC Engineer
World Wide Technology Holding, LLC
St. Louis, MO
- $90,000 to $162,600 USD / year
Experience troubleshooting end-user hardware, software, and driver issues
Added 10 mins ago
Fab Equipment Engineer
Avago Technologies Wireless (U.S.A.) Manufacturing LLC
United States
As a DCIM (Diffusion, CVD, Implant, Milling) Team Equipment Engineer with Broadcom Limited’s Wireless Semiconductor Division (WSD), you will own and support equipment used to develop and…

Transform9

Automation Test Engineer

Remote, United States

Apply on jobs.workable.com About employer

Applications open in a new tab.

Job details

Work location: If you're in the Birmingham, AL area, this role is hybrid from our office (3 days in office / 2 remote)
Posting language: English
Posted: Jun 29, 2026

Original job description

Calling your doctor shouldn't be harder than seeing your doctor. But at most practices, patients wait on hold, front-office staff drown in ring queues, and revenue walks out the door with every missed call.

Transform9 builds AI agents that answer every call for physician practices - scheduling appointments, routing callers, and resolving routine requests in seconds, around the clock. Our agents integrate directly with each practice's EHR, practice management, and phone systems, and adapt to how their front office actually works.

Our agents have handled millions of patient calls for thousands of providers, cut average hold times by 90%, and decreased call abandonment by 80%. We're headquartered in Birmingham, AL, and growing fast.

About the role

At Transform9, a broken call flow means a patient can't reach their doctor. Quality isn't just a process concern - it's a patient safety concern. As a senior automation testing engineer, you'll own the test strategy and automation infrastructure for a real-time voice AI platform, ensuring that every agent behavior, integration point, and call flow performs exactly as expected before it ever reaches a live patient.

This is testing where the system under test doesn't give you the same answer twice. Our agents are LLM-driven, so correctness is a range of acceptable behaviors rather than a single expected string. You'll build the frameworks that make that range measurable - and make regressions obvious.

What you'll do

Design, build, and maintain the automated test infrastructure for Transform9's voice AI platform - unit, integration, end-to-end, and load/performance testing
Build evaluation and regression harnesses for non-deterministic agent behavior - scoring conversation outcomes and intent fulfillment rather than exact output matching
Generate synthetic conversation data and de-identified patient scenarios to expand coverage of edge cases that occur rarely in production
Develop test frameworks and tooling that enable the broader engineering team to write and run reliable tests efficiently
Define and enforce quality standards and testing best practices across engineering teams
Build simulation and regression frameworks for real-time voice and conversational AI scenarios
Partner with platform, provisioning, and integrations teams to ensure test coverage across all system boundaries
Own test environments and CI/CD pipeline integration for automated test execution
Investigate and triage production quality issues; drive root cause analysis and prevention
Develop testing approaches that satisfy HIPAA and healthcare compliance requirements

Location

Remote (US). If you're in the Birmingham, AL area, this role is hybrid from our office (3 days in office / 2 remote).

10+ years in software quality engineering, with a strong focus on test automation
Proven experience designing and owning test automation frameworks from the ground up
Proficiency in Python, TypeScript, or equivalent; strong scripting and tooling skills
Experience with CI/CD integration (GitHub Actions, Jenkins, or equivalent)
Deep understanding of testing strategies across unit, integration, and end-to-end layers
Experience testing AI-powered applications - LLM- or model-backed features, including prompt and model regression testing
Experience testing non-deterministic conversational flows, where the same input can yield different valid responses - designing assertions and evaluation criteria that tolerate variation without masking real regressions
Experience generating synthetic data for test coverage at scale - realistic conversation transcripts, edge-case inputs, and de-identified patient scenarios
Strong analytical and debugging skills - able to diagnose failures in complex distributed systems
Experience testing APIs, backend services, and event-driven architectures
Track record of raising quality standards across a team, not just writing tests

Nice to have

Experience testing real-time systems, telephony, or voice platforms
Familiarity with LLM evaluation tooling and prompt/model versioning workflows
Experience evaluating speech-to-text or text-to-speech quality
Load/performance testing experience for high-throughput systems
HIPAA-regulated or compliance-heavy environment experience
Experience with contract testing or service virtualization
Top-tier health coverage: medical, dental & vision
401(k)
Paid time off + holidays, and paid parental leave

If you want to fix the front door of healthcare, we'd love to hear from you. Transform9 is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status. Note: the Transform9 team will only email you from a transform9.com email address.

Apply on jobs.workable.com About employer

Report this job

Work requirements

Jobs in the United States