Jobs in the United States

25+ jobs

Group jobs by employerEmail me new jobs Save this search

Added just now
CF
Principal Software Engineer - Payments
Citizens Financial Group, Inc.
Pittsburgh, PA · Johnston, RI · Short Hills, NJ · Westwood, MA
- $147,000 to $192,000 USD / year
The Principal Software Engineer will be responsible for:
Added 1 min ago
Cybersecurity Engineer - Cloud
SAIC
Flexwork, CO · Chantilly, VA · Beale AFB, CA
SAIC is seeking a Cloud Cybersecurity Engineer to support the security, accreditation, and continuous monitoring of cloud environments that enable development, integration, testing, and…
Added 1 min ago
Mechanical Engineer
Intuitive
Sunnyvale, CA
Intuitive designs and manufactures highly complex robotic systems for use in minimally invasive surgical applications. Our da Vinci® Surgical Systems design engineering team is committed to…
Added 3 mins ago
Field Service Engineer IV
Xylem Services USA LLC
Groveport, OH · Columbus, OH
The Field Service Engineer IV is responsible for designing and optimizing processes for efficient operations, troubleshooting and solutioning Electrical & Instruments (E&I) issues at an…
Added 3 mins ago
Lead Information Security Engineer - Red Team
Lumen
Pierre, SD
The Lead Information Security Engineer within Product and Platform Security provides technical leadership and hands-on execution across Red Team functions. This role leverages advanced…
Added 4 mins ago
EG
Automated Test Engineer
Eliassen Group
Pierre, SD
- $40 to $50 USD / hour
Our client seeks an Automated Test Engineer to support Hivemind by monitoring and maintaining large volumes of automated tests, troubleshooting failures, and driving bug resolution across…
Added 4 mins ago
Packaging Engineer
SunOpta
Eden Prairie, MN
Must have experience with Microsoft Office Suite (Word, PowerPoint, Excel)
Added 5 mins ago
Technician 2
Nissan North America, Inc. (NNA)
Farmington Hills, MI
Universal EPA 608 Certification required
Added 5 mins ago
Senior Automation Engineer
Ralliant
Hollister, CA · Hollister
Pacific Scientific EMC is expanding and seeking a multidisciplinary Senior Automation Engineer to design and advance our automation systems. This role serves as the technical authority…
Added 5 mins ago
C
Full-Stack Software Engineer, Reinforcement Learning
Clera
San Francisco, CA
- $130,000 to $225,000 USD / year
Build product interfaces, backend systems, and internal tools for a reinforcement learning data platform. You will own experiences that help research teams and external partners create,…
Added 5 mins ago
C
Founding Engineer
Clera
Remote, United States
- $200,000 to $400,000 USD / year
…banking infrastructure for digital assets and AI. As a founding engineer, you will help develop banking systems and services from the ground up, with ownership across design,…
Added 5 mins ago
C
Founding Engineer
Clera
Remote, United States
- $180,000 to $250,000 USD / year
On-site, five days per week in New York, New York.
Added 6 mins ago
Stationary Engineer
ASRC Federal
Eareckson Station, AK
ASRC Federal Communications is seeking a Stationary Engineer for our ISS2 contract supporting our Air Force customer. This position is located on Eareckson Air Station. This is a rotational…
Added 7 mins ago
F-22 Strategic Mission Planner Sr
Lockheed Martin
Elmendorf AFB, AK
Enlisted Aircrew (e.g., Airborne Sensor Operator, Surveillance Operator, In-Flight Technician, Airborne Systems Engineer) experienced in airborne sensors, tactical datalinks, or electronic…
Added 7 mins ago
EG
Automated Test Engineer
Eliassen Group
Juneau, AK
- $40 to $50 USD / hour
Our client seeks an Automated Test Engineer to support Hivemind by monitoring and maintaining large volumes of automated tests, troubleshooting failures, and driving bug resolution across…
Added 8 mins ago
Lead Vulnerability Research Engineer
Raymond James & Associates, Inc.
Saint Petersburg, FL · Southfield, MI
This position follows a hybrid work model, with an expectation to be in the office 3 days per week in a Raymond James Corporate Office location (St
Added 8 mins ago
Quality Engineer
Weiss-Aug - East Hanover, NJ
East Hanover, NJ
For incoming inspection must have general knowledge and training in the principles related to metals or resins
Added 8 mins ago
Systems Engineer (5840)
SMX
Patuxent River, MD · Hollywood, MD
Must reside local to Pax River NAS and able to make scheduled and adhoc meetings in person
Added 8 mins ago
Acquisition Software Engineer (5840)
SMX
Patuxent River, MD · Hollywood, MD
Must reside local to Pax River NAS and able to make scheduled and adhoc meetings in person
Added 9 mins ago
Control System engineer HMI Engineer - FMCS SCADA Controls Systems
Hanwha Convergence
Round Rock, TX
Position Summary: Hanwha Convergence USA is seeking a Control Systems Engineer specializing in HMI/SCADA systems to support Facility Monitoring and Control Systems (FMCS) for semiconductor…
Added 9 mins ago
C
Senior Software Engineer (.NET Ecosystem)
ClickHouse
Remote, United States
- $167,000 to $238,000 USD / year
- 5+ years in software, much of it on data-intensive systems: drivers, SDKs, data access, ingestion or analytics.
Added 9 mins ago
Automatic Transmissions Torque Converter Design Engineer
Stellantis
Auburn Hills, MI
The Design Engineer for automatic transmission torque converters is responsible for specifying and releasing automatic transmission components including torque converter mechanical…
Added 10 mins ago
Engineer II
Custom Metal Designs LLC
Oakland, FL
We are seeking a motivated and experienced Mechanical Engineer II to join our team on-site. This position specializes in the mechanical design and integration of industrial automation…
Added 12 mins ago
Senior Cybersecurity Engineer – Security Operations & Data Protection
BT Brand
Atlanta, GA · Dallas, TX
Bennett Thrasher is looking for Senior Cybersecurity Engineer to own day-to-day security, including the safe use of AI tools, for multiple offices. You will be the firm's lead security…
Added 12 mins ago
P
Senior DevOps Engineer
Plenful
San Francisco, CA · Seattle, WA · Chicago, IL · New York City, NY
- $138,000 to $195,000 USD / year
R&D roles follow a hybrid model, with two days per week in our San Francisco office

Transform9

Automation Test Engineer

Remote, United States

Apply on jobs.workable.com About employer

Applications open in a new tab.

Job details

Work location: If you're in the Birmingham, AL area, this role is hybrid from our office (3 days in office / 2 remote)
Posting language: English
Posted: Jun 29, 2026

Original job description

Calling your doctor shouldn't be harder than seeing your doctor. But at most practices, patients wait on hold, front-office staff drown in ring queues, and revenue walks out the door with every missed call.

Transform9 builds AI agents that answer every call for physician practices - scheduling appointments, routing callers, and resolving routine requests in seconds, around the clock. Our agents integrate directly with each practice's EHR, practice management, and phone systems, and adapt to how their front office actually works.

Our agents have handled millions of patient calls for thousands of providers, cut average hold times by 90%, and decreased call abandonment by 80%. We're headquartered in Birmingham, AL, and growing fast.

About the role

At Transform9, a broken call flow means a patient can't reach their doctor. Quality isn't just a process concern - it's a patient safety concern. As a senior automation testing engineer, you'll own the test strategy and automation infrastructure for a real-time voice AI platform, ensuring that every agent behavior, integration point, and call flow performs exactly as expected before it ever reaches a live patient.

This is testing where the system under test doesn't give you the same answer twice. Our agents are LLM-driven, so correctness is a range of acceptable behaviors rather than a single expected string. You'll build the frameworks that make that range measurable - and make regressions obvious.

What you'll do

Design, build, and maintain the automated test infrastructure for Transform9's voice AI platform - unit, integration, end-to-end, and load/performance testing
Build evaluation and regression harnesses for non-deterministic agent behavior - scoring conversation outcomes and intent fulfillment rather than exact output matching
Generate synthetic conversation data and de-identified patient scenarios to expand coverage of edge cases that occur rarely in production
Develop test frameworks and tooling that enable the broader engineering team to write and run reliable tests efficiently
Define and enforce quality standards and testing best practices across engineering teams
Build simulation and regression frameworks for real-time voice and conversational AI scenarios
Partner with platform, provisioning, and integrations teams to ensure test coverage across all system boundaries
Own test environments and CI/CD pipeline integration for automated test execution
Investigate and triage production quality issues; drive root cause analysis and prevention
Develop testing approaches that satisfy HIPAA and healthcare compliance requirements

Location

Remote (US). If you're in the Birmingham, AL area, this role is hybrid from our office (3 days in office / 2 remote).

10+ years in software quality engineering, with a strong focus on test automation
Proven experience designing and owning test automation frameworks from the ground up
Proficiency in Python, TypeScript, or equivalent; strong scripting and tooling skills
Experience with CI/CD integration (GitHub Actions, Jenkins, or equivalent)
Deep understanding of testing strategies across unit, integration, and end-to-end layers
Experience testing AI-powered applications - LLM- or model-backed features, including prompt and model regression testing
Experience testing non-deterministic conversational flows, where the same input can yield different valid responses - designing assertions and evaluation criteria that tolerate variation without masking real regressions
Experience generating synthetic data for test coverage at scale - realistic conversation transcripts, edge-case inputs, and de-identified patient scenarios
Strong analytical and debugging skills - able to diagnose failures in complex distributed systems
Experience testing APIs, backend services, and event-driven architectures
Track record of raising quality standards across a team, not just writing tests

Nice to have

Experience testing real-time systems, telephony, or voice platforms
Familiarity with LLM evaluation tooling and prompt/model versioning workflows
Experience evaluating speech-to-text or text-to-speech quality
Load/performance testing experience for high-throughput systems
HIPAA-regulated or compliance-heavy environment experience
Experience with contract testing or service virtualization
Top-tier health coverage: medical, dental & vision
401(k)
Paid time off + holidays, and paid parental leave

If you want to fix the front door of healthcare, we'd love to hear from you. Transform9 is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status. Note: the Transform9 team will only email you from a transform9.com email address.

Apply on jobs.workable.com About employer

Report this job

Work requirements

Jobs in the United States