Jobs in the United States

25+ jobs

Save this search

Added 2 mins ago
Systems Engineer - Electronic Security Systems
Chenega Corporation
Falls Church, VA
The Systems Engineer, Electronic Security Systems (ESS) serves as the senior technical authority responsible for the engineering, integration, sustainment, modernization, and continuous…
Added 2 mins ago
C-sUAS Systems Engineer
Chenega Corporation
Arlington, VA
The C-sUAS Systems Engineer provides technical expertise and operational support for Counter-Small Unmanned Aircraft Systems (C-sUAS) detection technologies. This role is responsible for…
Added 2 mins ago
Principal Engineer I - AI Engineering
Western Alliance Bank
Phoenix, AZ · Dallas, TX
…other AI-assisted engineering capabilities. As a Principal Engineer I, you will partner with Development, Architecture, DevOps, Quality Engineering, Security, Cloud and Governance teams to…
Added 5 mins ago
Senior Core Infrastructure Engineer - OCI Product Catalog (Nashville-TN)
Oracle
Nashville, TN
…automation/IaC for troubleshooting and maintenance, and applies advanced security controls (encryption, access, remediation) while ensuring change, compliance, and documentation standards…
Added 5 mins ago
SME Network and Computer Systems Administrator
Goldbelt, Inc.
Oklahoma City, OK
…port/protocol/service (PPS) documentation, and control implementations for the System Security Plan (SSP) and Authorization…
Added 7 mins ago
MT
System Safety Engineer
Modern Technology Solutions Inc
El Segundo, CA · El Segundo
- $114,000 to $141,000 USD / year
Modern Technology Solutions, Inc. (MTSI) is seeking a System Safety Engineer to join our team in El Segundo, CA. In this position, your work will have a profound impact on the country’s…
Added 7 mins ago
MT
Principal Program Systems Integration Engineer
Modern Technology Solutions Inc
El Segundo, CA · El Segundo
- $140,000 to $200,000 USD / year
Modern Technology Solutions, Inc. (MTSI) is seeking a Principal Program Systems Integration Engineer to join our team in El Segundo, CA. Due to security requirements, work is required to be…
Added 8 mins ago
Technical Enablement Engineer
Apple
Seattle, WA
We’re looking for a Technical Enablement Engineer to help engineers across Apple build secure software with confidence. In this role, you will close the gap between security guidance and…
Added 8 mins ago
Security Engineer - Developer Experience
Apple
Seattle, WA
We're looking for a Developer Experience Security Engineer to help engineers across Apple build secure software with confidence, closing the gap between security guidance and engineering…
Added 9 mins ago
Senior Mobile Android Engineer (Engineer III)
The Elevance Health Companies, Inc.
United States
The Senior Mobile Android Engineer (Engineer III) is responsible for the delivery of end-to-end system development and maintenance on complex technology systems within assigned client…
Added 12 mins ago
Staff Cloud Engineer, ML Ops
Modernizing Medicine, Inc.
Boca Raton, FL
As a Staff MLOps Engineer at Modernizing Medicine, you’ll help bridge the gap between data science, machine learning engineering, and production systems. You’ll lead efforts to establish…
Added 12 mins ago
Staff Engineer, Databricks Platform
Modernizing Medicine, Inc.
Boca Raton, FL
We are seeking a hands-on Senior/Staff Data Platform Engineer to own and evolve our established Databricks platform on AWS. The platform supports mission-critical data, analytics, and AI…
Added 13 mins ago
SL
Systems Administrator, Systems & Application IT
Salt Lake Community College (UT)
Salt Lake City, UT
- $87,499.54 to $97,842.27 USD / year
Engineers and/or oversees the implementation of server systems projects, with an emphasis on Linux system administration. Installs, configures, operates, and maintains server…
Added 14 mins ago
SW
Central IT Services Supervisor
State Water Resources Control Board
CA
- $8,504 to $11,395 USD / month
…including Business Technology Management, Client Services, and System…
Added 15 mins ago
C Sharp / .Net Developer
Charles Schwab Inc.
Austin, TX · Southlake, TX
As a Software Development Engineer on the Transaction Posting System (TPS) team, you will help power one of Schwab’s most business-critical platforms, supporting high-volume transaction…
Added 18 mins ago
Senior Cloud DevOps Engineer - Top SECRET - FULLY ONSITE
VISUAL SOFT, INC
Huntsville, AL
We are seeking an experienced Senior Cloud DevOps Engineer to support the design, automation, deployment, and maintenance of mission-critical cloud infrastructure in a classified AWS…
Added 18 mins ago
Mid Level Cloud Developer - Top SECRET - FULLY ONSITE
VISUAL SOFT, INC
Huntsville, AL
We are seeking an experienced Mid Level Cloud DevOps Engineer to support the design, automation, deployment, and maintenance of mission-critical cloud infrastructure in a classified AWS…
Added 19 mins ago
Avionics Systems Engineer III TS/SCI (345B)
JPL/NASA
Pasadena, CA
…avionics subsystem avionics concepts, implementing avionics system architecture designs, designing and ensuring implementation of hardware for flight projects, and supporting project…
Added 20 mins ago
IT Infrastructure & DevOps Engineer
TETRAMEM INC
San Jose, CA
Solid understanding of networking, security, access control, and system monitoring.
Added 20 mins ago
Field Service Technician II - Spokane, WA.
NCR Atleos
United States
Manage network faults, system access, security settings, and remote connectivity
Added 20 mins ago
Senior System Software Engineer - Factory Bringup
NVIDIA USA
Remote, United States
…SBIOS, VBIOS, NIC and other components, version validation, security provisioning, and power-cycle recovery and retry handling. Your goal is a high first-pass yield at…
Added 21 mins ago
I
Senior Machine Learning Engineer, Agentic Context Retrieval and Search (Nova)
Iterable
Remote, United States
- $150,000 to $250,000 USD / year
…Intelligence, the AI layer of our platform, all with enterprise-grade security and compliance. Today, nearly 1,200 brands across 50+ countries rely on Iterable to drive growth, deepen…
Added 22 mins ago
SP
Electrical Engineer
Systems Planning and Analysis
Dahlgren, VA
- $80,000 USD / year
Systems Planning and Analysis, Inc. (SPA) delivers high-impact, technical solutions to complex national security issues. With over 50 years of business expertise and consistent growth, we…
Added 24 mins ago
EW
Senior Security Engineer
East West Bank
Dallas, TX · San Marino, CA
- $115,000 USD / year
The Cyber Security Engineer supports the development and maintenance of a corporate-wide information security program to help protect the organization’s information assets. This role is…
Added 24 mins ago
Software Engineer - Load Balancing
Cloudflare
Austin, TX · NY · San Francisco, CA
Cloudflare is a system spanning the globe, on a mission to make the Internet better, safer, and more powerful every day. As a Software Engineer at Cloudflare, you’ll work on the code that…

Gradientflo Labs

QA Automation Engineer (Founding Team)

San Francisco, CA, United States

$24,000 to $32,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $24,000 to $32,000 USD / year
Posting language: English

Original job description

Role Overview You’ll be the safety net and enabler of speed at Vibecoderz. In a system where AI agents generate artifacts, mini-apps, and real-time interactions, quality isn’t just about correctness - it’s about trust. As the founding QA Automation Engineer, you’ll design frameworks that validate not just code but also AI outputs. From traditional E2E flows to specialized agent evaluation pipelines, you’ll ensure that everything shipping to production meets our gold standard. This role is about building autonomous, self-healing QA systems that scale with our multi-agent platform. You’ll work hand-in-hand with PM, FE, BE, AI, and DevOps to embed quality into every phase of the pipeline using Linear (execution), Notion (test cases/playbooks), and GitHub (CI/CD integration) as your tools of record.

Key Responsibilities

Automation Framework Ownership
Design and implement end-to-end automated test frameworks for FE, BE, and AI agents.
Cover unit, integration, regression, and smoke tests.
Frontend Testing
Build E2E suites for Next.js UI using Playwright or Cypress.
Simulate real-user flows: onboarding, AI tutor interaction, artifact generation.
Backend Testing
Automate FastAPI endpoint validation.
Ensure <100ms response SLA is consistently met.
AI Agent Evals
Develop golden sets for agent responses (TutorAgent, Mini-App Generator, Quiz Generator).
Automate detection of hallucinations, irrelevant answers, or unsafe outputs.
Continuous Testing Integration
Integrate all test suites into GitHub Actions CI/CD pipelines.
Block merges unless all critical tests pass.
Realtime Testing
Validate WebSocket-based real-time interactions (voice transcription, live artifacts).
Create stress tests for multi-user editing and presence.
Security & Reliability Testing
Build automated checks for prompt injection and unsafe code generation.
Implement sandboxed test environments for mini-app execution.
Performance & Load Testing
Benchmark system under 100K concurrent learners.
Identify latency bottlenecks across Pub/Sub and Cloud Run services.
Defect Tracking & Reporting
Use Linear for bug triage and prioritization.
Create dashboards of defect density, test coverage, and agent accuracy.
Culture of Quality
Define QA best practices, playbooks, and documentation in Notion.
Mentor engineers to write better testable code.

Success Metrics

90 Days (Probation):

Automated framework live for FE (Next.js) and BE (FastAPI).
AI TutorAgent “Text → Course” flow covered by golden set evals.
CI/CD pipeline enforces automated test runs before deploy.

12 Months:

85% test automation coverage across platform.
<1% escaped defects in production.
AI agent eval accuracy >90% on golden set outputs.
System proven under 100K concurrent users with <1% error rate.

Must-Haves

10+ years QA automation in SaaS/product engineering.
Strong expertise with Playwright/Cypress, Pytest, Postman/Newman.
Proven experience integrating test suites into CI/CD pipelines.
Familiarity with real-time systems (WebSockets, CRDT/OT).
Deep understanding of QA methodologies: smoke, regression, load, E2E.

Nice-to-Haves

Experience with LLM/AI output evaluation (evals).
Prior startup or founding engineer experience.
Knowledge of security testing (XSS, prompt injection defense).
Contributions to open-source QA frameworks.

Tech Stack Visibility

Frontend: Playwright, Cypress
Backend: Pytest, Postman/Newman
AI Evals: Custom golden set framework, LangSmith/Langfuse for prompt monitoring
CI/CD: GitHub Actions integration
Observability: OpenTelemetry hooks into test reports
Infra: Cloud Run staging environments for test runs

Assessment Objective: Validate ability to design automated test frameworks that cover FE, BE, and AI outputs.

Challenge (Candidate PoC):

Frontend (FE) E2E Test
Write Playwright/Cypress tests for:
User onboarding (sign-up with Google).
Chatting with TutorAgent mock API.
Rendering a Quiz block with answer validation.
Backend (BE) API Test
Write Pytest suite for FastAPI service:
/generate-course endpoint (input: “Teach React Hooks”).
Assert valid JSON structure for output.
AI Agent Eval
Create a golden set with 5 input prompts and expected TutorAgent responses.
Automate comparison with tolerance for natural language variation.
CI/CD Integration
Configure GitHub Actions to run FE + BE + AI eval tests on each PR.
Block merge if any critical tests fail.

Deliverables:

GitHub repo with FE, BE, and AI test suites.
GitHub Actions workflow file with integrated tests.
Golden set JSON for TutorAgent eval.
README documenting design choices and edge cases.

Evaluation Criteria:

Automation Framework Quality (30%)
AI Evals & Innovation (25%)
CI/CD Integration (20%)
Test Coverage & Reliability (15%)
Documentation & Clarity (10%)

Apply About employer

Report this job