Jobs in the United States

25+ jobs

Save this search

Added 22 mins ago
GP
Software Engineer - Full Stack
Global Payment Holdi
Denver, CO
- $91,900 to $130,000 USD / year
Make your mark at one of the biggest names in payments. We're looking for a Software Engineer to join our ever-evolving Portal team and help shape the future of global commerce
Added 32 mins ago
Electrical Engineer - East Tawas Area
The Pivot Group Network
East Tawas · East Tawas, MI
Facilities Electrical Engineer, Controls Engineer, Automation Engineer, Electrical Design Engineer, Manufacturing Engineer, Maintenance Engineer, Instrumentation and Controls Engineer,…
Added 46 mins ago
Member of Technical Staff, Security
Wafer
San Francisco, CA
We're looking for a hands-on security engineer to help secure the systems behind our inference cloud. You'll work directly with engineers to find weaknesses, build practical protections and…
Added 50 mins ago
Electrical Engineer - Monroe Area
The Pivot Group Network
Monroe · Monroe, MI
Manufacturing Engineer, Maintenance Engineer, Instrumentation and Controls Engineer, Electrical Project Engineer, Process Controls Engineer, Facilities Electrical Engineer, Controls…
Added 56 mins ago
System Test Engineer - Level 3 or 4
Northrop Grumman
Huntsville, AL
The selected Engineer will support the Ground-based Midcourse Defense (GMD) Weapon System (GWS) program as an individual contributor on the Architecture and Delivery (A&D) Automated Test…
Added 1 hour ago
Sr Prin Security Engineer
Consumers Energy
JACKSON, MI
The Senior Principal Security Engineer will support the organization’s most critical security initiatives, serving as both a technical expert and strategic leader. This role is responsible…
Added 2 hours ago
Field System Technician
Bechtel Corporation
Millersport, OH
Assist the EPC Automation Lead in coordinating with the Project Field Engineer, project IS&T Lead, and other automation leads (procurement and project controls, commissioning, etc.), as…
Added 2 hours ago
Site Reliability Manager, Android SRE
Google
San Francisco, CA
Much of our software development focuses on optimizing existing systems, building infrastructure and eliminating work through automation. On the SRE team, you’ll have the opportunity to…
Added 2 hours ago
Staff Software Engineer, Site Reliability Engineering, Raxium
Google
Fremont, CA
2 years of experience building automation scripts using Python or Terraform.
Added 2 hours ago
AWS DevOps/Security Engineer Senior/Architect
Jobgether
Remote, United States
We are seeking a highly experienced AWS DevOps/Security Engineer Senior/Architect to design, build, secure, and operate enterprise-scale cloud environments. This role plays a critical part…
Added 3 hours ago
Field System Technician
Bechtel
Millersport, OH
Assist the EPC Automation Lead in coordinating with the Project Field Engineer, project IS&T Lead, and other automation leads (procurement and project controls, commissioning, etc.), as…
Added 3 hours ago
CI
Embedded Software Test Automation Engineer
Cintal, Inc.
Chillicothe, IL
- $90,000 to $110,000 USD / year
…leveraging advanced technologies to reduce product costs, shorten design and development lead times, and accelerate the introduction of high-quality products to the…
Added 3 hours ago
Senior Lead Engineer - Design Verification
Altera Corporation
San Jose, CA
Altera is seeking a Senior Lead Engineer - Design Verification to provide hands-on technical leadership for the verification of next-generation FPGA, programmable SoC, and platform…
Added 4 hours ago
O
Senior Network Developer
Oracle
Seattle, WA · Nashville, TN · Redwood City, CA · Santa Clara, CA · Reston, VA
- $91,400 to $187,000 USD / year
As a Sr Network Development Engineer, you will be responsible for helping design, build, test, deploy and operate highly scalable solutions to support Oracle’s next-generation Cloud…
Added 4 hours ago
Software Engineer- Semiconductor Technology (C#/.NET)
Keysight Technologies, Inc.
Santa Rosa, CA
Our team, part of Keysight Laboratories' High Frequency Technology Center (HFTC), is a software development group. We design and build custom software used across Keysight's Santa Rosa…
Added 4 hours ago
Senior Software Engineer - Cloud SaaS - IE&A
Jobgether
Remote, United States
We are looking for an experienced Senior Software Engineer to help build and scale a new cloud-based SaaS platform from the ground up, serving the welding and fabrication industry. In this…
Added 4 hours ago
Electrical Engineer, RDPI
Amazon
Westboro, MA
As an Electrical Engineer on our team, you will design industrial control panels, select and integrate sensors and components, and develop electrical systems for packaging and sortation…
Added 5 hours ago
J
Lead Site Reliability Engineer
Jobgether
Remote, United States
- $150,000 to $175,000 USD / year
In this role, you will play a key leadership role in driving cloud infrastructure modernization, automation, and operational excellence. You will design, build, and maintain scalable…
Added 5 hours ago
DS
(1119604) Lead Software Engineer - Emerging Technologies
Diversified Services Network, Inc.
Remote, United States
- $140,000 to $145,000 USD / year
Diversified Services Network, Inc. (DSN) is seeking a full-time Lead Software Engineer – Emerging Technologies to join our team in your choice of our Chicago, IL; Peoria, IL; Irving, TX; or…
Added 5 hours ago
DS
(1119604) Lead Software Engineer - Emerging Technologies
Diversified Services Network, Inc.
Remote, United States
- $140,000 to $145,000 USD / year
Diversified Services Network, Inc. (DSN) is seeking a full-time Lead Software Engineer – Emerging Technologies to join our team in your choice of our Chicago, IL; Peoria, IL; Irving, TX; or…
Added 5 hours ago
DS
(1119604) Lead Software Engineer - Emerging Technologies
Diversified Services Network, Inc.
Remote, United States
- $140,000 to $145,000 USD / year
Diversified Services Network, Inc. (DSN) is seeking a full-time Lead Software Engineer – Emerging Technologies to join our team in your choice of our Chicago, IL; Peoria, IL; Irving, TX; or…
Added 5 hours ago
DS
(1119604) Lead Software Engineer - Emerging Technologies
Diversified Services Network, Inc.
Remote, United States
- $140,000 to $145,000 USD / year
Diversified Services Network, Inc. (DSN) is seeking a full-time Lead Software Engineer – Emerging Technologies to join our team in your choice of our Chicago, IL; Peoria, IL; Irving, TX; or…
Added 5 hours ago
Operations Analyst
Celsius
Boca Raton, FL
Joyful by design, sunny by nature, and unapologetically bold. If your bestie has you saved in their phone as “Icon,” you’re ALANI NU® - confident, colorful, and bringing main-character…
Added 5 hours ago
Senior Backend Engineer - India
Lighthouz AI
Remote, United States
We're looking for a Backend Engineer with familiarity with front end tech to join our fast-growing engineering team. You'll play a key role in building and scaling the core infrastructure…
Added 5 hours ago
Z
Software Quality Engineer
ZipLiens
Franklin, TN
- $77,000 to $104,000 USD / year
…funds more quickly and accurately. We are looking for a quality engineer who is passionate about building the testing and evaluation that keeps complex, data-heavy products working…

Gradientflo Labs

QA Automation Engineer (Founding Team)

San Francisco, CA, United States

$24,000 to $32,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $24,000 to $32,000 USD / year
Posting language: English

Original job description

Role Overview You’ll be the safety net and enabler of speed at Vibecoderz. In a system where AI agents generate artifacts, mini-apps, and real-time interactions, quality isn’t just about correctness - it’s about trust. As the founding QA Automation Engineer, you’ll design frameworks that validate not just code but also AI outputs. From traditional E2E flows to specialized agent evaluation pipelines, you’ll ensure that everything shipping to production meets our gold standard. This role is about building autonomous, self-healing QA systems that scale with our multi-agent platform. You’ll work hand-in-hand with PM, FE, BE, AI, and DevOps to embed quality into every phase of the pipeline using Linear (execution), Notion (test cases/playbooks), and GitHub (CI/CD integration) as your tools of record.

Key Responsibilities

Automation Framework Ownership
Design and implement end-to-end automated test frameworks for FE, BE, and AI agents.
Cover unit, integration, regression, and smoke tests.
Frontend Testing
Build E2E suites for Next.js UI using Playwright or Cypress.
Simulate real-user flows: onboarding, AI tutor interaction, artifact generation.
Backend Testing
Automate FastAPI endpoint validation.
Ensure <100ms response SLA is consistently met.
AI Agent Evals
Develop golden sets for agent responses (TutorAgent, Mini-App Generator, Quiz Generator).
Automate detection of hallucinations, irrelevant answers, or unsafe outputs.
Continuous Testing Integration
Integrate all test suites into GitHub Actions CI/CD pipelines.
Block merges unless all critical tests pass.
Realtime Testing
Validate WebSocket-based real-time interactions (voice transcription, live artifacts).
Create stress tests for multi-user editing and presence.
Security & Reliability Testing
Build automated checks for prompt injection and unsafe code generation.
Implement sandboxed test environments for mini-app execution.
Performance & Load Testing
Benchmark system under 100K concurrent learners.
Identify latency bottlenecks across Pub/Sub and Cloud Run services.
Defect Tracking & Reporting
Use Linear for bug triage and prioritization.
Create dashboards of defect density, test coverage, and agent accuracy.
Culture of Quality
Define QA best practices, playbooks, and documentation in Notion.
Mentor engineers to write better testable code.

Success Metrics

90 Days (Probation):

Automated framework live for FE (Next.js) and BE (FastAPI).
AI TutorAgent “Text → Course” flow covered by golden set evals.
CI/CD pipeline enforces automated test runs before deploy.

12 Months:

85% test automation coverage across platform.
<1% escaped defects in production.
AI agent eval accuracy >90% on golden set outputs.
System proven under 100K concurrent users with <1% error rate.

Must-Haves

10+ years QA automation in SaaS/product engineering.
Strong expertise with Playwright/Cypress, Pytest, Postman/Newman.
Proven experience integrating test suites into CI/CD pipelines.
Familiarity with real-time systems (WebSockets, CRDT/OT).
Deep understanding of QA methodologies: smoke, regression, load, E2E.

Nice-to-Haves

Experience with LLM/AI output evaluation (evals).
Prior startup or founding engineer experience.
Knowledge of security testing (XSS, prompt injection defense).
Contributions to open-source QA frameworks.

Tech Stack Visibility

Frontend: Playwright, Cypress
Backend: Pytest, Postman/Newman
AI Evals: Custom golden set framework, LangSmith/Langfuse for prompt monitoring
CI/CD: GitHub Actions integration
Observability: OpenTelemetry hooks into test reports
Infra: Cloud Run staging environments for test runs

Assessment Objective: Validate ability to design automated test frameworks that cover FE, BE, and AI outputs.

Challenge (Candidate PoC):

Frontend (FE) E2E Test
Write Playwright/Cypress tests for:
User onboarding (sign-up with Google).
Chatting with TutorAgent mock API.
Rendering a Quiz block with answer validation.
Backend (BE) API Test
Write Pytest suite for FastAPI service:
/generate-course endpoint (input: “Teach React Hooks”).
Assert valid JSON structure for output.
AI Agent Eval
Create a golden set with 5 input prompts and expected TutorAgent responses.
Automate comparison with tolerance for natural language variation.
CI/CD Integration
Configure GitHub Actions to run FE + BE + AI eval tests on each PR.
Block merge if any critical tests fail.

Deliverables:

GitHub repo with FE, BE, and AI test suites.
GitHub Actions workflow file with integrated tests.
Golden set JSON for TutorAgent eval.
README documenting design choices and edge cases.

Evaluation Criteria:

Automation Framework Quality (30%)
AI Evals & Innovation (25%)
CI/CD Integration (20%)
Test Coverage & Reliability (15%)
Documentation & Clarity (10%)

Apply About employer

Report this job