Jobs in the United States

25+ jobs

Save this search

Added 1 min ago
O
Senior Principal Oracle Health Systems Engineer - HIE
Oracle
Jefferson City, MO
- $103,000 to $264,100 USD / year
Seeking a highly experienced Senior Principal Systems Engineer to provide technical leadership in the design, operation, maintenance, optimization, and strategic evolution of Health…
Added 4 mins ago
EE
IT Specialist (Systems Analysis/Applications Software)
Equal Employment Opportunity Commission
Washington, DC
- $143,913 to $187,093 USD / year
As an IT Specialist (Systems Analysis/Applications Software) at the GS-2210-14, you will be part of the Mission Applications Management Division (MAMD), Office of the Chief Information…
Added 4 mins ago
AN
SUPERVISORY FACILITY OPERATIONS SPECIALIST
Air National Guard Units
Camp Murray, WA
- $83,935 to $109,122 USD / year
…Maintenance (O&M) programs. Provides critical input to the Base Civil Engineer (BCE), through the CE Commander Facility Investment Matrix (FIM), Base Master Plan, Space Utilization Plan,…
Added 8 mins ago
Mid Career Spaceflight Hardware Propulsion Engineer
Amentum
Houston, TX
…diverse backgrounds to help us envision, shape, and deliver systems that will enable the exploration of space while benefiting people here on Earth. We are excited about what we do, and we…
Added 8 mins ago
Mid Career Spaceflight Hardware Propulsion Engineer
Amentum
Houston, TX
…diverse backgrounds to help us envision, shape, and deliver systems that will enable the exploration of space while benefiting people here on Earth. We are excited about what we do, and we…
Added 8 mins ago
Early Career Spaceflight Hardware Propulsion Engineer
Amentum
Houston, TX
…diverse backgrounds to help us envision, shape, and deliver systems that will enable the exploration of space while benefiting people here on Earth. We are excited about what we do, and we…
Added 8 mins ago
Early Career Spaceflight Hardware Propulsion Engineer
Amentum
Houston, TX
…diverse backgrounds to help us envision, shape, and deliver systems that will enable the exploration of space while benefiting people here on Earth. We are excited about what we do, and we…
Added 10 mins ago
Senior Staff Optical Engineer, Geo
Google
Mountain View, CA
Consummate knowledge of lens and optical systems across physics, materials, and techniques.
Added 13 mins ago
VH
Supervisory Healthcare Engineer
Veterans Health Administration
Kings, NY
- $174,922 to $227,406 USD / year
The Healthcare Engineer provides for a safe, reliable, and precisely controlled operating environment for direct patient care. Healthcare Engineers serve as experts in the design,…
Added 15 mins ago
Manufacturing Engineer 3 - 31037
Huntington Ingalls Industries
Pocasset, MA
The Senior Manufacturing Engineer leads the development, implementation, and sustainment of manufacturing processes for Unmanned Underwater Vehicles (UUVs) in a defense contracting…
Added 15 mins ago
Engineer V
General Atomics
Acton, MA
We currently have an exciting opportunity in our Science & Technology Products’ Systems Engineering Directorate for a Project Engineer to lead engineering and development of cutting-edge…
Added 15 mins ago
Software QA Engineer II Senior - (E2)
Applied Materials
Billerica, MA
Provides feedback in preparation of technical appraisals of programming languages, systems and computation software
Added 15 mins ago
Mechanical Engineer, Staff - E4
Lockheed Martin
Chelmsford, MA
…engaged in the research, design, development, manufacture, integration, and sustainment of advanced technology systems, products, and services. Lockheed Martin Missiles and Fire Control…
Added 16 mins ago
Agentic automation, Frontier AI
Lilly
Boston, MA
You will engineer the connective tissue between Agentic AI and physical lab systems building practical integrations with robotic platforms, analytical instruments, and data pipelines.…
Added 16 mins ago
Electro Acoustic Engineer
Massa Products Corporation
Hingham, MA
Air Ultrasonic Engineer positions available: Working knowledge of the design of transducers and systems in ultrasonic frequencies and how they can be optimized in different environments for…
Added 16 mins ago
EG
Staff AI & Data Engineer – Databricks
Eliassen Group
Boston, MA
- $80 to $90 USD / hour
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the…
Added 21 mins ago
O
Senior Engineer - SCADA and Controls Engineering
Oracle
Jefferson City, MO
- $114,600 to $234,600 USD / year
The Senior Engineer, SCADA and Controls Engineering supports the standardization, design, implementation, and integration of data center controls systems across a global portfolio. This…
Added 22 mins ago
NA
ELECTRICAL ENGINEER
Naval Air Systems Command
Naval Air Station San Diego, CA
- $102,246 to $158,062 USD / year
…specifications for complex low to medium voltage electrical systems, including substations, switchgear, motor control centers (MCC's), transformers, and breaker panels. | You will perform…
Added 25 mins ago
FA
Aerospace Engineer (Direct Hire)
Federal Aviation Administration
Houston, TX · Patrick AFB, FL · Wallops Island, VA · Los Angeles County, CA · Vandenberg AFB, CA · Cape Canaveral AFS, FL · Washington, DC
- $53,528 to $99,683 USD / year
Project Management & Systems Integration: Experience managing or participating in complex, multi-phase space engineering projects through certification, approval, or compliance. Background…
Added 25 mins ago
FA
Aerospace Engineer (Direct Hire)
Federal Aviation Administration
Wallops Island, VA · Patrick AFB, FL · Cape Canaveral AFS, FL · Los Angeles County, CA · Vandenberg AFB, CA · Washington, DC · Houston, TX
- $77,351 to $148,073 USD / year
Project Management & Systems Integration: Experience managing or participating in complex, multi-phase space engineering projects through certification, approval, or compliance. Background…
Added 31 mins ago
EG
Staff AI & Data Engineer – Databricks
Eliassen Group
Pierre, SD
- $80 to $90 USD / hour
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the…
Added 34 mins ago
GI
Senior Software Engineer
GitHub, Inc.
United States
- $127,800 to $339,000 USD / year
As a software engineer at GitHub, you will enhance the collaboration experience at GitHub by working closely with a community of engineers and designers with a distributed, diverse and…
Added 40 mins ago
NF
ENVIRONMENTAL ENGINEER/PHYSICAL SCIENTIST
Naval Facilities Engineering Systems Command
Bangor, WA
- $119,630 to $155,521 USD / year
…program. | You will establish and implement program(s) for the integration of environmental compliance management and pollution prevention into mission operations and facilities management…
Added 1 hour ago
O
Pursuit Manager - Federal
Oracle
Jefferson City, MO
- $21.3 to $33.22 USD / hour
+ Identify and surface candidates for AI-enabled automation as the Applied AI capability comes online; partner with the AI Integration Engineer on pilot workflows.
Added 1 hour ago
Cloud Solution Engineer (Genomics & AI)
Oracle
Jefferson City, MO
The opportunity Oracle is seeking a senior pre-sales engineer with expertise in genomics, software engineering, and applied AI/ML. You will help molecular diagnostics companies, genomics…

Gradientflo Labs

QA Automation Engineer (Founding Team)

San Francisco, CA, United States

$24,000 to $32,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $24,000 to $32,000 USD / year
Posting language: English

Original job description

Role Overview You’ll be the safety net and enabler of speed at Vibecoderz. In a system where AI agents generate artifacts, mini-apps, and real-time interactions, quality isn’t just about correctness - it’s about trust. As the founding QA Automation Engineer, you’ll design frameworks that validate not just code but also AI outputs. From traditional E2E flows to specialized agent evaluation pipelines, you’ll ensure that everything shipping to production meets our gold standard. This role is about building autonomous, self-healing QA systems that scale with our multi-agent platform. You’ll work hand-in-hand with PM, FE, BE, AI, and DevOps to embed quality into every phase of the pipeline using Linear (execution), Notion (test cases/playbooks), and GitHub (CI/CD integration) as your tools of record.

Key Responsibilities

Automation Framework Ownership
Design and implement end-to-end automated test frameworks for FE, BE, and AI agents.
Cover unit, integration, regression, and smoke tests.
Frontend Testing
Build E2E suites for Next.js UI using Playwright or Cypress.
Simulate real-user flows: onboarding, AI tutor interaction, artifact generation.
Backend Testing
Automate FastAPI endpoint validation.
Ensure <100ms response SLA is consistently met.
AI Agent Evals
Develop golden sets for agent responses (TutorAgent, Mini-App Generator, Quiz Generator).
Automate detection of hallucinations, irrelevant answers, or unsafe outputs.
Continuous Testing Integration
Integrate all test suites into GitHub Actions CI/CD pipelines.
Block merges unless all critical tests pass.
Realtime Testing
Validate WebSocket-based real-time interactions (voice transcription, live artifacts).
Create stress tests for multi-user editing and presence.
Security & Reliability Testing
Build automated checks for prompt injection and unsafe code generation.
Implement sandboxed test environments for mini-app execution.
Performance & Load Testing
Benchmark system under 100K concurrent learners.
Identify latency bottlenecks across Pub/Sub and Cloud Run services.
Defect Tracking & Reporting
Use Linear for bug triage and prioritization.
Create dashboards of defect density, test coverage, and agent accuracy.
Culture of Quality
Define QA best practices, playbooks, and documentation in Notion.
Mentor engineers to write better testable code.

Success Metrics

90 Days (Probation):

Automated framework live for FE (Next.js) and BE (FastAPI).
AI TutorAgent “Text → Course” flow covered by golden set evals.
CI/CD pipeline enforces automated test runs before deploy.

12 Months:

85% test automation coverage across platform.
<1% escaped defects in production.
AI agent eval accuracy >90% on golden set outputs.
System proven under 100K concurrent users with <1% error rate.

Must-Haves

10+ years QA automation in SaaS/product engineering.
Strong expertise with Playwright/Cypress, Pytest, Postman/Newman.
Proven experience integrating test suites into CI/CD pipelines.
Familiarity with real-time systems (WebSockets, CRDT/OT).
Deep understanding of QA methodologies: smoke, regression, load, E2E.

Nice-to-Haves

Experience with LLM/AI output evaluation (evals).
Prior startup or founding engineer experience.
Knowledge of security testing (XSS, prompt injection defense).
Contributions to open-source QA frameworks.

Tech Stack Visibility

Frontend: Playwright, Cypress
Backend: Pytest, Postman/Newman
AI Evals: Custom golden set framework, LangSmith/Langfuse for prompt monitoring
CI/CD: GitHub Actions integration
Observability: OpenTelemetry hooks into test reports
Infra: Cloud Run staging environments for test runs

Assessment Objective: Validate ability to design automated test frameworks that cover FE, BE, and AI outputs.

Challenge (Candidate PoC):

Frontend (FE) E2E Test
Write Playwright/Cypress tests for:
User onboarding (sign-up with Google).
Chatting with TutorAgent mock API.
Rendering a Quiz block with answer validation.
Backend (BE) API Test
Write Pytest suite for FastAPI service:
/generate-course endpoint (input: “Teach React Hooks”).
Assert valid JSON structure for output.
AI Agent Eval
Create a golden set with 5 input prompts and expected TutorAgent responses.
Automate comparison with tolerance for natural language variation.
CI/CD Integration
Configure GitHub Actions to run FE + BE + AI eval tests on each PR.
Block merge if any critical tests fail.

Deliverables:

GitHub repo with FE, BE, and AI test suites.
GitHub Actions workflow file with integrated tests.
Golden set JSON for TutorAgent eval.
README documenting design choices and edge cases.

Evaluation Criteria:

Automation Framework Quality (30%)
AI Evals & Innovation (25%)
CI/CD Integration (20%)
Test Coverage & Reliability (15%)
Documentation & Clarity (10%)

Apply About employer

Report this job