Jobs in the United States

25+ jobs

Save this search

Added 9 mins ago
M
Software Engineer II - CTJ - TS/SCI
Microsoft
VA · WA · Reston, VA · Redmond, WA · Reston · Redmond
- $102,100 to $219,200 USD / year
Microsoft has an exciting opportunity for a Software Engineer in the Cloud+AI Silver Team. This team will be responsible for deploying and operating a Secure Work Area, including the…
Added 12 mins ago
Critical Infrastructure Engineer (MF1)
Experis USA
Marshfield, MO
Our client, Critical Infrastructure is seeking a Critical Infrastructure Engineer (MF1) to join their team. As a Critical Infrastructure Engineer (MF1), you will be part of the Engineering…
Added 14 mins ago
G
Maintenance Engineer
GPAC
Maple Grove, MN
- $34 to $41 USD / hour
A global leader in food processing technology is seeking a Maintenance Engineer to join its technical applications team.
Added 14 mins ago
G
Maintenance Engineer
GPAC
Minnetonka, MN
- $34 to $41 USD / hour
A global leader in food processing technology is seeking a Maintenance Engineer to join its technical applications team.
Added 14 mins ago
G
Maintenance Engineer
GPAC
Eden Prairie, MN
- $34 to $41 USD / hour
A global leader in food processing technology is seeking a Maintenance Engineer to join its technical applications team.
Added 14 mins ago
G
Maintenance Engineer
GPAC
New Hope, MN
- $34 to $41 USD / hour
A global leader in food processing technology is seeking a Maintenance Engineer to join its technical applications team.
Added 14 mins ago
G
Maintenance Engineer
GPAC
New Hope, MN
- $34 to $41 USD / hour
A global leader in food processing technology is seeking a Maintenance Engineer to join its technical applications team.
Added 15 mins ago
G
Maintenance Engineer
GPAC
Champlin, MN
- $34 to $41 USD / hour
A global leader in food processing technology is seeking a Maintenance Engineer to join its technical applications team.
Added 15 mins ago
G
Maintenance Engineer
GPAC
Wayzata, MN
- $34 to $41 USD / hour
A global leader in food processing technology is seeking a Maintenance Engineer to join its technical applications team.
Added 15 mins ago
G
Maintenance Engineer
GPAC
St Louis Park, MN
- $34 to $41 USD / hour
A global leader in food processing technology is seeking a Maintenance Engineer to join its technical applications team.
Added 15 mins ago
G
Maintenance Engineer
GPAC
Mound, MN
- $34 to $41 USD / hour
A global leader in food processing technology is seeking a Maintenance Engineer to join its technical applications team.
Added 15 mins ago
G
Maintenance Engineer
GPAC
Shakopee, MN
- $34 to $41 USD / hour
A global leader in food processing technology is seeking a Maintenance Engineer to join its technical applications team.
Added 17 mins ago
GI
Lead Backend Engineer
Gardens Interactive
Remote, United States
- $196,000 to $203,000 USD / year
- Own reliability, service level objectives, incident response, and infrastructure cost.
Added 19 mins ago
TT
Mid/Senior Full Stack AI Engineer
True Talent Solutions Partners
San Francisco, CA
- $180,000 to $250,000 USD / year
- Build and operate production AI agents for quoting, pricing, and cross-sell workflows, including orchestration, evaluation, and reliability.
Added 21 mins ago
M
Technical Support Engineer
Microsoft
TX · NC · WA · Irving, TX · Charlotte, NC · Redmond, WA · Irving · Charlotte · Redmond
- $86,100 to $187,400 USD / year
…delivering customer success. As a Senior Technical Support Engineer, you will own, troubleshoot, and solve complex customer technical issues. This opportunity will allow you to accelerate…
Added 21 mins ago
M
Electrical Engineer
Microsoft
WA · Redmond, WA · Redmond
- $119,800 to $261,000 USD / year
We are seeking a Subject Matter Expert Electrical Engineer to join Microsoft Cloud Operations and Innovation (CO&I). CO&I is the team behind the cloud. Within CO&I, the Datacenter…
Added 21 mins ago
M
Principal Software Engineer
Microsoft
WA · NY · CA · Redmond, WA · Mountain View, CA · Sunnyvale, CA · Redmond · New York · Mountain View · Sunnyvale
- $142,800 to $304,200 USD / year
As a Principal Software Engineer, on the Substrate Application Platform team, you will help build the next generation platform for internal and external developers and agents to access M365…
Added 21 mins ago
M
Principal Software Engineer - Cloud Infrastructure & AI Systems
Microsoft
WA · TX · OR · CA · NC · Redmond, WA · Austin, TX · Hillsboro, OR · Mountain View, CA · Raleigh, NC · Redmond · Austin · Hillsboro · Mountain View · Raleigh
- $142,800 to $304,200 USD / year
…global infrastructure. We are seeking a Principal Software Engineer to architect and deliver highly scalable cloud services that enable firmware lifecycle management across multiple…
Added 21 mins ago
M
Principal Software Engineer
Microsoft
United States
- $165,600 to $331,200 USD / year
…through production validation, with a focus on scalability, reliability, security, and measurable customer…
Added 21 mins ago
M
Senior Software Engineer
Microsoft
WA · GA · Redmond, WA · Atlanta, GA · Redmond · Atlanta
- $119,800 to $261,000 USD / year
Design and deliver AI-powered capabilities using large language models, with a focus on effective context management, reliability, and measurable customer value.
Added 21 mins ago
M
Senior Software Engineer - Networking
Microsoft
WA · Redmond, WA · Redmond
- $119,800 to $261,000 USD / year
…protocols, packet processing, connection management, performance, reliability, and network security. You will analyze complex networking behavior using packet captures, telemetry, tracing,…
Added 21 mins ago
M
Principal Hardware Engineer
Microsoft
WA · CA · OR · NC · TX · Redmond, WA · Mountain View, CA · Hillsboro, OR · Raleigh, NC · Austin, TX · Redmond · Mountain View · Hillsboro · Raleigh · Austin
- $142,800 to $304,200 USD / year
We are looking for a Principal Hardware Engineer to join the team.
Added 21 mins ago
M
Senior Hardware Engineer
Microsoft
CA · WA · TX · NC · OR · Mountain View, CA · Redmond, WA · Austin, TX · Raleigh, NC · Hillsboro, OR · Mountain View · Redmond · Austin · Raleigh · Hillsboro
- $119,800 to $261,000 USD / year
…AI, and agentic workflows. We are looking for a Sr. Hardware Engineer to solve challenging hardware, firmware, software, and system-level problems across Microsoft’s Global Azure Cloud…
Added 21 mins ago
M
*Child* Senior Software Engineer
Microsoft
United States
- $119,800 to $261,000 USD / year
…continuously innovate to improve the agility, scalability, reliability, security, and cost-effectiveness of our…
Added 25 mins ago
Staff Systems Engineer - AV Platform
General Motors
Jefferson City, MO
As a Senior Systems Engineer, you will be at the heart of this transformation-leading systems engineering efforts that ensure seamless integration of sensors and compute platforms. This…

Gradientflo Labs

QA Automation Engineer (Founding Team)

San Francisco, CA, United States

$24,000 to $32,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $24,000 to $32,000 USD / year
Posting language: English

Original job description

Role Overview You’ll be the safety net and enabler of speed at Vibecoderz. In a system where AI agents generate artifacts, mini-apps, and real-time interactions, quality isn’t just about correctness - it’s about trust. As the founding QA Automation Engineer, you’ll design frameworks that validate not just code but also AI outputs. From traditional E2E flows to specialized agent evaluation pipelines, you’ll ensure that everything shipping to production meets our gold standard. This role is about building autonomous, self-healing QA systems that scale with our multi-agent platform. You’ll work hand-in-hand with PM, FE, BE, AI, and DevOps to embed quality into every phase of the pipeline using Linear (execution), Notion (test cases/playbooks), and GitHub (CI/CD integration) as your tools of record.

Key Responsibilities

Automation Framework Ownership
Design and implement end-to-end automated test frameworks for FE, BE, and AI agents.
Cover unit, integration, regression, and smoke tests.
Frontend Testing
Build E2E suites for Next.js UI using Playwright or Cypress.
Simulate real-user flows: onboarding, AI tutor interaction, artifact generation.
Backend Testing
Automate FastAPI endpoint validation.
Ensure <100ms response SLA is consistently met.
AI Agent Evals
Develop golden sets for agent responses (TutorAgent, Mini-App Generator, Quiz Generator).
Automate detection of hallucinations, irrelevant answers, or unsafe outputs.
Continuous Testing Integration
Integrate all test suites into GitHub Actions CI/CD pipelines.
Block merges unless all critical tests pass.
Realtime Testing
Validate WebSocket-based real-time interactions (voice transcription, live artifacts).
Create stress tests for multi-user editing and presence.
Security & Reliability Testing
Build automated checks for prompt injection and unsafe code generation.
Implement sandboxed test environments for mini-app execution.
Performance & Load Testing
Benchmark system under 100K concurrent learners.
Identify latency bottlenecks across Pub/Sub and Cloud Run services.
Defect Tracking & Reporting
Use Linear for bug triage and prioritization.
Create dashboards of defect density, test coverage, and agent accuracy.
Culture of Quality
Define QA best practices, playbooks, and documentation in Notion.
Mentor engineers to write better testable code.

Success Metrics

90 Days (Probation):

Automated framework live for FE (Next.js) and BE (FastAPI).
AI TutorAgent “Text → Course” flow covered by golden set evals.
CI/CD pipeline enforces automated test runs before deploy.

12 Months:

85% test automation coverage across platform.
<1% escaped defects in production.
AI agent eval accuracy >90% on golden set outputs.
System proven under 100K concurrent users with <1% error rate.

Must-Haves

10+ years QA automation in SaaS/product engineering.
Strong expertise with Playwright/Cypress, Pytest, Postman/Newman.
Proven experience integrating test suites into CI/CD pipelines.
Familiarity with real-time systems (WebSockets, CRDT/OT).
Deep understanding of QA methodologies: smoke, regression, load, E2E.

Nice-to-Haves

Experience with LLM/AI output evaluation (evals).
Prior startup or founding engineer experience.
Knowledge of security testing (XSS, prompt injection defense).
Contributions to open-source QA frameworks.

Tech Stack Visibility

Frontend: Playwright, Cypress
Backend: Pytest, Postman/Newman
AI Evals: Custom golden set framework, LangSmith/Langfuse for prompt monitoring
CI/CD: GitHub Actions integration
Observability: OpenTelemetry hooks into test reports
Infra: Cloud Run staging environments for test runs

Assessment Objective: Validate ability to design automated test frameworks that cover FE, BE, and AI outputs.

Challenge (Candidate PoC):

Frontend (FE) E2E Test
Write Playwright/Cypress tests for:
User onboarding (sign-up with Google).
Chatting with TutorAgent mock API.
Rendering a Quiz block with answer validation.
Backend (BE) API Test
Write Pytest suite for FastAPI service:
/generate-course endpoint (input: “Teach React Hooks”).
Assert valid JSON structure for output.
AI Agent Eval
Create a golden set with 5 input prompts and expected TutorAgent responses.
Automate comparison with tolerance for natural language variation.
CI/CD Integration
Configure GitHub Actions to run FE + BE + AI eval tests on each PR.
Block merge if any critical tests fail.

Deliverables:

GitHub repo with FE, BE, and AI test suites.
GitHub Actions workflow file with integrated tests.
Golden set JSON for TutorAgent eval.
README documenting design choices and edge cases.

Evaluation Criteria:

Automation Framework Quality (30%)
AI Evals & Innovation (25%)
CI/CD Integration (20%)
Test Coverage & Reliability (15%)
Documentation & Clarity (10%)

Apply About employer

Report this job