Jobs in the United States

25+ jobs

Save this search

Added just now
Senior Technical Program Manager , AWS Organizations
Amazon
Seattle, WA
You will work with senior product and engineering leaders to define strategy and requirements. You will design, coordinate, and execute technical solutions that scale globally across AWS's…
Added just now
Senior Lead Software Engineer- AI/ML Training Infrastructure
JPMorgan Chase
Seattle, WA
Be an integral part of an agile engineering team that is constantly pushing the boundaries of what is possible across cloud, infrastructure, and AI/ML platforms.
Added just now
U
Senior Systems Engineer, AM&D Services & Products
Uber
Seattle, WA
- $171,000 to $190,000 USD / year
…the intersection of cutting-edge robotics, safety-critical systems, and complex platform integration. This role is on Uber’s Autonomous Mobility and Delivery Safety team and reports to the…
Added just now
Software Development Engineer, Amazon Private Brands
Amazon
Seattle, WA
…connect with the engineers and business partners who rely on the systems you…
Added just now
U
Senior Software Engineer, Capacity & Efficiency Engineering (CEE) - Planning
Uber
Seattle, WA
- $202,000 to $224,000 USD / year
Engineering at Uber means building for real-world impact under real-world constraints. As a Senior Software Engineer on CEE, you will architect the systems that decide how much…
Added just now
AC
Sourcing Manager
Aston Carter
Seattle, WA
- $55 to $65 USD / hour
Bachelors degree in Supply Chain, Logistics, Operations, Business, Engineering, or a related field.
Added just now
Software Development Engineer II, AWS Throttling
Amazon
Seattle, WA
Build production-grade systems that handle millions of requests with low latency and high availability. Design solutions that scale to meet growing customer demands.
Added just now
Technical Program Manager, Annapurna
Amazon
Seattle, WA
…cloud-scale innovation with world-class expertise across silicon engineering, hardware design, verification, software, and…
Added just now
Senior Product Manager, Commerce
Amazon
Seattle, WA
Partner cross-functionally with Engineering, Design, Data Science, Research, and Community teams to deliver products that help streamers succeed and grow their channels
Added just now
Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs
Amazon
Seattle, WA
…AWS. The team covers multiple disciplines including silicon engineering, hardware design and verification, software and…
Added just now
Data Engineer, WW Pricing - Data & Analytics
Amazon
Seattle, WA
Bachelor's degree or foreign equivalent in Computer Science, Engineering, Information Systems, Mathematics, or a related field
Added just now
Senior Global Creator Programs Manager
Amazon
Seattle, WA
Strong operational skills: you build systems, processes, and workflows that scale, and you partner effectively across Product, Engineering, Marketing, and Partnerships
Added just now
Project Engineer
American Bridge Company
Seattle, WA
…movable bridge. The work presents challenging construction engineering and logistical requirements, including complex steel erection, heavy lifting operations, temporary works, mechanical…
Added just now
Software Dev Engineer I, Security Platform
Amazon
Seattle, WA
We're a dynamic group of security engineers passionate about creating resilient, intelligent systems. Our team is committed to developing innovative technologies that protect and empower…
Added just now
SAP Analytics Architect - SAC/Datasphere/BDC
PwC
Seattle, WA
…Business Administration/Management, Computer Science/Information Systems,…
Added just now
Supplier Support Manufacturing Engineer
GE Aerospace
Bellevue, WA · Redmond, WA · Seattle, WA
…cycles. Utilize advanced operational, product management, and engineering techniques to resolve…
Added just now
Cyber SAP Internal Controls Manager/ Engineering Manager II
Deloitte
Seattle, WA
Bachelor's degree in accounting, information systems, business, or a related field
Added just now
Solutions Architect II
Amazon
Seattle, WA
4+ years of specific technology domain areas (e.g. software development, cloud computing, systems engineering, infrastructure, security, networking, data & analytics) experience
Added just now
TW
Sr Manager, Systems Reliability Engineering
The Walt Disney Company
Seattle, WA
- $200,400 to $268,700 USD / year
The Senior Manager of Systems Reliability Engineering (SRE) will lead and develop a high-performing team of managers, leads, and engineers responsible for the reliability, scalability, and…
Added just now
Executive Supply Chain FLIGHT DECK Leader
GE Aerospace
Bellevue, WA · Redmond, WA · Seattle, WA
…Management, Materials Management, Industrial Transformation, and Engineering Material Systems. Reporting to the CES FLIGHT DECK & AI leader with a dotted line to the VP, Supply Chain, this…
Added just now
GA
Principal Technical Product Manager, Data & Platform
GE Aerospace
Bellevue, WA · Redmond, WA · Seattle, WA
- $152,000 to $222,000 USD / year
As part of the GE Aerospace Digital Technology organization supporting the Defense & Systems (D&S) business, the Principal Technical Product Manager, Data & Platform owns the D&S Palantir…
Added just now
Senior Partner Sales Manager - Content (Adobe & Sitecore)
EPAM Systems
Seattle, WA
Added just now
Product Designer
Meta
Seattle, WA · Bellevue, WA
Partner closely with engineering and data science to define what good looks like in agent output across chat, voice and visual surfaces, and drive the eval strategy that measures it
Added just now
Principal Architect- Hypervisors, Operating Systems, & Datacenter
JPMorgan Chase
Seattle, WA
Partners with architects, design authorities and engineering teams across hypervisor platforms, operating systems, storage, networking, cyber and datacenter services, providing…
Added just now
Information Communications & Technology (ICT) Infrastructure Operations Technician
Port of Seattle
Seattle, WA
You will administer identity, authentication, and access management across enterprise systems, including user accounts, directories, email, shared resources, and permissions. You will also…

Gradientflo Labs

Prompt Engineer (Founding Team)

San Francisco, CA, United States

$24,000 to $32,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $24,000 to $32,000 USD / year
Posting language: English

Original job description

Role Overview You will be the language architect of Vibecoderz. The TutorAgent and its family of sub-agents only think as clearly as the prompts that guide them - and you will design those “thought patterns.” As the founding Prompt Engineer, you’ll build a prompt library and evaluation system that ensures Vibecoderz produces consistent, safe, and high-quality artifacts: slides, quizzes, code snippets, and runnable mini-apps. This is a role for a builder of mental scaffolding. You’ll be deeply involved in orchestrating system prompts, tool schemas, chaining strategies, and eval frameworks that make our AI both reliable and delightful. You’ll collaborate with AI Engineers on orchestration, Backend Engineers on schema integration, and PM on defining product outcomes. You’ll use Linear for execution, Notion for prompt specs and experiments, and GitHub for version control, making every iteration observable, testable, and reproducible.

Key Responsibilities

Prompt Library Ownership - Design, version, and maintain system prompts for TutorAgent, PlannerAgent, CodeAgent, QuizAgent, and ContentAgent.
Prompt Chaining & Orchestration - Implement advanced strategies: reflection, planning, few-shot, self-consistency, and tool-use flows.
Schema Definition - Collaborate with BE and AI engineers to define JSON schemas and tool contracts that LLMs must respect.
Evaluation Pipelines - Use LangSmith or Langfuse to build eval frameworks that test accuracy, latency, drift, and hallucination rates.
Performance Optimization - Continuously refine prompts to minimize cost and latency while maximizing reliability and user trust.
Hybrid Model Router Support - Adapt prompt strategies for Gemini Flash vs. Pro vs. Claude depending on use case (speed vs. depth).
Guardrails & Safety - Embed safety layers in prompts to prevent unsafe, biased, or irrelevant outputs.
RAG Integration - Build prompt strategies for retrieval-augmented generation (GitHub docs, MDN, StackOverflow).
Documentation & Experimentation - Maintain prompt playbooks in Notion, documenting rationale, variations, and outcomes for reproducibility.
Cross-Team Collaboration - Work with PM to translate learning flows into prompt chains, AI engineers for orchestration, and QA for regression testing.
Problem Solving - Debug prompt failures, identify root causes (model vs. schema vs. orchestration), and propose iterative solutions.

Success Metrics

90 Days (Probation):

Deliver prompt library v1 for TutorAgent, PlannerAgent, and QuizAgent.
Build baseline LangSmith eval pipeline with at least 20 golden prompts.
Achieve <15% hallucination rate in core flows.

12 Months:

Maintain <5% hallucination rate across all core workflows.
Prompt system powering 10+ specialized agents in production.
Automated regression evals integrated into CI/CD pipeline.
AI outputs powering >50% of artifacts with consistent schema compliance.

Must-Haves

10+ years in NLP, prompt engineering, or applied AI.
Expertise in LLM prompting strategies and evaluation frameworks.
Strong grasp of JSON schema enforcement, tool-use, and prompt chaining.
Proven ability to debug and refine AI outputs in production products.
Product company background with evidence of shipping AI-first systems.

Nice-to-Haves

Contributions to LangChain, CrewAI, or LangSmith open source.
Research background in prompt optimization, LLM evals, or safety.
Prior work on developer-facing AI tutor or EdTech products.
Startup/founding engineer experience.

Tech Stack Visibility

Prompting & Orchestration: LangSmith, Langfuse, Google ADK
Models: Gemini Pro, Gemini Flash, Gemini Vision, Gemini Live API, Claude 3 Opus
Data: Firestore, Redis, Neo4j (schema enforcement targets)
Infra: Cloud Run, Pub/Sub for agent comms
CI/CD: GitHub Actions with prompt regression evals
Tools: Linear (execution), Notion (prompt specs), GitHub (prompt versions)

Assessment Objective: Validate ability to design, evaluate, and optimize a prompt system powering multi-agent tutoring.

Challenge (Candidate PoC):

Design system prompts for:
TutorAgent: teaching “React Hooks.”
QuizAgent: generating 5 MCQs with answers + explanations.
CodeAgent: generating runnable JS snippets.
Implement prompt chaining strategy for:
Outline → Lesson → Quiz → Mini-App.
Build a LangSmith eval pipeline:
Test against 20 golden prompts.
Measure accuracy, latency, hallucination rate, schema compliance.
Optimize:
Compare Gemini Flash vs. Pro routing for cost/latency.
Document tradeoffs and improvements.

Deliverables:

Prompt library (YAML/JSON).
Eval report with metrics table (baseline vs. optimized).
GitHub repo with eval scripts + LangSmith integration.
Notion doc summarizing prompt strategies.
5-min Loom walkthrough of the workflow.

Evaluation Criteria:

Prompt Design & Schema Compliance (30%)
Prompt Chaining & Orchestration Strategy (20%)
Evaluation Pipeline & Metrics (20%)
Performance Optimization (15%)
Documentation & Reproducibility (15%)

Apply About employer

Report this job