Jobs in the United States

25+ jobs

Save this search

Added just now
PL
Collateral Analyst - Alterna
Paychex, LLC
Orlando, FL
- $25.17 to $26 USD / hour
Alterna Capital Solutions is a Paychex Company. Clients will find more than financial solutions with Alterna. We’re a financial partner with a genuine desire to help business owners achieve…
Added just now
New Business Account Executive - East
GitLab
Remote, United States
GitLab is the intelligent orchestration platform for DevSecOps. GitLab enables organizations to increase developer productivity, improve operational efficiency, reduce security and…
Added 1 min ago
P
MTS IV, Software
Panasonic
Irvine, CA
- $112,000 to $188,000 USD / year
…mid-level engineers. Design, develop, and implement data-driven solutions, leveraging machine learning techniques to enhance our In-Flight Entertainment & Connectivity (IFEC) systems.…
Added 1 min ago
Manager, Solutions Architecture | East Coast | Remote
Grafana Labs
Remote, United States
Grafana Labs seeks a dynamic Manager for our Solutions Architects team, one who shares our enthusiasm for driving successful business outcomes in the observability domain. As a Manager of…
Added 1 min ago
Senior Associate - AI Security Engineer
New York Life Insurance Co
United States
…competitive advantage for New York Life's businesses. We build solutions that power how we serve policy owners, agents, advisors and employees while delivering measurable business…
Added 1 min ago
Surveillance Analyst, Corporate Compliance
New York Life Insurance Co
White Plains, NY
As a Fortune 100 mutual company, we offer a place to grow your skills, contribute to meaningful work, and deliver solutions that matter. Your ideas drive what’s next, and your growth powers…
Added 1 min ago
Director - AI Product Manager - AI Controls & Observability
Edward Jones
United States
…standards-based ecosystem, rather than developing one-off or front-end…
Added 2 mins ago
IS
Project Manager – Financial Systems Integration (Azure)
INSPYR Solutions
Deerfield Beach, FL
- $65 to $75 USD / hour
Added 2 mins ago
Sr. System/Test Validation Engineer
Advanced Micro Devices, Inc
Austin, TX
…In this role, you will develop and deploy manufacturing test solutions for industry-leading GPUs used in Artificial Intelligence (AI), Machine Learning (ML), and High-Performance Computing…
Added 2 mins ago
Senior Leadership Technical Program Manager, Data Intelligence, Core Systems
Google
San Jose, CA
…are owners and advocates for the underlying design elements, developer platforms, product components, and infrastructure at Google. These are the essential building blocks for excellent,…
Added 2 mins ago
Package Design Engineer
Google
Sunnyvale, CA
Be part of a team that pushes boundaries, developing custom silicon solutions that power the future of Google's direct-to-consumer products. You'll contribute to the innovation behind…
Added 3 mins ago
Product Application Engineer
Advanced Micro Devices, Inc
Austin, TX
Install and test solutions in-house, as required, to ensure successful deployments and evaluations.
Added 3 mins ago
Director, Customer Program Management Data Center GPU
Advanced Micro Devices, Inc
Bellevue, WA
…tuning and ensure final customer satisfaction for AMD DC GPU solutions. This role will align cross-functional business development, engineering, product, support, and GTM teams to…
Added 4 mins ago
Extended Expertise Consultant
Palo Alto Networks Public Sector, LLC
Remote, United States
Refine and translate complex requirements and execute best practice solutions for automated workflows and playbook development.
Added 5 mins ago
A
Benefits Program Manager - Retirement & ESPP (Hybrid)
AECOM
Houston, TX
- $80,000 to $110,000 USD / year
…private-sector clients to create innovative, sustainable and resilient solutions throughout the project lifecycle – from advisory, planning, design and engineering to program and…
Added 5 mins ago
A
Benefits Program Manager - Retirement & ESPP (Hybrid)
AECOM
Chicago, IL
- $80,000 to $110,000 USD / year
…private-sector clients to create innovative, sustainable and resilient solutions throughout the project lifecycle – from advisory, planning, design and engineering to program and…
Added 5 mins ago
Sr. Product Manager
Safe-Guard Products International LLC
Atlanta, GA
Added 5 mins ago
Microbiologist III
Empower Pharmacy
Houston, TX
Added 6 mins ago
Senior Electrical Engineer
Worley
Monrovia, CA · Long Beach, CA
…they meet today's needs and transition to more sustainable…
Added 6 mins ago
Cloud Sales Specialist
Everpure
Santa Clara, CA
Everpure is seeking a highly motivated Cloud Sales Specialist with experience selling cloud-based solutions into large Enterprise customers. Reporting to the Global Cloud Sales leader, the…
Added 6 mins ago
IG
AI Engineer Architect / FDE (Prototype/POCs)
Insight Global
Chicago, IL
- From $94 USD / hour
…service across four organizations, incubating experimental solutions that are later handed off to domain-specific engineering teams for scaling and…
Added 6 mins ago
IG
AI Engineer Architect / FDE (Prototype/POCs)
Insight Global
Chicago, IL
- From $94 USD / hour
…service across four organizations, incubating experimental solutions that are later handed off to domain-specific engineering teams for scaling and…
Added 7 mins ago
Manager, Merchandising Operations
The RealReal, Inc.
Secaucus 35, NJ
Added 8 mins ago
Robotics Test Release Engineer
Gecko Robotics
Pittsburgh, PA
…of critical infrastructure. Gecko's complete and connected solutions combine wall-climbing robots, industry-leading sensors, and an AI-powered data platform to provide customers with a…
Added 8 mins ago
Staff Forward Deployed Engineer
Databricks
Remote, United States
…state, and local government customers to build and productionize solutions to their data & AI challenges using the Databricks platform. You will manage and lead technical design and…

Gradientflo Labs

Prompt Engineer (Founding Team)

San Francisco, CA, United States

$24,000 to $32,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $24,000 to $32,000 USD / year
Posting language: English

Original job description

Role Overview You will be the language architect of Vibecoderz. The TutorAgent and its family of sub-agents only think as clearly as the prompts that guide them - and you will design those “thought patterns.” As the founding Prompt Engineer, you’ll build a prompt library and evaluation system that ensures Vibecoderz produces consistent, safe, and high-quality artifacts: slides, quizzes, code snippets, and runnable mini-apps. This is a role for a builder of mental scaffolding. You’ll be deeply involved in orchestrating system prompts, tool schemas, chaining strategies, and eval frameworks that make our AI both reliable and delightful. You’ll collaborate with AI Engineers on orchestration, Backend Engineers on schema integration, and PM on defining product outcomes. You’ll use Linear for execution, Notion for prompt specs and experiments, and GitHub for version control, making every iteration observable, testable, and reproducible.

Key Responsibilities

Prompt Library Ownership - Design, version, and maintain system prompts for TutorAgent, PlannerAgent, CodeAgent, QuizAgent, and ContentAgent.
Prompt Chaining & Orchestration - Implement advanced strategies: reflection, planning, few-shot, self-consistency, and tool-use flows.
Schema Definition - Collaborate with BE and AI engineers to define JSON schemas and tool contracts that LLMs must respect.
Evaluation Pipelines - Use LangSmith or Langfuse to build eval frameworks that test accuracy, latency, drift, and hallucination rates.
Performance Optimization - Continuously refine prompts to minimize cost and latency while maximizing reliability and user trust.
Hybrid Model Router Support - Adapt prompt strategies for Gemini Flash vs. Pro vs. Claude depending on use case (speed vs. depth).
Guardrails & Safety - Embed safety layers in prompts to prevent unsafe, biased, or irrelevant outputs.
RAG Integration - Build prompt strategies for retrieval-augmented generation (GitHub docs, MDN, StackOverflow).
Documentation & Experimentation - Maintain prompt playbooks in Notion, documenting rationale, variations, and outcomes for reproducibility.
Cross-Team Collaboration - Work with PM to translate learning flows into prompt chains, AI engineers for orchestration, and QA for regression testing.
Problem Solving - Debug prompt failures, identify root causes (model vs. schema vs. orchestration), and propose iterative solutions.

Success Metrics

90 Days (Probation):

Deliver prompt library v1 for TutorAgent, PlannerAgent, and QuizAgent.
Build baseline LangSmith eval pipeline with at least 20 golden prompts.
Achieve <15% hallucination rate in core flows.

12 Months:

Maintain <5% hallucination rate across all core workflows.
Prompt system powering 10+ specialized agents in production.
Automated regression evals integrated into CI/CD pipeline.
AI outputs powering >50% of artifacts with consistent schema compliance.

Must-Haves

10+ years in NLP, prompt engineering, or applied AI.
Expertise in LLM prompting strategies and evaluation frameworks.
Strong grasp of JSON schema enforcement, tool-use, and prompt chaining.
Proven ability to debug and refine AI outputs in production products.
Product company background with evidence of shipping AI-first systems.

Nice-to-Haves

Contributions to LangChain, CrewAI, or LangSmith open source.
Research background in prompt optimization, LLM evals, or safety.
Prior work on developer-facing AI tutor or EdTech products.
Startup/founding engineer experience.

Tech Stack Visibility

Prompting & Orchestration: LangSmith, Langfuse, Google ADK
Models: Gemini Pro, Gemini Flash, Gemini Vision, Gemini Live API, Claude 3 Opus
Data: Firestore, Redis, Neo4j (schema enforcement targets)
Infra: Cloud Run, Pub/Sub for agent comms
CI/CD: GitHub Actions with prompt regression evals
Tools: Linear (execution), Notion (prompt specs), GitHub (prompt versions)

Assessment Objective: Validate ability to design, evaluate, and optimize a prompt system powering multi-agent tutoring.

Challenge (Candidate PoC):

Design system prompts for:
TutorAgent: teaching “React Hooks.”
QuizAgent: generating 5 MCQs with answers + explanations.
CodeAgent: generating runnable JS snippets.
Implement prompt chaining strategy for:
Outline → Lesson → Quiz → Mini-App.
Build a LangSmith eval pipeline:
Test against 20 golden prompts.
Measure accuracy, latency, hallucination rate, schema compliance.
Optimize:
Compare Gemini Flash vs. Pro routing for cost/latency.
Document tradeoffs and improvements.

Deliverables:

Prompt library (YAML/JSON).
Eval report with metrics table (baseline vs. optimized).
GitHub repo with eval scripts + LangSmith integration.
Notion doc summarizing prompt strategies.
5-min Loom walkthrough of the workflow.

Evaluation Criteria:

Prompt Design & Schema Compliance (30%)
Prompt Chaining & Orchestration Strategy (20%)
Evaluation Pipeline & Metrics (20%)
Performance Optimization (15%)
Documentation & Reproducibility (15%)

Apply About employer

Report this job