Find work in the United States.

A simpler way to find your next job.

Jobs in the United States

25+ jobs

Save this search

Added 2 mins ago
Community Manager
LDG Development
Austin, TX · austin, TX
As a Community Manager of an affordable housing asset, you are primarily responsible for protecting, maintaining, and enhancing the value of the community while also maximizing the living…
Added 3 mins ago
Area Manager
Mission Linen Supply
Salinas, CA
Administer a recruitment and training program for RSSRs, including initial orientation, product familiarity, company policy, goals, and objectives, plus ongoing coaching on account…
Added 4 mins ago
Quality Systems, Compliance & Safety Manager
TCOM
Columbia, MD
Manage (plan, lead, delegate, control, organize, staff, and coordinate) and optimize the assigned Quality Systems, Compliance & Safety organization across all TCOM, L.P. facilities.…
Added 5 mins ago
EP
Pretrial Services Supervisor
El Paso County
Colorado Springs, CO
- $70,000 to $75,000 USD / year
Works collaboratively with the Program Manager and unit staff to achieve program goals. Provides recommendations for continuous program development and improvement.
Added 6 mins ago
Pediatric Nurse Practitioner | Interventional Radiology
Children's Mercy KC
Kansas City, MO
We are seeking a motivated provider with strong critical thinking skills and a commitment to delivering patient and family-centered care. Training and ongoing clinical support will be…
Added 7 mins ago
Change Implementation Consultant - Payment Manager
B10 Wells Fargo Bank, N. A.
CHARLOTTE, NC · WINSTON SALEM, NC · SALT LAKE CITY, UT · MINNEAPOLIS, MN
Employees support our focus on building strong customer relationships balanced with a strong risk mitigating and compliance-driven culture which firmly establishes those disciplines as…
Added 11 mins ago
Golang Engineer
Bread Financial Payments, Inc
Columbus, OH · Chadds Ford, PA · Frisco, TX · Draper, UT · NY · Wilmington, DE
…based on technical designs, writing clean, efficient code, and executing comprehensive unit tests. Building on foundational experience, this role involves deeper participation in team…
Added 14 mins ago
Associate Director & Counsel, Fighter & Mobility Programs (Remote)
RTX Corporation
east hartford, CT
Collaborate with the attorneys for other Pratt & Whitney program areas (e.g., Military Development Programs) and functional areas (e.g., Global Trade, Intellectual Property, etc.) to ensure…
Added 18 mins ago
Senior Integrated Marketing Manager - Kenra Professional
Henkel group
Culver City · Culver City, CA, CA
The Senior Integrated Marketing Manager leads the integrated marketing team and is responsible for defining the strategies, plans and oversee the execution of the plans that drive brand…
Added 19 mins ago
Exec. Director, Finance Opns.
Atlantic Health System
Morristown, NJ
The position provides executive oversight of Air Medical, Critical Care Transport, Mobile Intensive Care Unit (MICU) operations, Basic Life Support and 9-1-1 EMS operations, contracted…
Added 19 mins ago
Patient Services Manager
Mount Sinai Medical Center of Florida, Inc.
Miami Beach, FL
Ensure the use of established systems to track, manage, and validate staff competencies, including platforms such as Pineapple Academy, Jolt, CBORD (including tablet-based modules), and…
Added 19 mins ago
Dietary Manager
Mount Sinai Medical Center of Florida, Inc.
Miami Beach, FL
Ensure the use of established systems to track, manage, and validate staff competencies, including platforms such as Pineapple Academy, Jolt, CBORD (including tablet-based modules), and…
Added 19 mins ago
GO
Program Manager
Government of the District of Columbia
4058 Minnesota Avenue, NE
- $150,000 USD / year
…Operations Bureau. The mission of DOES is to foster economic development and growth in the District of Columbia by providing workforce training, linking job seekers with employers,…
Added 20 mins ago
Engineering Program Manager
Cisco
Durham, NC
We are seeking an experienced Engineering Program Manager with extensive background in multi-functional and cross business unit program management to lead software Threat Intelligence…
Added 23 mins ago
New Graduate Registered Nurse (RN) - Cellular Immunotherapies and Transplant Inpatient Unit - Rotating
VCUHSA VCU Health System Authority
Richmond, VA
…nurses are automatically enrolled in our VIZIENT Nurse Residency Program, a program designed to support your transition into practice and help you thrive in your first year. In…
Added 24 mins ago
Outpatient Clinician
LAFAYETTE COUNTY HUMAN SERVICES
DARLINGTON, WI
Added 24 mins ago
Community Support Prog. Clinical Coord.
LAFAYETTE COUNTY HUMAN SERVICES
DARLINGTON, WI
Added 24 mins ago
Com Mgr Urg Response Team
The Michaels Organization
Grandview, TX
2. As directed by the RPM/RVP/SVP, coordinate and oversee hiring (for open positions approved by the Regional Property Manager), training, completing and conducting performance evaluations…
Added 25 mins ago
Project Manager (Workforce Liaison III)
Bluegrass Community & Technical College
Lexington, KY
The Project Manager will work with business, industry, and community organizations to identify new accounts, contact clients, assess training needs, conduct presentations, track activity,…
Added 25 mins ago
Tester (Remote)
GovCIO
Madison, WI
GovCIO is currently hiring a Software Development Engineer in Test (SDET), Test Engineer, to join cross-functional product teams building and modernizing federal digital services on AWS…
Added 25 mins ago
Full Stack Developer (Remote)
GovCIO
Madison, WI
Write unit and component tests. Build and maintain Cypress end-to-end tests in the CI/CD pipeline.
Added 26 mins ago
Advanced Practice Provider Pediatric
MCW: SARGEANT HEALTH CENTER
MILWAUKEE, WI
Added 26 mins ago
Advanced Practice Provider Pediatric
MCW: SARGEANT HEALTH CENTER
MILWAUKEE, WI
Added 26 mins ago
Technical Program Manager – RMA & Field Failure Analysis
ALTEN Technology USA
Irvine or Palo Alto, CA · Irvine, CA
As Technical Program Manager – RMA & Field Failure Analysis you will lead a hybrid team (on-site in California and offshore in India) performing RMA triage and field failure analysis on…
Added 37 mins ago
Estates Security Officer Pool & Beach
Estates at Acqualina
Sunny Isles Beach, FL
Competitive Wages • Medical, Dental, Vision Insurance • Life Insurance • 401K Program • Paid Holidays and Vacation • Outstanding Recognition and Awards Program • Effective Training Programs…

Dscout

AI Research Engineer

San Francisco, CA, United States

Apply About employer

Applications open in a new tab.

Job details

Posting language: English
Posted: Oct 29, 2026

Original job description

At Dscout, we’re building the most flexible and powerful UX research platform on the market - trusted by the world’s top brands in finance (JP Morgan Chase, Intuit, Charles Schwab, PayPal), healthcare (Aya, Headspace), consumer goods (Keen, Verizon, Target, Northface), and tech (Google, Amazon, Facebook, Meta, Spotify, AirBnB). Our tools help teams deeply understand the humans behind their products, so they can build better ones. We are expanding our smart and driven team and would love for you to join us.

Dscout AI Training & Evals

Dscout AI Training & Evals builds human data and evals that show whether AI works for real people. For ten years Dscout has captured how people behave in real context, with consent and scientific rigor. AI Training & Evals points that engine at AI: consented human behavior and judgment, turned into the training data, evals, and benchmarks AI teams trust.

Capability has outrun trust. Models ace benchmarks and still surprise people in the wild. A benchmark says how capable a model is. It does not say whether the model works for the person using it, across weeks, in the mess of real life. That gap is where we work.

We serve AI researchers, the product builders who ship alongside them, and the research teams who partner with both. We are a new unit inside an established company: live customers, a mature platform (React, Elixir, Python, Swift, Kotlin; SOC 2 and HITRUST certified), a small senior team, and room to build. We work AI-native. Agents write code, evals gate changes, and we aim to do in months what used to take years.

A note from our Chief AI Officer & GM. The questions that matter most about AI are not answered by a bigger leaderboard. Does a model work for a real person across three weeks of real use? Does a rubric measure what it claims? Does an AI judge agree with the people it stands for? We have a decade of methods for studying people in real context, and we will publish our methods and benchmarks so the field can check our work. Join us to do rigorous science that matters.

Why this seat

Work on a problem the field has not solved: measuring whether AI works for real people, over real time.
Study something most evals do not have: real participants, doing real tasks in their own context.
Own the benchmark. You are founding it, not joining a team that has one.
Publish. Methods and benchmarks go to the research community, with first authorship on the benchmark.
Join a small senior team with direct access to the Head of AI Research and the GM.

Job Description

This is a research-first role focused on questions where the right rubric, benchmark, or method does not yet exist. You will find the gaps, propose bold directions, and take projects from first hypothesis through experiments and benchmark construction to publication. You will also build: the science has to run inside live customer programs.

What you will do

Rubrics and QA science

Design rubrics and test whether they measure what they claim: validity, reliability, and sensitivity.
Measure how reliable human raters are, and when disagreement is noise versus real signal.
Calibrate AI judges against real human judgment, and study when they drift away from it.
Build quality signals that put evidence behind every data point we ship.

Long-horizon, real-user benchmarks

Design Dscout’s first benchmark: real users, in real context, over long horizons. Multi-week tasks across tools, not one-shot prompts.
Define the protocol, task design, scoring, and release. Work with our delivery team on fieldwork.
Work out how to keep a living benchmark honest over time: drift, contamination, difficulty, and what counts as a meaningful change.
Write the paper and own the public release.

Human judgment as training and eval signal

Study when real-world human feedback improves a model and when it adds noise.
Explore how preference and judgment data from representative people differ from expert data.
Turn findings into methods our forward deployed engineers and delivery team can run in the field.

New research directions

These areas are the core, not the whole list. You will have significant latitude to propose new programs, such as calibrating user simulations against real behavior, human-AI collaboration, and behavioral evaluation of agents.
Co-author with outside labs and academics on studies that need real-user data. Help run our paper-reading group.

A good first year

A QA and rubric framework running on live customer programs, with documented validity.
Benchmark v0 released, with a paper submitted to a top venue.
At least one external team using or citing our work.
Delivery colleagues using your methods without needing you in the room.

How we will hire: a conversation with the Head of AI Research; a research talk on a project you led; a design exercise (how would you validate a rubric for a long-horizon task?); a conversation with the GM, forward deployed engineers, and delivery partners.

Requirements

What we care about most. A strong publication record helps. We care most about whether you can find the question that matters, design a rigorous way to answer it, and move fast enough that the answer is still useful.

What you bring

Published research, or strong preprints and workshop papers, in evals, preference learning, reward modeling, human-AI interaction, measurement, or agent evaluation.
A PhD, a PhD in progress, or an MS with two or more strong research internships at labs or top industry groups. If you do not have advanced degrees but have a history of creative machine learning research work, this is just as desirable.
Strong applied statistics: inter-rater reliability, confidence intervals, power, and a nose for when a metric misleads.
Hands-on experience with LLM-as-judge, rubric-based evaluation, and preference data.
Strong Python, and the ability to build research prototypes and evaluation pipelines other people run. You use AI coding tools as a real part of your workflow.
Experience running experiments on messy human data, not only curated datasets.
Clear technical writing, and the ability to explain your work to a lab researcher and to a product manager.
Based in the Bay Area.

Nice to have: long-horizon or agentic evaluation work; psychometrics, item response theory, or human-subjects research; open-source benchmark or dataset contributions.

Compensation: $250-400K OTE + Equity. Includes a built-in bonus and equity program, publication freedom, a conference budget, flexible PTO, 15 holidays, 12 weeks of paid parental leave, 401k match, and an education stipend.

This is an ideal list. If the role excites you and you do not check every box, we would still love to hear from you. Of course, what is outlined above is an ideal set of expectations; however, business needs and other projects and tasks may shift, and additional tasks could be assigned at the discretion of your manager.

About Dscout

Dscout is a team of passionate, empathetic, and curious professionals. As a recognized leader in the Forrester Wave, we’re at the cutting edge of experience research technology. The power of research drives us - how in-context insights from real people can build more enjoyable products and services.

We prioritize learning, sharing, and building. We also deeply value being a diverse and inclusive team and company and look for team members who align with that belief. Join our dynamic team and help shape product roadmaps and business strategies for the world’s most loved brands.

It doesn't stop there. When you join the Dscout team, you will get:

A strong and competitive compensation package with a built-in bonus and equity program.
An incredible and progressive benefits package (for both you and your dependents) to support work/life balance, including flexible PTO, 15 company holidays, 12 weeks of paid parental leave, 401k match, and much more.
An education stipend to support your growth & development, and a remote work stipend.
A company that is open and transparent with our team. You will know what is happening and why it matters.

Dscout is an equal-opportunity employer that values diversity. We do not discriminate based on identity, including race, color, religion, national origin or ancestry, sex, gender identity and expression, age, physical or mental disability, pregnancy, veteran or military status, unfavorable discharge from military service, genetic information, sexual orientation, marital status, order of protection status, citizenship status, arrest record or expunged or sealed convictions, or any other legally recognized protected basis under federal, state, or local law.

If you need reasonable accommodations for any part of the employment process, please email us at accommodations@dscout.com with the nature of your request and your contact information. We'll do everything possible to ensure you're well-prepared for success during our interview process, while also upholding your privacy, including accommodating any special requests. Please note that only inquiries regarding requests for reasonable accommodation will be responded to from this email address.

When you apply at Dscout, we will process your job applicant data, including your employment and education history, transcript, writing samples, and references, as necessary to consider your job application for open positions. For more information about our privacy practices, please visit our Privacy Policy.

Dscout participates in the E-Verify program in certain locations, as required by law.

Location Flexibility: Dscout is proud to support a remote-first workforce and enable employees to work from almost anywhere. At this time, however, we are unable to hire in the following locations: Montana, Hawaii, Alaska, and Washington DC.

NOTE: DSCOUT NEVER CONTACTS JOB APPLICANTS VIA TEXT, MESSENGER, OR OTHER SIMILAR APPLICATIONS. BE AWARE OF PHISHING AND SPOOFING SCAMS, BOTH VIA TEXT AND EMAIL. ONLY RESPOND TO EMAILS FROM DSCOUT.COM

Apply About employer

More about this job

Skills

Research
PayPal
Collaboration
Machine learning
Statistics
Python
Workflow
Technical writing

Report this job