Open jobs in the United States

Save this search

Added 9 mins ago
TT
Senior Enterprise Account Executive
True Talent Solutions Partners
Boston, MA
- $115,000 to $140,000 USD / year
Added 9 mins ago
TT
Founding Senior Engineer
True Talent Solutions Partners
New York, NY
- $175,000 to $225,000 USD / year
Added 9 mins ago
TT
Product Lead
True Talent Solutions Partners
New York, NY
- $200,000 to $225,000 USD / year
Added 9 mins ago
TT
Forward Deployed Engineer
True Talent Solutions Partners
San Francisco, CA
- $165,000 to $250,000 USD / year
Added 42 mins ago
TT
Senior Backend Software Engineer
True Talent Solutions Partners
San Francisco, CA
- $200,000 to $400,000 USD / year
Added 42 mins ago
TT
Staff Product Manager
True Talent Solutions Partners
New York, NY
- $180,000 to $250,000 USD / year
Added 42 mins ago
Founding Product Designer
True Talent Solutions Partners
San Francisco, CA
Added 42 mins ago
TT
Member of Technical Staff, Applied Researcher
True Talent Solutions Partners
New York, NY
- $300,000 to $500,000 USD / year
Added 42 mins ago
TT
Senior Security Engineer
True Talent Solutions Partners
San Francisco, CA
- $190,000 to $250,000 USD / year
Added 1 hour ago
TT
Senior Solutions Engineer, Digital Native and Mid-Market
True Talent Solutions Partners
Remote, United States
- $147,000 to $175,000 USD / year
Added 1 hour ago
TT
Product Engineer
True Talent Solutions Partners
Remote, United States
- $185,000 to $485,000 USD / year
Added 1 hour ago
TT
Senior/Staff Product Engineer, Applied AI
True Talent Solutions Partners
San Francisco, CA
- $200,000 to $300,000 USD / year
Added 1 hour ago
TT
Software Engineer, C++ Systems
True Talent Solutions Partners
San Francisco, CA
- $250,000 to $325,000 USD / year
Added 1 hour ago
TT
Senior Software Engineer
True Talent Solutions Partners
San Francisco, CA
- $200,000 to $240,000 USD / year
Added 1 hour ago
TT
Member of Technical Staff, AI Agents
True Talent Solutions Partners
New York, NY
- $150,000 to $300,000 USD / year
Added 1 hour ago
TT
Trusts and Estates Associate
True Talent Solutions Partners
Atlanta, GA
- $235,000 to $300,000 USD / year
Added 1 hour ago
TT
Litigator / Transactional Attorney, HOA Law
True Talent Solutions Partners
Los Angeles, CA
- $155,000 to $195,000 USD / year
Added 1 hour ago
TT
Litigation Associate
True Talent Solutions Partners
New York City, NY
- $125,000 to $165,000 USD / year
Added 1 hour ago
TT
Case Investigation Attorney, Securities Class Action
True Talent Solutions Partners
Boston, MA
- $160,000 to $220,000 USD / year
Added 1 hour ago
TT
Bankruptcy Attorney (Debtor Litigation), Partner or Senior Associate
True Talent Solutions Partners
New York, NY
- $275,000 to $400,000 USD / year
Added 1 hour ago
TT
Lead Software Engineer, Platform
True Talent Solutions Partners
San Francisco, CA
- $220,000 to $320,000 USD / year
Added 1 hour ago
TT
Senior Litigation Attorney
True Talent Solutions Partners
Eagle, ID
- $130,000 to $150,000 USD / year
Added 2 hours ago
TT
Civil Litigation Associate or Partner
True Talent Solutions Partners
Fishkill, NY
- $150,000 to $200,000 USD / year
Added 2 hours ago
TT
Technical Product Manager
True Talent Solutions Partners
Sunnyvale, CA
- $150,000 to $250,000 USD / year
Added 2 hours ago
TT
Senior Forward Deployed Engineer
True Talent Solutions Partners
Redwood City, CA
- $215,000 to $290,000 USD / year

True Talent Solutions Partners

Research Engineer, Evals

San Francisco, CA, United States

$250,000 to $290,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $250,000 to $290,000 USD / year
Posting language: English
Posted: Nov 1, 2026

Original job description

ABOUT THE ROLE

Build evaluation systems for a web data extraction product, defining and measuring output quality across diverse websites, formats, and edge cases. You will own the process from evaluation methodology and datasets through to insights that inform model and product decisions.

WHAT YOU'LL DO

Design metrics that define high-quality structured extraction across varied web pages and data formats.
Build scalable pipelines and evaluation harnesses to measure output quality rigorously.
Generate and curate trustworthy datasets with reference extractions and ground-truth labels.
Connect evaluation results to model and product decisions, closing the feedback loop.
Make evaluation findings actionable for the broader team.

WHAT WE'RE LOOKING FOR

Four or more years of relevant experience, including at least two years working on evaluation systems.
Strong Python skills and experience with machine learning, LLMs, data pipelines, web scraping, NLP, evaluation frameworks, and statistical analysis.
Experience designing and building evaluations for LLM-based structured extraction from messy, real-world web pages or documents, including field-level accuracy measurement at scale.
Background building or evaluating large-scale web or document extraction systems and creating ground-truth datasets.
Statistical rigor in metric design and interpretation, including sampling, significance, estimator bias and variance, error bounds, and judge-to-human agreement.
Ability to combine research methodology with hands-on engineering and use evaluation results to guide real model or product changes.

COMPENSATION & BENEFITS

Base salary range: $250,000 to $290,000 USD annually. Visa sponsorship is available.

LOCATION

Hybrid, based in San Francisco, California. The role requires working on-site five days per week in San Francisco or Toronto.

Apply About employer

More about this job

Skills

Research
Grading systems
Python
Machine learning
Natural language processing
Statistics
Scientific research methodology

Report this job