About the company Our client is an artificial intelligence company. The role Raydar is recruiting for this role on behalf of our client. Lead quality across life sciences work, defining what expert-level standards look like and building the reviews, evaluation tools and processes that enforce them. The role blends deep subject-matter judgment with hands-on technical work on AI-based review tools, and it is new, so the successful candidate will help shape its scope. What you'll do
- Own quality standards across life sciences projects and define what expert-level output looks like.
- Build quality tooling and systems, including AI-assisted review and automated evaluations.
- Convert subject-matter expertise into automated reviewers that flag the errors an expert would catch.
- Work with senior researchers to turn technical requirements into quality standards and expert-graded reference sets.
- Investigate defects and model failure patterns, identify root causes and improve processes to prevent recurrence.
Requirements
What we're looking for
- 4 or more years of experience, including operations work in a startup environment in a strategic or program lead role.
- Completed or nearly completed PhD in a life sciences field, with substantial research and data analysis experience.
- Background as a scientist or researcher in life sciences.
- Hands-on experience building, testing and refining prompts or evaluations for AI tools.
- Ability to tell genuine expert-level work from work that only appears expert.
- Comfort working through ambiguity and creating structured processes.
- Record of designing scoring methods, review criteria or benchmark answer sets for expert work.
- Experience with AI tools, large language models and frontier models. Bonus points
- Experience at an AI data labeling or evaluation company.
- Skill in presenting technical scientific topics to people outside the field.
Benefits
Compensation and benefits
- Base salary: USD 200,000 to 300,000 per year
- Equity Location and work model
- New York, NY, United States or San Francisco, CA, United States
- On-site, 5 days in-office per week (New York preferred)
- Full-time
