Jobs in the United States

25+ jobs

Group jobs by employerEmail me new jobs Save this search

Added just now
ML Infrastructure Engineer, Autonomy (All Levels)
Rivian
Palo Alto, CA
Analysis of requirements, architecture, design, development, code review, quality assurance, and deployment of entire software engineering life cycle
Added 2 mins ago
Software Engineer, Infrastructure - Central Growth
Meta
Jefferson City, MO
Software Engineer, Infrastructure - Central Growth Responsibilities:
Added 7 mins ago
Electrical Design Engineer / Principal Electrical Design Engineer
Northrop Grumman
Oklahoma City, OK
Must have experience developing electrical designs using tools such as Visio, AutoCAD, or similar design software tools
Added 7 mins ago
Member of Product Staff
Meta
Oklahoma City, OK
Maximize efficiency in a constantly evolving environment where the process is fluid and creative solutions are the norm.
Added 7 mins ago
Lead Director - Security Operations Center (SOC)
CVS Health
Oklahoma City, OK
…purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger – helping to simplify health care one person, one family…
Added 7 mins ago
AI Native Data and Knowledge Architect - Senior Manager
EY
Oklahoma City, OK · Tulsa, OK
To qualify you must have
Added 7 mins ago
Technical Engineer
Highmark Health
Oklahoma City, OK
…analysts, and engineers to build and optimize solutions, ensuring quality, integrity, and performance. The ideal candidate is adaptable, solution-oriented, and capable of collaborating…
Added 7 mins ago
AI/ML Engineer Intern
Intermountain Health
Oklahoma City, OK
…lives possible”; making healthcare more affordable and higher quality; and making a difference in the patients and communities it serves. As a Data Science Intern, you will work as a member…
Added 7 mins ago
Product Content Engineer
Meta
Oklahoma City, OK
…by providing model-centered solutions, setting standards of quality, and building the frameworks that ensure AI-powered experiences actually work for people.We're looking for a Content…
Added 7 mins ago
Product Security Engineer - Team Lead
Meta
Oklahoma City, OK
Product Security Engineer - Team Lead Responsibilities:
Added 7 mins ago
C
Senior SDET / QA Automation Engineer (Playwright, Selenium, Java & Cucumber)
Cognizant
Oklahoma City, OK
- $62,500 to $99,000 USD / year
We are seeking a Senior SDET / QA Automation Engineer (Playwright, Selenium, Java & Cucumber) to join our Quality Engineering team supporting a leading healthcare client. The ideal…
Added 9 mins ago
Data Engineer - Remote
Mindex
Remote, United States
…to enhance productivity, accelerate problem-solving, improve quality, automate routine tasks, and drive innovation in the delivery of solutions and…
Added 17 mins ago
Senior Information Systems Security Engineer - Security Control Assessor (SCA)
Peraton
Quantico, VA
Peraton is seeking an Information Systems Security Engineer (ISSE) – Security Control Assessors (SCA) to support an established federal enterprise cybersecurity program. The team will…
Added 17 mins ago
Senior Information Systems Security Engineer - Security Control Assessor (SCA)
Peraton
Washington, DC
Peraton is seeking an Information Systems Security Engineer (ISSE) – Security Control Assessors (SCA) to support an established federal enterprise cybersecurity program. The team will…
Added 20 mins ago
Information Management Engineer
SAIC
Remote, United States
We are seeking a detail-oriented and organized Information Management Engineer to enter, quality-assure, and publish metadata and content for published reports across custom-built content…
Added 20 mins ago
Lead Director - Security Operations Center (SOC)
CVS Health
Washington Dc, DC
…purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger – helping to simplify health care one person, one family…
Added 20 mins ago
Member of Product Staff
Meta
Washington, DC
Maximize efficiency in a constantly evolving environment where the process is fluid and creative solutions are the norm.
Added 20 mins ago
Backend Application Engineer
Accenture
Washington, DC
A Backend Application Engineer who enjoys turning complex business and mission needs into dependable enterprise software. You build the services, APIs, business logic, data interactions,…
Added 20 mins ago
Software Engineer and Data Automation Specialist
U. S. Sentencing Commission
Washington, DC
For example, to qualify for the JS-13, one (1) year of specialized experience must have been at the GS-12 level or equivalent
Added 20 mins ago
AI Native Data and Knowledge Architect - Senior Manager
EY
Washington, DC
To qualify you must have
Added 20 mins ago
Senior Water & Wastewater Project Engineer
Consor Engineers
Riverside, CA
Location: Candidates must reside in California and hold an active California PE license
Added 20 mins ago
Senior Water & Wastewater Project Engineer
Consor Engineers
Santa Clara, CA
Location: Candidates must reside in California and hold an active California PE license
Added 20 mins ago
Senior Water & Wastewater Project Engineer
Consor Engineers
San Francisco, CA
Location: Candidates must reside in California and hold an active California PE license
Added 20 mins ago
Senior Water & Wastewater Project Engineer
Consor Engineers
Oakland, CA
Location: Candidates must reside in California and hold an active California PE license
Added 20 mins ago
Senior Water & Wastewater Project Engineer
Consor Engineers
Walnut Creek, CA
Location: Candidates must reside in California and hold an active California PE license

Product Content Engineer

Washington, DC, United States

Apply on usnlx.com About employer

Applications open in a new tab.

Job details

Experience: 5+ years of experience working collaboratively with product, engineering, design, and user research teams
Posting language: English
Posted: Nov 12, 2026

Original job description

Summary:

Product Content Engineering is a horizontal function supporting initiatives across Meta. We partner closely with product and technical teams to solve problems by providing model-centered solutions, setting standards of quality, and building the frameworks that ensure AI-powered experiences actually work for people.We're looking for a Content Engineer who will partner with Meta’s agent tooling team to define model quality standards and target behaviors for Meta’s internal AI assistant - an automated tool driving employee productivity across internal systems, data, and workflows. You'll work at the intersection of evaluation: building the frameworks, rubrics, and pipelines that hold AI outputs to a high standard. You'll assess model behavior and hardness, identify where it falls short, and work cross-functionally with engineering, product, research, and data science teams to make it better.If you're energized by building better AI experiences through rigorous evaluation, thrive in ambiguity, and bring strong editorial and analytical judgment, we encourage you to apply.

Required Skills:

Product Content Engineer Responsibilities:

Define quality standards – how well the model is at taking actions, completing tasks, changing states, asking for permission when needed, etc. and use them to systematically evaluate how AI models are performing for Meta’s internal AI assistant.
Design golden sets, taxonomies, and guidelines that integrate qualitative and quantitative signals.
Build repeatable workflows for collecting, annotating, and analyzing AI outputs so evaluations can run efficiently as models evolve.
Evaluate successive model releases through structured comparison, documenting what improved, what regressed, and what to prioritize next.
Develop processes to track model quality and performance over time and flag regressions.
Synthesize evaluation results into structured error patterns and concrete recommendations that engineering and product teams can act on.
Work cross-functionally with engineering, data science, and product teams to align AI behaviors with real-world user expectations.
Identify and mitigate operational risks - staffing gaps, timeline conflicts, quality regressions - before they impact delivery.

Minimum Qualifications:

Bachelor's degree in Computer Science, Data Science, Linguistics, or a related field, or equivalent practical experience
5+ years of experience working collaboratively with product, engineering, design, and user research teams
2+ years working with generative AI products, AI evaluation, prompt engineering, annotation, and/or labeling and analysis
Experience designing and implementing evaluation frameworks, annotation guidelines, or quality rubrics for agentic systems
Demonstrated data analysis skills, with experience exploring data, identifying patterns, and producing actionable insights
Experience applying critical thinking to lead data-driven analyses that inform product or user experience decisions, and communicating findings to executive leadership
Proven track record of cross-functional collaboration and delivering results in environments with evolving requirements and competing priorities

Preferred Qualifications:

Experience establishing ground truth for text-based agentic workflows (e.g., multi-step reasoning, tool use, end-to-end task completion), including the annotation guidelines and quality rubrics that make evaluations repeatable
Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)
Familiarity with AI evaluation methods such as human eval, model-as-judge, A/B testing, or red-teaming
Experience building dashboards, scripts, or workflows that codify evaluation metrics
Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies
Experience with Python, SQL, or other tools for data analysis and evaluation automation
Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)

Public Compensation:

$162,000/year to $227,000/year + bonus + equity + benefits

Industry: Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@meta.com.

Apply on usnlx.com About employer

Report this job

Work requirements

Jobs in the United States