Jobs in the United States

25+ jobs

Group jobs by employerEmail me new jobs Save this search

Added just now
Analytical Innovation & Technology Lead
USA - 3383 Shire Human Genetic Therapies, Inc.
Lexington, MA
…analytical, AI-enabled, and digital laboratory technologies - automation, robotics, PAT, rapid microbiological methods, spectroscopy, imaging, advanced sensors, digital twins, predictive…
Added just now
Automation Engineering Manager
Cybertrol Engineering
Madison, WI · Maple Grove, MN
Cybertrol Engineering creates and delivers custom-engineered automation hardware and software solutions to manufacturing customers throughout the upper Midwest and across the world. The…
Added just now
IT Sustainment Engineer/Systems Administrator
CACI, INC.-FEDERAL
Chantilly, VA
Leverage Python, Ansible and other tools to develop automation and infrastructure as code.
Added just now
Front End Engineer
BigMarker
Chicago, IL
This is a flexible hybrid role, with a minimum of 3 days per week in-person at our Chicago office located by the Merchandise Mart
Added 1 min ago
Software Engineer II
Sony Interactive Entertainment (SIE)
San Mateo, CA
Experience with test automation frameworks (e.g. Appium, Mocha.js, etc.)
Added 1 min ago
Recruiting Manager
Mid-State Machine
Lakeland, FL
Added 1 min ago
TP
Part-Time Energy Savings Program Intern
The Pennsylvania State University
United States
- $16 USD / hour
- Part-time
…retrofitting lighting to LEDs, verifying savings from building automation system commissioning strategies, and estimating savings and payback from installing high-efficiency…
Added 2 mins ago
Senior QA Engineer
Revelation Pharma LLC
Kennesaw, GA
We are hiring a Senior QA Engineer to own quality for Grove. This is a hands-on, automation-first role embedded with the Grove engineering team. You will build and own the test automation…
Added 2 mins ago
Automation Engineer (Starlink Customer Experience)
SpaceX
Redmond, WA
As an Operations Engineer, Automation on the Customer Experience team, you will be responsible for developing, maintaining, and continuously improving both business-critical and…
Added 2 mins ago
Program Controls Spec III
Aerospace
Clearwater, FL
YOU MUST HAVE
Added 3 mins ago
Systems Engineer
BAE Systems
McLean, VA
AI-Integrated Systems Engineer – You leverage AI-assisted engineering tools, digital models, and automation to improve requirements quality, architecture analysis, testing, and delivery…
Added 3 mins ago
Enterprise Cybersecurity Automation Engineer
Booz Allen Hamilton_United States
McLean, VA
Enterprise Cybersecurity Automation EngineerThe Opportunity:
Added 3 mins ago
DevOps Engineer, Lead
Booz Allen Hamilton_United States
Lexington, MA · McLean, VA · San Antonio, TX
Knowledge of creating and improving continuous automation across multiple technical stacks
Added 4 mins ago
Lead Platform Infrastructure Product Engineer
Radiant
San Francisco, CA
You’ll work across compute, networking, storage, Kubernetes, APIs, automation, identity, observability, and developer tooling, partnering closely with product, infrastructure, SRE,…
Added 4 mins ago
Lead Cloud Product Engineer
Radiant
San Francisco, CA
You’ll work across APIs, SDKs, developer tooling, workflows, platform services, integrations, and user-facing product experiences, partnering closely with product, engineering,…
Added 4 mins ago
Senior/Principal Product Manager - Security
Radiant
San Francisco, CA
- Partner with engineering and security teams on secure-by-design architecture, controls, automation, and platform hardening.
Added 4 mins ago
People Partner
Radiant
San Francisco, CA
…and drive continuous improvement through data, technology and automation as Radiant continues to…
Added 4 mins ago
Senior/Principal Product Manager - MLOps
Radiant
San Francisco, CA
- Work with ML engineers, researchers, and platform teams to improve developer experience, automation, and self-service.
Added 4 mins ago
Senior Field Product Engineer
Radiant
San Francisco, CA
- Developer tooling: APIs, SDKs, CLIs, automation
Added 4 mins ago
Senior/Principal Product Manager - Operations
Radiant
San Francisco, CA
You’ll work across CMDB, asset and service inventory, internal APIs, workflow automation, third-party integrations, and platform administration, partnering closely with engineering, SRE,…
Added 4 mins ago
Accountant
Radiant
San Francisco, CA
- Contribute ideas for process improvements and automation - spotting inefficiencies and suggesting ways to work smarter as we scale.
Added 4 mins ago
Infrastructure Tooling & Observability Engineer (UK)
Radiant
San Francisco, CA
A core part of your responsibility will be developing intelligent observability and automation systems, including advanced alerting strategies, anomaly detection, and AI-driven tooling that…
Added 4 mins ago
Manager, Development
Veradigm LLC
Remote, United States
Added 5 mins ago
WI
(USA) Senior Manager, Automation Engineering
Walmart Inc.
United States
- $110,000 to $220,000 USD / year
Role summary: As Senior Manager, Automation Engineering, you will lead the design, integration, and optimization of automation systems to enhance operational efficiency within the supply…
Added 5 mins ago
WI
(USA) Director, Automation Engineering
Walmart Inc.
United States
- $130,000 to $260,000 USD / year
Role summary: The (USA) Director, Automation Engineering leads the development and implementation of advanced automation solutions to enhance supply chain efficiency. This role requires…

Product Content Engineer

Charleston, WV, United States

Apply on usnlx.com About employer

Applications open in a new tab.

Job details

Experience: 5+ years of experience working collaboratively with product, engineering, design, and user research teams
Posting language: English
Posted: Nov 12, 2026

Original job description

Summary:

Product Content Engineering is a horizontal function supporting initiatives across Meta. We partner closely with product and technical teams to solve problems by providing model-centered solutions, setting standards of quality, and building the frameworks that ensure AI-powered experiences actually work for people.We're looking for a Content Engineer who will partner with Meta’s agent tooling team to define model quality standards and target behaviors for Meta’s internal AI assistant - an automated tool driving employee productivity across internal systems, data, and workflows. You'll work at the intersection of evaluation: building the frameworks, rubrics, and pipelines that hold AI outputs to a high standard. You'll assess model behavior and hardness, identify where it falls short, and work cross-functionally with engineering, product, research, and data science teams to make it better.If you're energized by building better AI experiences through rigorous evaluation, thrive in ambiguity, and bring strong editorial and analytical judgment, we encourage you to apply.

Required Skills:

Product Content Engineer Responsibilities:

Define quality standards – how well the model is at taking actions, completing tasks, changing states, asking for permission when needed, etc. and use them to systematically evaluate how AI models are performing for Meta’s internal AI assistant.
Design golden sets, taxonomies, and guidelines that integrate qualitative and quantitative signals.
Build repeatable workflows for collecting, annotating, and analyzing AI outputs so evaluations can run efficiently as models evolve.
Evaluate successive model releases through structured comparison, documenting what improved, what regressed, and what to prioritize next.
Develop processes to track model quality and performance over time and flag regressions.
Synthesize evaluation results into structured error patterns and concrete recommendations that engineering and product teams can act on.
Work cross-functionally with engineering, data science, and product teams to align AI behaviors with real-world user expectations.
Identify and mitigate operational risks - staffing gaps, timeline conflicts, quality regressions - before they impact delivery.

Minimum Qualifications:

Bachelor's degree in Computer Science, Data Science, Linguistics, or a related field, or equivalent practical experience
5+ years of experience working collaboratively with product, engineering, design, and user research teams
2+ years working with generative AI products, AI evaluation, prompt engineering, annotation, and/or labeling and analysis
Experience designing and implementing evaluation frameworks, annotation guidelines, or quality rubrics for agentic systems
Demonstrated data analysis skills, with experience exploring data, identifying patterns, and producing actionable insights
Experience applying critical thinking to lead data-driven analyses that inform product or user experience decisions, and communicating findings to executive leadership
Proven track record of cross-functional collaboration and delivering results in environments with evolving requirements and competing priorities

Preferred Qualifications:

Experience establishing ground truth for text-based agentic workflows (e.g., multi-step reasoning, tool use, end-to-end task completion), including the annotation guidelines and quality rubrics that make evaluations repeatable
Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)
Familiarity with AI evaluation methods such as human eval, model-as-judge, A/B testing, or red-teaming
Experience building dashboards, scripts, or workflows that codify evaluation metrics
Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies
Experience with Python, SQL, or other tools for data analysis and evaluation automation
Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)

Public Compensation:

$162,000/year to $227,000/year + bonus + equity + benefits

Industry: Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@meta.com.

Apply on usnlx.com About employer

More about this job

Skills

Define quality standards
Computer science
Research
Data analysis
Critical thinking
Collaboration
Hazard assessment
Python
SQL

Report this job

Work requirements

Jobs in the United States