Jobs in the United States

25+ jobs

Group jobs by employerEmail me new jobs Save this search

Added just now
INTEGRATION AND AUTOMATION ENGINEER - 1
Liberty Health
Wilmington, NC
Must have a valid driver's license
Added 1 min ago
MD-Scrum Master - TS/SCI w/ Polygraph
Sunayu
Annapolis Junction, MD
Experience applying test automation, test-driven development, continuous integration, and continuous deployment to achieve built-in quality by the team.
Added 2 mins ago
ServiceNow SPM Business Analyst
NTT DATA Services
Plano, TX
Must Reside in the US
Added 2 mins ago
Staff Software Engineer
Overjet
San Mateo, CA
- The reduction of engineering toil. That means building tooling, automation, and structure that save the team time every week.
Added 2 mins ago
Strategic Mission Systems Administrator
GD Information Technology, Inc.
United States
Clearance: Must have a current/active Top Secret clearance with ability to obtain TS/SCI and a CI Poly
Added 2 mins ago
Strategic Mission Systems Administrator
GD Information Technology, Inc.
United States
Clearance: Must have a current/active Top Secret clearance with ability to obtain TS/SCI
Added 2 mins ago
Strategic Mission Systems Administrator
GD Information Technology, Inc.
United States
Clearance: Must have a current/active Top Secret clearance with ability to obtain TS/SCI and a CI Poly
Added 2 mins ago
Network Engineer III
GD Information Technology, Inc.
United States
Utilize advanced routing/switching protocols, firewalls, and modern network automation tools
Added 3 mins ago
Security Engineer (Identity Platforms)
Consumers Energy
JACKSON, MI
Automate security processes where appropriate by leveraging scripting and Security Orchestration, Automation, and Response (SOAR) platforms to enhance efficiency and consistency in incident…
Added 3 mins ago
Vice President of Feed and Nutrition
Passel Farms
Emmetsburg, IA
Evaluate new feed ingredients, nutritional technologies, manufacturing processes, and automation opportunities.
Added 3 mins ago
VP Tech Infrastructure
Coastal Credit Union
Raleigh, NC
Hybrid position, must live locally
Added 4 mins ago
VP, Field Claims
Munich Re Careers
Nashville, TN · Charlotte, NC · Cleveland, OH · Columbus, OH · Denver, CO · Houston, TX · Atlanta, GA · Dallas, TX · Indianapolis, IN · Chicago, IL · Philadelphia, PA · Pittsburgh, PA · Amelia, OH
Advance digital-first field claim capabilities through mobile tools, virtual and remote inspection, workflow automation, data and analytics, and responsible AI-supported decisioning.
Added 5 mins ago
Senior Supplier Quality Engineer
Anduril Industries
Costa Mesa, CA
Added 6 mins ago
OI
Senior Product Designer
Onit, Inc.
Remote, United States
- $135,000 to $150,000 USD / year
Design AI-native and automation-driven experiences
Added 6 mins ago
OI
Senior Product Designer
Onit, Inc.
Remote, United States
- $135,000 to $150,000 USD / year
Design AI-native and automation-driven experiences
Added 7 mins ago
Software Engineer Intern (Year-Round)
VALEO NORTH AMERICA
Troy, MI
AI-Driven Automation: Explore and leverage modern artificial intelligence tools to help optimize CI/CD workflows and improve automated testing procedures.
Added 7 mins ago
Field IT/Systems Engineer
HEICO
Columbia, MD
Experience with Linux, PowerShell scripting, or configuration automation tools.
Added 8 mins ago
BV
MLOps Engineer
Bright Vision Technologies
Sunnyvale / South Bay, CA
- $115,000 to $165,000 USD / year
Bright Vision Technologies is seeking an MLOps Engineer to build and maintain the automation and infrastructure required to develop, deploy, monitor, and manage machine learning models in…
Added 8 mins ago
AVP Business Banking Credit and Systems
PeoplesBank
Holyoke, MA
Identify automation opportunities that improve efficiency, service levels, and scalability.
Added 8 mins ago
Industrial Electrician - Weekend
Shaw
Cartersville, GA
10 Hr non-rotating shift, Hrs fall to in punch day, Observed Calendar, shift starts AM
Added 9 mins ago
IP
Health, Safety, and Environmental Manager
IMI Plc - Legacy Precision
Palmer, MA
- $140,000 to $150,000 USD / year
…control applications. We focus on five market sectors: Industrial Automation, Process Automation, Climate Control, Life Science, and…
Added 9 mins ago
IG
Data Engineer - ETL
Insight Global
Jacksonville, FL
- From $68 USD / hour
Dimensional modeling and data quality automation experience.
Added 9 mins ago
AC
Estimator
AIR Control Concepts
Wichita, KS
- $94,000 to $104,000 USD / year
Building Controls and Services, Inc. (BCS) is an HVAC and building automation company founded in 1985, serving Kansas and Western Missouri. The company provides heating and air…
Added 10 mins ago
Senior Manager, Inspection Readiness - GCP
Genmab
Princeton, NJ
Design and optimize tools and processes for trial inspection readiness, leveraging digitalization and automation to improve efficiency and compliance.
Added 11 mins ago
Chief Clinical AI Officer
Govcio LLC
United States

Closed listing

Product Content Engineer

Tallahassee, FL, United States

This opening has closed.

The original listing is kept below for reference.

Find open jobs More jobs with this employer

About employer

Job details

Experience: 5+ years of experience working collaboratively with product, engineering, design, and user research teams
Posting language: English
Posted: Nov 12, 2026

Similar jobs hiring now

Search current openings

Original job description

Archived listing. The details below describe a past opening.

Summary:

Product Content Engineering is a horizontal function supporting initiatives across Meta. We partner closely with product and technical teams to solve problems by providing model-centered solutions, setting standards of quality, and building the frameworks that ensure AI-powered experiences actually work for people.We're looking for a Content Engineer who will partner with Meta’s agent tooling team to define model quality standards and target behaviors for Meta’s internal AI assistant - an automated tool driving employee productivity across internal systems, data, and workflows. You'll work at the intersection of evaluation: building the frameworks, rubrics, and pipelines that hold AI outputs to a high standard. You'll assess model behavior and hardness, identify where it falls short, and work cross-functionally with engineering, product, research, and data science teams to make it better.If you're energized by building better AI experiences through rigorous evaluation, thrive in ambiguity, and bring strong editorial and analytical judgment, we encourage you to apply.

Required Skills:

Product Content Engineer Responsibilities:

Define quality standards – how well the model is at taking actions, completing tasks, changing states, asking for permission when needed, etc. and use them to systematically evaluate how AI models are performing for Meta’s internal AI assistant.
Design golden sets, taxonomies, and guidelines that integrate qualitative and quantitative signals.
Build repeatable workflows for collecting, annotating, and analyzing AI outputs so evaluations can run efficiently as models evolve.
Evaluate successive model releases through structured comparison, documenting what improved, what regressed, and what to prioritize next.
Develop processes to track model quality and performance over time and flag regressions.
Synthesize evaluation results into structured error patterns and concrete recommendations that engineering and product teams can act on.
Work cross-functionally with engineering, data science, and product teams to align AI behaviors with real-world user expectations.
Identify and mitigate operational risks - staffing gaps, timeline conflicts, quality regressions - before they impact delivery.

Minimum Qualifications:

Bachelor's degree in Computer Science, Data Science, Linguistics, or a related field, or equivalent practical experience
5+ years of experience working collaboratively with product, engineering, design, and user research teams
2+ years working with generative AI products, AI evaluation, prompt engineering, annotation, and/or labeling and analysis
Experience designing and implementing evaluation frameworks, annotation guidelines, or quality rubrics for agentic systems
Demonstrated data analysis skills, with experience exploring data, identifying patterns, and producing actionable insights
Experience applying critical thinking to lead data-driven analyses that inform product or user experience decisions, and communicating findings to executive leadership
Proven track record of cross-functional collaboration and delivering results in environments with evolving requirements and competing priorities

Preferred Qualifications:

Experience establishing ground truth for text-based agentic workflows (e.g., multi-step reasoning, tool use, end-to-end task completion), including the annotation guidelines and quality rubrics that make evaluations repeatable
Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)
Familiarity with AI evaluation methods such as human eval, model-as-judge, A/B testing, or red-teaming
Experience building dashboards, scripts, or workflows that codify evaluation metrics
Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies
Experience with Python, SQL, or other tools for data analysis and evaluation automation
Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)

Public Compensation:

$162,000/year to $227,000/year + bonus + equity + benefits

Industry: Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@meta.com.

About employer

More about this job

Skills

Define quality standards
Computer science
Research
Data analysis
Critical thinking
Collaboration
Hazard assessment
Python
SQL

Report this job

Work requirements

Jobs in the United States