Jobs in the United States

25+ jobs

Save this search

Added 4 mins ago
Senior Accounting Manager
LaunchDarkly
Remote, United States
As Senior Accounting Manager, you’ll play a key role in strengthening the financial operations behind that work: owning critical close and technical accounting activities, supporting…
Added 6 mins ago
Engineering Document Control Manager
Teledyne Defense Electronics, LLC
Hawthorne, CA
…Quality, and Manufacturing. As Engineering Document Control Manager, you will lead the people, systems, and processes that turn critical technical information into accurate, secure, and…
Added 6 mins ago
Manager, Software Development Engineer
Equinix LLC
United States
Equinix is looking for a Manager, Software Engineer to lead the team that builds and supports our channel and partner systems. The platforms include Salesforce Partner Relationship…
Added 7 mins ago
Associate Director, Client Systems Integration
Alteva RCM
Queens, NY
Work with the Epic Program Manager, who provides dedicated Epic specialization, to coordinate on Epic-based clients.
Added 8 mins ago
Manager, Software Engineering (Marketing Technology)
Columbia Sportswear Company
Portland, OR
Columbia Sportswear is seeking an Engineering Manager, Marketing Technology to lead a team responsible for delivering the platforms and capabilities that power customer engagement across…
Added 12 mins ago
Senior Guidewire Policy Center Scrum Master
American Family Insurance - Corporate
Madison, WI
Working knowledge of Guidewire PolicyCenter workflows, product configuration, integrations, and production support processes within an insurance technology environment.
Added 12 mins ago
Product Owner LMS/ LCMS
Remote, United States
…custom LMS and LCMS platforms, including learner experience, manager experience, admin workflows, course delivery, content lifecycle, assignments, completions, certificates, compliance…
Added 13 mins ago
P
Senior Security Operations Engineer
Pilotbase
Remote, United States
- $120,000 to $130,000 USD / year
…the evidence our compliance programs depend on. The Security Manager sets the standards, you make them real, and show that they hold. You will work across endpoints, cloud, identity,…
Added 15 mins ago
Sr. Principal Enterprise Wide Applications Analyst
CORP-Corporate Office
Remote, United States
…Overhaul Operations and will report to the Sustainment Solutions Manager. This is a remote/virtual…
Added 15 mins ago
PI
Sr Manager, System Analysis and Technical Delivery
PayPal, Inc.
Scottsdale, AZ · UT
- $152,500 to $226,600 USD / year
The Senior Manager, Systems Analysis and Technical Delivery will lead technical requirements, systems analysis, technical product delivery, and user acceptance testing for PayPal Bank…
Added 15 mins ago
Sentinel PLM Systems Engineering Manager 3- 20054
CORP-Corporate Office
United States
Provide technical leadership and decision-making over all engineering disciplines. The PLM Program Manager owns the end-to-end technical baseline, multi-year roadmap, and project portfolio…
Added 15 mins ago
U
Applications Developer II - EPM
Uber
New York City, NY
- $153,000 to $170,000 USD / year
…business leaders. This role is supported by a Lead Product Manager who oversees the EPM portfolio, and you will work alongside other application developers who own other critical financial…
Added 16 mins ago
Product Manager, Senior
Booz Allen Hamilton_United States
Washington, DC
…puts it to work. We are looking for a startup-minded Product Manager who is also the team's product owner and Scrum Master. You'll own the backlog, run the sprint cadence, write epics and…
Added 17 mins ago
IT Manager
NexTech Solutions LLC
Huntsville, AL
…Department of State and Department of War customers. The IT Manager runs NTS corporate IT day to day: infrastructure, endpoints, identity, collaboration tools, business systems, and the…
Added 18 mins ago
Manager, Marketing Automation
Zelis Healthcare, LLC
United States
Maintain platform governance, documentation, suppression logic, property standards, integrations and quality assurance.
Added 18 mins ago
MANAGER CUSTOMER MARKETING PROGRAMS & DELIVERY
Sally
Plano, TX
The Manager, Customer Marketing Programs & Delivery supports the successful execution of Customer Marketing initiatives across CRM, Loyalty, Personalization, Customer Data, and Marketing…
Added 18 mins ago
HRIS Senior Specialist
ICANN
Los Angeles, CA
Working closely with the Senior HRIS Manager, this position provides hands-on functional and technical support for HR systems, staff data, reporting, integrations, system testing, and…
Added 20 mins ago
I
IT Salesforce Development Manager
IDBNY
NYC, NY
- $170,000 to $190,000 USD / year
The Bank is seeking a qualified individual to serve as IT Application Manager responsible for the Salesforce platform and related customer engagement applications. This role serves as the…
Added 20 mins ago
MANAGER CUSTOMER MARKETING PROGRAMS & DELIVERY
CosmoProf
Plano, TX
The Manager, Customer Marketing Programs & Delivery supports the successful execution of Customer Marketing initiatives across CRM, Loyalty, Personalization, Customer Data, and Marketing…
Added 20 mins ago
Lead Technical Program Manager - Payments
JPMC page
Tampa, FL · Plano, TX · Seattle, WA
As a Lead Technical Program Manager in Commercial & Investment Bank - Payments team, you will drive the successful delivery of complex technology projects and programs that will help…
Added 20 mins ago
Sr. Product Manager, Strategic Growth – Data Capture Technologies & Partnerships
Cardinal Health 200, LLC
Remote, United States
The Data Capture Technologies & Partnerships Senior Product Manager executes against the product portfolio strategy for technology partnerships and owns the data capture technology roadmap…
Added 21 mins ago
Sr. Product Manager, Fleet Telemetry
SunStrong Management, LLC
Remote, United States
The Sr. Product Manager, Fleet Telemetry is responsible for what the fleet telemetry and data platform organization builds and in what order, across residential, commercial and industrial,…
Added 22 mins ago
Manager, Marketing Automation
Zelis
St. Petersburg, FL · Morristown, NJ
Maintain platform governance, documentation, suppression logic, property standards, integrations and quality assurance.
Added 22 mins ago
Principal AI Solutions Architect, Customer Success
United States - Genesys Cloud Services, Inc.
Virtual Office, TX
…adoption. Supporting the newly launched Agentic AI Orchestration program, this role combines hands-on architecture and rapid prototyping with executive-level customer engagement, technical…
Added 22 mins ago
Principal AI Solutions Architect, Customer Success
United States - Genesys Cloud Services, Inc.
Virtual Office, TX · IN · MO · FL · MA · NC · MS · GA
…adoption. Supporting the newly launched Agentic AI Orchestration program, this role combines hands-on architecture and rapid prototyping with executive-level customer engagement, technical…

American Express

Senior Technical Product Manager – Agent Evaluation & Observability

New York, NY, United States
Phoenix, AZ, United States
NY, United States

Apply About employer

Applications open in a new tab.

Job details

Apply by: Nov 18, 2026
Experience: 6-8+ years of experience in product management, product development, software engineering, technical platforms, analytics, quality tooling, or AI products.
Posting language: English
Posted: Nov 4, 2026

Original job description

Agentic Partner Membership Experiences The core of our company is not just the products we offer, but the personal connections our customers have with our brand. You can create digital experiences, from payments to rewards to servicing, that keep us connected to our customers and serve them at every touchpoint. From digital servicing and lifestyle features to secure, frictionless payment options, you can make a meaningful difference in our customers’ lives and help set us apart in the industry. Find your place in digital products on #TeamAmex. The Amex Digital Labs team drives innovation at American Express by originating, incubating, and managing products and platforms that are essential to our customers’ digital lives. We are a fast-paced team that leverages emerging technologies to develop digital payment and financial services products and engaging Membership experiences for Card Members. We often collaborate with technology companies and strategic partners to bring products to the market. We are looking for a Senior Technical Product Manager to lead the roadmap for tools and workflows that hlep teams test and improve agent-enabled customer experiences. You will help teams measure how well agent's complete customer tasks, understand failures and use the findings to improve their experiences.

You will own the product roadmap, requirements and adoption of shared evaluation tools and workflows. Working with engineering and enterprise platform teams, you will build on existing capabilities to help product teams assess agent performance and decide what to improve. Domain product owners will remain accountable for release decisions.

Primary responsibilities:

Own Evaluation and Quality workflows

Own the roadmap for shared agent evaluation and observability capabilities, from user discovery and requirements through launch, adoption and improvement.
Partner with domain owners to define representative journeys, prompt sets, expected tool behavior and outputs, scoring rubrics and acceptance criteria.
Define requirements for automated evaluation, human review, and tools that help teams diagnose failures.

Connect Evaluations with Operational Evidence

Define product requirements for traces, events, diagnostic views and review tools that connect customer intent, tool or API calls and observed outcomes where data access permits.
Work with engineering, analytics and existing enterprise evaluation and observability teams to extend shared capabilities, reuse instrumentation and standardize evidence.
Identify where limited access to partner data prevents a complete assessment.
Partner with Identity and domain owners to test policy-relevant behavior, including denied actions, revoked access and required approvals.

Measure and Improve Agent Experiences

Define meaningful measures such as task completion, correct tool use, response quality, failure and recovery rates, latency and cost.
Define how testing and monitoring work together across controlled test environments, end-to-end partner integrations and production. Clarify what each can measure and use the findings to prioritize improvements with the responsible teams.
Measure adoption and usefulness of evaluation workflows, including review effort, coverage and time to identify problems. Communicate the limits of findings based on sampled data.

Lead a Reusable Product Capability

Translate measurement gaps into a prioritized backlog, clear requirements, and actionable acceptance criteria. Recommend when to extend existing tools, integrate a solution or build a missing capability.
Build privacy and data governance into evaluation and telemetry requirements, including permitted uses of partner-provided data, appropriate access, minimization and retention. Communicate uncertainty, release risks and tradeoffs clearly.

Minimum Qualifications

6-8+ years of experience in product management, product development, software engineering, technical platforms, analytics, quality tooling, or AI products.
Experience owning evaluation, testing, observability, analytics or related technical products through launch, adoption and iteration, with measurable user or business outcomes.
Practical understanding of AI or agent-enabled systems, including nondeterministic behavior, tool or API interactions, and the need for both automated tests and human judgment.
Ability to define metrics, interpret evidence and identify sampling, coverage, or measurement limitations. Familiarity with traces, logs, APIs and technical troubleshooting.
Strong product discovery, roadmap and prioritization skills, including translating ambiguous quality problems into usable tools and repeatable workflows.
Cross-functional leadership and clear communication, with the ability to balance customer outcomes, engineering constraints and privacy or risk requirements.

Preferred Qualifications

Experience with LLM or agent evaluation, scenario design, human review, model-assisted scoring or production failure analysis.
Familiarity with MCP, function calling, telemetry standards or evaluation frameworks; ability to use code or queries to investigate evidence.
Experience building shared capabilities adopted by multiple teams or delivering products in financial services or another regulated industry.
Bachelor’s degree or equivalent experience.

Employment eligibility to work with American Express in the United States is required as the company will not pursue visa sponsorship for these positions.

We back you with benefits that support your holistic well-being so you can be and deliver your best. This means caring for you and your loved ones' physical, financial, and mental health, as well as providing the flexibility you need to thrive personally and professionally:

Competitive base salaries
Bonus incentives
6% Company Match on retirement savings plan
Free financial coaching and financial well-being support
Comprehensive medical, dental, vision, life insurance, and disability benefits
Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need
20+ weeks paid parental leave for all parents, regardless of gender, offered for pregnancy, adoption or surrogacy
Free access to global on-site wellness centers staffed with nurses and doctors (depending on location)
Free and confidential counseling support through our Healthy Minds program
Career development and training opportunities

For a full list of Team Amex benefits, visit our Colleague Benefits Site.

American Express is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, disability status, age, or any other status protected by law. American Express will consider for employment all qualified applicants, including those with arrest or conviction records, in accordance with the requirements of applicable state and local laws, including the California Fair Chance Act, the Los Angeles County Fair Chance Ordinance for Employers, and the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance. For positions covered by federal and/or state banking regulations, American Express will comply with such regulations as it relates to the consideration of applicants with criminal convictions.

We back our colleagues with the support they need to thrive, professionally and personally. That's why we have Amex Flex, our enterprise working model that provides greater flexibility to colleagues while ensuring we preserve the important aspects of our unique in-person culture. Depending on role and business needs, colleagues will either work onsite, in a hybrid model (combination of in-office and virtual days) or fully virtually.

US Job Seekers - Click to view the “Know Your Rights” poster. If the link does not work, you may access the poster by copying and pasting the following URL in a new browser window: https://www.eeoc.gov/poster.

The below represents the expected salary range for this job requisition. Ultimately, in determining your pay, we’ll consider your location, experience, and other job-related factors.

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. From delivering differentiated products to providing world-class customer service, we operate with a strong risk mindset, ensuring we continue to uphold our brand promise of trust, security, and service.

As part of Team Amex, you’ll experience our powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express.

Apply About employer

Report this job