Find work in the United States.

A simpler way to find your next job.

Jobs in the United States

25+ jobs

Save this search

Added 3 mins ago
Senior Software Engineer (Institutional, Financing)
Coinbase
Montpelier, VT
As a Senior Software Engineer on the Financing Engineering team within the Institutional group, you'll design, build, and scale the systems that safely manage billions of dollars in loans…
Added 4 mins ago
AI Automation Architect - Manufacturing and MES processes- Remote
Cognizant
Montpelier, VT
…fundamentally connect people with processes. Within Cognizant IOT, we engineer industry-aligned, IoT-enabled products that merge industry needs with human drivers. Our intelligent products…
Added 15 mins ago
Senior Software Engineer (Institutional, Financing)
Coinbase
Trenton, NJ
As a Senior Software Engineer on the Financing Engineering team within the Institutional group, you'll design, build, and scale the systems that safely manage billions of dollars in loans…
Added 19 mins ago
WI
(USA) Principal, Software Engineer
Walmart Inc.
United States
- $143,000 to $286,000 USD / year
The (USA) Principal, Software Engineer leads the design and delivery of scalable platform capabilities, driving innovation in cloud-native architectures and AI/ML integration. This role…
Added 19 mins ago
WI
Software Engineer II | Bentonville, Arkansas
Walmart Inc.
United States
- $80,000 to $155,000 USD / year
As a Software Engineer II, you will deliver high-quality software solutions by collaborating with cross-functional teams to design, develop, and maintain scalable applications and services.…
Added 32 mins ago
Senior AI Engineer, Banking Technology
Citi
JERSEY CITY, NJ · Jersey City, NJ · Jersey City
Citi’s Banking Technology organization is seeking a highly hands-on Senior AI Engineer to design, build, and deploy cutting‑edge AI solutions for Investment, Corporate, and Commercial…
Added 54 mins ago
Sr AI Information Security Engineer (REMOTE)
Insight Global
Cary, NC
A large software and gaming company is seeking a Senior Information Security Engineer with hands-on experience in both Security Engineering and AI technologies. This individual will help…
Added 55 mins ago
C
Sr. AWS Data Engineer (Java, Python & Generative AI)
Cognizant
Charlotte, NC
- $90,000 to $105,000 USD / year
As a Senior AWS Data Engineer , you will make an impact by designing and building scalable cloud-based data solutions, modern APIs, and Generative AI capabilities that drive business…
Added 56 mins ago
Data Engineer, Clinical Operations
E.R. Squibb & Sons,L.L.C.
Princeton, NJ
As a Data Engineer, you will play a vital role in supporting the broader Data Engineering community to deliver cutting-edge data and analytics platforms for our Global Drug Development…
Added 59 mins ago
Information Security Engineer – Global Security Infrastructure
Micron Technology
Boise
JR116695 Information Security Engineer – Global Security Infrastructure
Added 1 hour ago
Staff ML Engineer - Embodied AI Scaling Foundations
General Motors LLC
Remote, United States
As a Staff AI/ML Engineer in the Embodied AI Data Foundations organization, you will be an individual contributor developing data-centric AI solutions that directly improve autonomous…
Added 1 hour ago
F
Senior Infrastructure Security Engineer
fal
San Francisco, CA
- $180,000 to $250,000 USD / year
fal is the generative media ecosystem powering the next generation of AI products. We build the infrastructure, tools, and model access that teams need to move from idea to production, and…
Added 1 hour ago
F
Staff Security Engineer
fal
San Francisco, CA
- $180,000 to $250,000 USD / year
fal is the generative media ecosystem powering the next generation of AI products. We build the infrastructure, tools, and model access that teams need to move from idea to production, and…
Added 1 hour ago
Generative AI Software Engineer
Koniag Government Services
Washington, DC
Tuknik Government Services, LLC a Koniag Government Services company, is seeking a Generative AI Software Engineer with a Secret security clearance to support TGS in supporting our…
Added 1 hour ago
Perplexity/AI Integration Lead
Koniag Government Services
Washington, DC
Serve as the subject matter expert and technical lead for AI platform integration initiatives, with a focus on Perplexity AI and other enterprise-grade LLM and generative AI tools.
Added 1 hour ago
Sr. AI Technical Lead & Data Developer (REMOTE)
Koniag Government Services
Albuquerque, NM
Strong background as a Database Engineer with advanced SQL proficiency, data modeling, and performance tuning.
Added 1 hour ago
C
Quality Engineer (AI & Test Automation)
Cognizant
Jefferson City, MO
- $65,000 USD / year
…quality into every stage of the lifecycle, and as a Quality Engineer, you will be on the front lines of this…
Added 1 hour ago
Full-Stack/UI Senior Software Engineer - 26375
Enverus
Pittsburgh, PA
We are the most trusted energy-dedicated SaaS company, with a platform built to maximize value from generative AI, and our innovative solutions are reshaping the way energy is consumed and…
Added 1 hour ago
Software Engineer I
American Express
Sunrise, FL
We are looking for a motivated and hands-on Full Stack Software Engineer with strong Python programming fundamentals, experience working with Relational and NoSQL databases, and practical…
Added 1 hour ago
Sr. CyberArk Implementation Engineer or Architect
Capgemini
Atlanta, GA, GA
We are seeking an experienced Senior CyberArk PAM Implementation Engineer to assess, optimize, and enhance our existing CyberArk Privileged Access Management environment. The ideal…
Added 1 hour ago
Fellow Software Engineer-Eng (Agentic AI Architecture & Engineering)
UKG
Jefferson City, MO
We are seeking a distinguished and customer-facing Fellow AI Engineer to define and lead UKG's enterprise-wide Agentic AI strategy across the full UKG Product Suite. This role extends…
Added 2 hours ago
T
Senior AI/ML Engineer
TEKsystems
New York, NY
- $119,800 to $179,800 USD / year
…We are seeking a highly skilled and motivated Senior AI/ML Engineer with 57 years of experience in data engineering and at least 3 years in AI/ML engineering. The ideal candidate will have…
Added 2 hours ago
Senior Machine Learning Engineer, AI Safety Evaluations
NVIDIA USA
CA
NVIDIA has helped redefine what computers can do. Now, generative AI is opening new possibilities for how people learn, create, and tackle problems. Realizing that potential means answering…
Added 2 hours ago
Senior Director, Data and AI Engineer
Otsuka America Pharmaceutical Inc.
Jefferson City, MO
…data and AI foundations and implementing advanced data, AI and Generative AI (Gen AI)…
Added 2 hours ago
Forward Deployed Engineer - Databricks - Forensic Discovery & Financial Crime
Deloitte
Saint Louis, MO
…business solutions. As a Senior Consultant - Forward Deployed Engineer (FDE), you will design, build, and implement AI-enabled applications and data solutions in enterprise environments.…

Select Minds LLC

Senior AI Tools Testing Engineer

Dallas, TX, United States

$120,000 to $140,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $120,000 to $140,000 USD / year
Posting language: English
Posted: Nov 5, 2026

Original job description

Job Title: Senior / Lead AI Tools & Testing Engineer (Agentic AI & LLM Evaluation) Location: Dallas, TX (Hybrid) Duration: Long‑Term Experience:10 + Years

We seek a senior/lead AI engineer with hands‑on experience building, orchestrating, monitoring, and evaluating production‑grade Generative AI and Agentic AI applications. The ideal candidate is expert in Amazon Bedrock, AgentCore, LangGraph, LangChain, RAG, LLM observability, and evaluation frameworks. This role focuses on creating reliable, scalable, and production‑ready AI applications, emphasizing agent orchestration, AI testing, LLM evaluation, and continuous quality monitoring.

The candidate will collaborate with engineering, QA, and platform teams to establish best practices for building, testing, monitoring, and improving AI‑powered applications.

Key Responsibilities

Agentic AI & GenAI Engineering

Design, develop, and deploy production‑grade agentic and generative AI applications.
Build and orchestrate AI agents using LangGraph, LangChain, Amazon Bedrock, and AgentCore.
Implement multi‑agent workflows, tool calling, state management, memory, and orchestration.
Create scalable LLM‑powered applications and reusable AI components.

RAG & LLM Application Development

Design and implement Retrieval‑Augmented Generation (RAG) solutions.
Develop pipelines for document ingestion, chunking, embedding, retrieval, reranking, and context management.
Optimize retrieval accuracy, response quality, latency, and cost.
Apply grounding, hallucination reduction, and context‑relevance techniques.

LLM Evaluation & AI Testing

Build evaluation frameworks for LLM‑based applications and agentic workflows.
Automate evaluation with DeepEval and other LLM evaluation tools.
Use LLM‑as‑a‑Judge methods to assess response quality, relevance, accuracy, faithfulness, and reasoning.
Create evaluation datasets, test scenarios, benchmarks, and regression‑testing pipelines.
Evaluate agent behavior, tool execution, workflow accuracy, and response consistency.
Identify failure patterns and continuously improve AI application quality.

AI Observability & Monitoring

Implement tracing, monitoring, and observability with OpenTelemetry, LangSmith, and Langfuse.
Track LLM requests, agent execution flows, tool calls, latency, token consumption, errors, and performance.
Establish debugging mechanisms for complex multi‑step agentic workflows.
Develop monitoring practices to detect performance degradation and operational issues.

AWS AI Platform & Production Engineering

Deploy AI applications using Amazon Bedrock and Bedrock AgentCore.
Integrate foundation models, agent frameworks, APIs, and enterprise data sources.
Apply production‑readiness practices covering scalability, reliability, security, and performance.
Support CI/CD integration and automated evaluation of AI applications.
Optimize model selection, inference costs, latency, and resource utilization.

Technical Leadership & Collaboration

Provide technical guidance to engineering and QA teams.
Establish reusable frameworks, implementation patterns, and best practices.
Collaborate with architecture, DevOps, QA, and engineering teams.
Participate in design discussions, code reviews, proof‑of‑concept development, and implementation.
Mentor engineers and help teams adopt effective AI development and testing practices.

Required Technical Skills

Agentic AI & Orchestration

LangGraph
LangChain
Amazon Bedrock
Amazon Bedrock AgentCore
AI agents, multi‑agent orchestration, tool calling, workflow management

Generative AI & RAG

Large Language Models (LLMs)
Retrieval‑Augmented Generation (RAG)
Embeddings and vector search
Prompt engineering and context management
LLM application development

LLM Evaluation & Testing

DeepEval
LLM‑as‑a‑Judge techniques
Evaluation metrics and benchmarking
Automated evaluation and regression testing
Assessment of hallucination, faithfulness, relevance, and response quality

AI Observability & Monitoring

OpenTelemetry
LangSmith
Langfuse
LLM tracing, debugging, and performance monitoring

Production Engineering

Deploying and operating production‑grade GenAI applications
API integration and backend engineering
CI/CD and automated testing integration
Scalability, reliability, security, and performance optimization

Preferred Qualifications

8+ years of software engineering or IT experience.
Hands‑on experience developing and deploying GenAI or Agentic AI applications.
Experience with enterprise‑scale AI implementations.
Familiarity with AWS cloud services and enterprise AI security practices.
Experience establishing AI quality standards and evaluation methodologies.
Strong problem‑solving, communication, and technical collaboration skills.

What Success Looks Like

Development and deployment of production‑grade agentic AI applications.
Reliable orchestration and execution of AI agents and workflows.
Effective LLM evaluation and automated AI testing frameworks.
Improved AI application accuracy, reliability, observability, and performance.
Reusable engineering practices for building and maintaining enterprise GenAI solutions.

Important: This is a hands‑on engineering position. Candidates with practical experience building and evaluating AI applications are preferred over those whose experience is limited to AI strategy, architecture documentation, conventional QA automation, or using AI coding assistants.

Flexible work from home options available.

Apply About employer

More about this job

Skills

LangChain
Workflow
Debugging
AWS
CI/CD
Test automation
Problem solving
Communication skills
Collaboration

Report this job