Find work in the United States.

A simpler way to find your next job.

Jobs in the United States

25+ jobs

Save this search

Added 1 min ago
VLSI ASIC Logic Design Engineer
Hewlett Packard Enterprise
Ft. Collins, CO · Frisco, TX · Bloomington, MN · Chippewa Falls, WI
…enable prototype and production VLSI solutions. May direct support personnel in the preparation of detailed design, design testing and prototype…
Added 1 min ago
Systems Engineer for Large Public Venues (East Coast)
Hewlett Packard Enterprise
All, NY · All, DE · All, GA · All, PA · Boston, MA · All, NC · All, OH · All, MD · All, FL
The Systems Engineer for Large Public Venues on the East Coast will be mainly responsible for providing technical support and leadership in the creation of deliverable Wi-Fi and wireless…
Added 6 mins ago
Resident Engineer, Product Dev - Eng'g
Yazaki International Corporation
Canton, MI
Yazaki is looking for a Resident Engineer to join ECI Team in Canton, MI. The customer site is located in Dearborn, MI. The Resident Engineer serves as Yazaki’s primary technical…
Added 13 mins ago
Vice President of Engineering
Hays
NE
The ideal candidate is a former software engineer who progressed into senior engineering leadership and can combine strong technical credibility with executive-level business judgment.
Added 17 mins ago
G
Fire Protection Engineer (PE)
GPAC
Pittsburgh, PA
- $90,000 to $120,000 USD / year
A well-established, growing engineering firm, is seeking a highly motivated Fire Protection Design Engineer with expertise in fire hazards analysis, and fire protection system design. You…
Added 20 mins ago
Quality Systems Manager
Jobgether
Remote, United States
…and implement effective solutions. You will also lead audits, support regulatory inspections, and drive initiatives that improve organizational quality capabilities. This is an opportunity…
Added 24 mins ago
O
Lead Principal Platform Software Engineer
Oracle
Nashville, TN
- $113,600 to $306,400 USD / year
…scientific workflows, AI, robotics, and laboratory automation in support of the Ellison Institute of Technology…
Added 24 mins ago
O
Senior Platform Software Engineer
Oracle
Nashville, TN
- $87,800 to $209,500 USD / year
Software Engineer - OCI User Experience Engineering Platform
Added 24 mins ago
O
Manager, Application Software Engineering
Oracle
Austin, TX
- $114,600 to $234,600 USD / year
Own engineering delivery and application support
Added 24 mins ago
Senior Brand Marketing Manager
CircleCI
San Francisco, CA
…to launch headlines to sales decks. Use one test: would an engineer here send it to a friend? Write the biggest pieces…
Added 28 mins ago
Structural Engineer 4
CDM Smith
Portland, OR
…while accelerating your professional growth. As a Structural Engineer, you'll support the design and assessment of reinforced concrete, steel, masonry, and specialty structures,…
Added 43 mins ago
Senior Security Engineer
PathAI
Boston, MA
We're looking for a Senior Security Engineer who thinks like a software engineer. You will make secure development the easy path at PathAI by embedding security into how our engineers…
Added 43 mins ago
SU
Mobile / UI/UX Engineer
Stanbridge University
Remote, United States
- $115,000 to $150,000 USD / year
This mid- to senior-level position combines mobile application development, front-end engineering, and user experience design. The ideal candidate is a hands-on engineer who can translate…
Added 51 mins ago
Senior Site Reliability Engineer
Jobgether
Remote, United States
As a Senior Site Reliability Engineer, you will lead initiatives to strengthen infrastructure resilience, optimize application performance, and ensure the continuous delivery of reliable…
Added 51 mins ago
J
SENIOR NETWORK SECURITY ENGINEER
Jobgether
Remote, United States
- $120,000 to $140,000 USD / year
The Senior Network Security Engineer will lead the design, deployment, and maintenance of secure network access solutions across cloud and on-premises environments. This role focuses on…
Added 51 mins ago
Senior Juniper SRX Firewall Engineer
Jobgether
Remote, United States
…steps. Our partner is looking for a Senior Juniper SRX Firewall Engineer based in the United…
Added 51 mins ago
Refueling & Remote Handling I&C Engineer
Jobgether
Remote, United States
The Refueling & Remote Handling I&C Engineer will provide specialized instrumentation and controls engineering support for advanced nuclear reactor servicing operations. This role focuses…
Added 51 mins ago
EG
QA Automation Engineer
Eliassen Group
Honolulu, HI
- $75 to $82 USD / hour
Experience as an Automation Engineer using tools such as Selenium with Java or similar.
Added 51 mins ago
EG
Staff AI & Data Engineer – Databricks
Eliassen Group
Honolulu, HI
- $80 to $90 USD / hour
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the…
Added 56 mins ago
SE
ERP Software Engineer
Schweitzer Engineering Laboratories, Inc.
Pullman, WA
- $82,000 USD / year
Schweitzer Engineering Laboratories (SEL) seeks a creative and talented software engineer who is passionate about solving problems and improving the lives of people. SEL develops critical…
Added 58 mins ago
Transportation Supervising Engineer (Engineering)
State of Connecticut
Newington, CT
Please list your Driver's license number, expiration date, and issuing State, Professional Engineer (PE) license number and expiration date, and any other job-relevant licenses or…
Added 58 mins ago
SO
Transportation Planner 2 (40 Hour)
State of Connecticut
Newington, CT
- $91,979 to $132,381 USD / year
Support multimodal planning initiatives integrating rail with highway, bus, and active transportation networks.
Added 58 mins ago
Transportation Engineer Trainee
State of Connecticut
Newington, CT
Please list your Driver's license number, expiration date, and issuing State, Engineer in Training license number (if applicable) and any other job-relevant licenses or certifications you…
Added 59 mins ago
TL
Vice President, Data Systems
The Los Angeles Lakers, Inc
El Segundo, CA
- $275,000 to $300,000 USD / year
…qualitative data, and health, performance, and wearables data. Support and direct the ongoing move to modern, production-grade infrastructure (e.g. medallion architecture, orchestrated…
Added 1 hour ago
Staff Environmental Geologist / Scientist / Engineer
TRC Companies, Inc.
Concord, CA
TRC is seeking a highly motivated and detail-oriented staff-level Environmental Geologist, Scientist, or Civil Engineer to join our Engineering, Construction, and Remediation practice in…

Select Minds LLC

Senior AI Tools Testing Engineer

Dallas, TX, United States

$120,000 to $140,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $120,000 to $140,000 USD / year
Posting language: English
Posted: Nov 5, 2026

Original job description

Job Title: Senior / Lead AI Tools & Testing Engineer (Agentic AI & LLM Evaluation) Location: Dallas, TX (Hybrid) Duration: Long‑Term Experience:10 + Years

We seek a senior/lead AI engineer with hands‑on experience building, orchestrating, monitoring, and evaluating production‑grade Generative AI and Agentic AI applications. The ideal candidate is expert in Amazon Bedrock, AgentCore, LangGraph, LangChain, RAG, LLM observability, and evaluation frameworks. This role focuses on creating reliable, scalable, and production‑ready AI applications, emphasizing agent orchestration, AI testing, LLM evaluation, and continuous quality monitoring.

The candidate will collaborate with engineering, QA, and platform teams to establish best practices for building, testing, monitoring, and improving AI‑powered applications.

Key Responsibilities

Agentic AI & GenAI Engineering

Design, develop, and deploy production‑grade agentic and generative AI applications.
Build and orchestrate AI agents using LangGraph, LangChain, Amazon Bedrock, and AgentCore.
Implement multi‑agent workflows, tool calling, state management, memory, and orchestration.
Create scalable LLM‑powered applications and reusable AI components.

RAG & LLM Application Development

Design and implement Retrieval‑Augmented Generation (RAG) solutions.
Develop pipelines for document ingestion, chunking, embedding, retrieval, reranking, and context management.
Optimize retrieval accuracy, response quality, latency, and cost.
Apply grounding, hallucination reduction, and context‑relevance techniques.

LLM Evaluation & AI Testing

Build evaluation frameworks for LLM‑based applications and agentic workflows.
Automate evaluation with DeepEval and other LLM evaluation tools.
Use LLM‑as‑a‑Judge methods to assess response quality, relevance, accuracy, faithfulness, and reasoning.
Create evaluation datasets, test scenarios, benchmarks, and regression‑testing pipelines.
Evaluate agent behavior, tool execution, workflow accuracy, and response consistency.
Identify failure patterns and continuously improve AI application quality.

AI Observability & Monitoring

Implement tracing, monitoring, and observability with OpenTelemetry, LangSmith, and Langfuse.
Track LLM requests, agent execution flows, tool calls, latency, token consumption, errors, and performance.
Establish debugging mechanisms for complex multi‑step agentic workflows.
Develop monitoring practices to detect performance degradation and operational issues.

AWS AI Platform & Production Engineering

Deploy AI applications using Amazon Bedrock and Bedrock AgentCore.
Integrate foundation models, agent frameworks, APIs, and enterprise data sources.
Apply production‑readiness practices covering scalability, reliability, security, and performance.
Support CI/CD integration and automated evaluation of AI applications.
Optimize model selection, inference costs, latency, and resource utilization.

Technical Leadership & Collaboration

Provide technical guidance to engineering and QA teams.
Establish reusable frameworks, implementation patterns, and best practices.
Collaborate with architecture, DevOps, QA, and engineering teams.
Participate in design discussions, code reviews, proof‑of‑concept development, and implementation.
Mentor engineers and help teams adopt effective AI development and testing practices.

Required Technical Skills

Agentic AI & Orchestration

LangGraph
LangChain
Amazon Bedrock
Amazon Bedrock AgentCore
AI agents, multi‑agent orchestration, tool calling, workflow management

Generative AI & RAG

Large Language Models (LLMs)
Retrieval‑Augmented Generation (RAG)
Embeddings and vector search
Prompt engineering and context management
LLM application development

LLM Evaluation & Testing

DeepEval
LLM‑as‑a‑Judge techniques
Evaluation metrics and benchmarking
Automated evaluation and regression testing
Assessment of hallucination, faithfulness, relevance, and response quality

AI Observability & Monitoring

OpenTelemetry
LangSmith
Langfuse
LLM tracing, debugging, and performance monitoring

Production Engineering

Deploying and operating production‑grade GenAI applications
API integration and backend engineering
CI/CD and automated testing integration
Scalability, reliability, security, and performance optimization

Preferred Qualifications

8+ years of software engineering or IT experience.
Hands‑on experience developing and deploying GenAI or Agentic AI applications.
Experience with enterprise‑scale AI implementations.
Familiarity with AWS cloud services and enterprise AI security practices.
Experience establishing AI quality standards and evaluation methodologies.
Strong problem‑solving, communication, and technical collaboration skills.

What Success Looks Like

Development and deployment of production‑grade agentic AI applications.
Reliable orchestration and execution of AI agents and workflows.
Effective LLM evaluation and automated AI testing frameworks.
Improved AI application accuracy, reliability, observability, and performance.
Reusable engineering practices for building and maintaining enterprise GenAI solutions.

Important: This is a hands‑on engineering position. Candidates with practical experience building and evaluating AI applications are preferred over those whose experience is limited to AI strategy, architecture documentation, conventional QA automation, or using AI coding assistants.

Flexible work from home options available.

Apply About employer

More about this job

Skills

LangChain
Workflow
Debugging
AWS
CI/CD
Test automation
Problem solving
Communication skills
Collaboration

Report this job