Find work in the United States.

A simpler way to find your next job.

Jobs in the United States

25+ jobs

Save this search

Added 6 mins ago
IC
NM Wafer Packaging Manufacturing Advanced Packaging Engineer
Intel Corporation
NM
- $103,730 to $198,820 USD / year
Partner closely with engineers, technicians, integration teams, shift leadership, and management to deliver development and manufacturing commitments.
Added 17 mins ago
Software Engineer III
Robert Half Inc.
Remote, United States
Robert Half is seeking a Software Engineer III who will analyze, design, program, debug, test, implement and modify software enhancements and/or new applications used in local, networked,…
Added 19 mins ago
Business Development & Field Innovation Manager
Motorola Solutions, Inc.
Remote, United States
…technologies to support security and safety throughout the world. We engineer our products from start to finish and manufacture them in-house. We're known for low volume and high capability…
Added 27 mins ago
Information Systems Engineer Manager 2
CORP-Corporate Office
United States
Northrop Grumman Aeronautics Systems has an opening for an Information Systems Engineer Manager 2 to join our team of qualified, diverse individuals within our Aircraft Solutions…
Added 27 mins ago
Space Vehicle Systems Engineer - Level 3 or 4 (AHT)
CORP-Corporate Office
United States
Northrop Grumman’s Space Systems Sector is seeking a Space Vehicle Systems Engineer – Level 3 or 4 to join our team in Redondo Beach, CA. This position can be filled at either Level 3…
Added 31 mins ago
EG
Quality Assurance Engineer - PHP
Eliassen Group
Bismarck, ND
- $40 to $50 USD / hour
Our client seeks a results-driven Senior Quality Assurance Engineer to support Policyholder Portal applications. The role requires manual, automation, mobile, API, and database testing…
Added 32 mins ago
Applied AI Engineer II
Blue Origin LLC
Seattle, WA
…latest AI and Large Language Model (LLM) technologies. As a Software Developer focused on Artificial Intelligence, you join us to build the next generation of software that powers Blue…
Added 36 mins ago
MA
Principal Corporate Technology Engineer
Microsoft AI
NY · Mountain View, CA · Redmond, WA
- $142,800 to $304,200 USD / year
We are looking for a Principal Corporate Technology Engineer to engineer the identity, SaaS, access-governance, internal application, integration, and endpoint capabilities that Microsoft…
Added 37 mins ago
L
Cybersecurity Systems Engineer II
Lyntris
San Diego, CA
- $115,000 to $145,000 USD / year
…expertise within their domain. Combining differentiated hardware, software and mission expertise, Lyntris helps customers sense threats, make sense of complex conditions and act with…
Added 41 mins ago
Senior Flight Test Engineer - Space Systems
Anduril Industries
Costa Mesa, CA
Serve as the lead test engineer for R&D rocket-launched systems, including development, certification, and integration testing of subsystems.
Added 43 mins ago
Mission Manager / Systems Engineer II
Lodestar
Los Angeles, CA
Lodestar is the software-first space prime for the hardware abundant era. We believe the next generation of space systems will be defined not by launch, fuel, and batteries, but by…
Added 1 hour ago
Flight Test Engineer - Space Systems
Anduril Industries
Costa Mesa, CA
Serve as the lead test engineer for R&D rocket-launched systems, including development, certification, and integration testing of subsystems.
Added 1 hour ago
EG
Quality Assurance Engineer - PHP
Eliassen Group
Montpelier, VT
- $40 to $50 USD / hour
Our client seeks a results-driven Senior Quality Assurance Engineer to support Policyholder Portal applications. The role requires manual, automation, mobile, API, and database testing…
Added 1 hour ago
Mechatronics Engineer III
JPL/NASA
Pasadena, CA
You will be working as a Mechatronics Engineer within the Mechanical Engineering, Integration, and Test Section, which leads the design, analysis, development, integration, and test of…
Added 1 hour ago
Senior Test Engineer
ASRC Federal Holding Company
Egg Harbor Township, NJ
ASRC Federal Advanced Research LLC (AFAR) is seeking a Senior Test Engineer to join our Common Support Services - Weather (CSS-Wx) team that supports the Federal Aviation…
Added 1 hour ago
WI
(USA) Principal, Software Engineer
Walmart Inc.
United States
- $143,000 to $286,000 USD / year
The (USA) Principal, Software Engineer leads the design and delivery of scalable platform capabilities, driving innovation in cloud-native architectures and AI/ML integration. This role…
Added 1 hour ago
WI
Software Engineer II | Bentonville, Arkansas
Walmart Inc.
United States
- $80,000 to $155,000 USD / year
As a Software Engineer II, you will deliver high-quality software solutions by collaborating with cross-functional teams to design, develop, and maintain scalable applications and services.…
Added 1 hour ago
H
R&D Writing System Engineer
HP
Corvallis
- $93,400 to $143,800 USD / year
The Fluids Technology and Integration (FTI) R&D lab is a fast paced, dynamic, and innovative organization that develops ink and micro-fluidic technologies that advance print applications…
Added 1 hour ago
Sr Mechanical Engineer
Leidos
Albuquerque, NM
Leidos Defense Systems is seeking a highly motivated Sr Mechanical Engineer who loves collaboration and being a part of something big, to join our team. This role drives the implementation…
Added 1 hour ago
Senior/Principal Mechanical Engineer - Experimental Solid Mechanics, Onsite
Sandia National Laboratories
Albuquerque, NM
…security! We are seeking a highly motivated R&D Mechanical Engineer to join our dynamic team in the Experimental Solid Mechanics…
Added 1 hour ago
Senior/Principal Software Solutions Architect - Data Integration Framework, Hybrid
Sandia National Laboratories
Albuquerque, NM
If so, Sandia National Laboratories' Science and Information Engineering System's group is seeking a motivated Software Solution Architect to join the Design and Development Solutions team…
Added 1 hour ago
EG
Quality Assurance Engineer - PHP
Eliassen Group
Santa Fe, NM
- $40 to $50 USD / hour
Our client seeks a results-driven Senior Quality Assurance Engineer to support Policyholder Portal applications. The role requires manual, automation, mobile, API, and database testing…
Added 1 hour ago
Co-Packaged Optics Packaging Process Development Engineer
MSI - (Marvell Semiconductor Inc.) US
Santa Clara, CA
…and mitigation of risk to new technologies used in product integration and ensure factory readiness through maturing product during the NPI phase. This job will require you to have hands-on…
Added 1 hour ago
DevOps Engineer or Principal DevOps Engineer - Position qualifies for sign-on bonus starting at $5k
Northrop Grumman
Aurora · Morrisville · Sacramento
Ensures implementation of Software Configuration Management (SCM), code quality, and code coverage with automated testing for Continuous Integration/Continuous Delivery (CI/CD) pipelines.
Added 1 hour ago
Information Systems Engineer Manager 2
Northrop Grumman
Beale AFB
Northrop Grumman Aeronautics Systems has an opening for an Information Systems Engineer Manager 2 to join our team of qualified, diverse individuals within our Aircraft Solutions…

Select Minds LLC

Senior AI Tools Testing Engineer

Dallas, TX, United States

$120,000 to $140,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $120,000 to $140,000 USD / year
Posting language: English
Posted: Nov 5, 2026

Original job description

Job Title: Senior / Lead AI Tools & Testing Engineer (Agentic AI & LLM Evaluation) Location: Dallas, TX (Hybrid) Duration: Long‑Term Experience:10 + Years

We seek a senior/lead AI engineer with hands‑on experience building, orchestrating, monitoring, and evaluating production‑grade Generative AI and Agentic AI applications. The ideal candidate is expert in Amazon Bedrock, AgentCore, LangGraph, LangChain, RAG, LLM observability, and evaluation frameworks. This role focuses on creating reliable, scalable, and production‑ready AI applications, emphasizing agent orchestration, AI testing, LLM evaluation, and continuous quality monitoring.

The candidate will collaborate with engineering, QA, and platform teams to establish best practices for building, testing, monitoring, and improving AI‑powered applications.

Key Responsibilities

Agentic AI & GenAI Engineering

Design, develop, and deploy production‑grade agentic and generative AI applications.
Build and orchestrate AI agents using LangGraph, LangChain, Amazon Bedrock, and AgentCore.
Implement multi‑agent workflows, tool calling, state management, memory, and orchestration.
Create scalable LLM‑powered applications and reusable AI components.

RAG & LLM Application Development

Design and implement Retrieval‑Augmented Generation (RAG) solutions.
Develop pipelines for document ingestion, chunking, embedding, retrieval, reranking, and context management.
Optimize retrieval accuracy, response quality, latency, and cost.
Apply grounding, hallucination reduction, and context‑relevance techniques.

LLM Evaluation & AI Testing

Build evaluation frameworks for LLM‑based applications and agentic workflows.
Automate evaluation with DeepEval and other LLM evaluation tools.
Use LLM‑as‑a‑Judge methods to assess response quality, relevance, accuracy, faithfulness, and reasoning.
Create evaluation datasets, test scenarios, benchmarks, and regression‑testing pipelines.
Evaluate agent behavior, tool execution, workflow accuracy, and response consistency.
Identify failure patterns and continuously improve AI application quality.

AI Observability & Monitoring

Implement tracing, monitoring, and observability with OpenTelemetry, LangSmith, and Langfuse.
Track LLM requests, agent execution flows, tool calls, latency, token consumption, errors, and performance.
Establish debugging mechanisms for complex multi‑step agentic workflows.
Develop monitoring practices to detect performance degradation and operational issues.

AWS AI Platform & Production Engineering

Deploy AI applications using Amazon Bedrock and Bedrock AgentCore.
Integrate foundation models, agent frameworks, APIs, and enterprise data sources.
Apply production‑readiness practices covering scalability, reliability, security, and performance.
Support CI/CD integration and automated evaluation of AI applications.
Optimize model selection, inference costs, latency, and resource utilization.

Technical Leadership & Collaboration

Provide technical guidance to engineering and QA teams.
Establish reusable frameworks, implementation patterns, and best practices.
Collaborate with architecture, DevOps, QA, and engineering teams.
Participate in design discussions, code reviews, proof‑of‑concept development, and implementation.
Mentor engineers and help teams adopt effective AI development and testing practices.

Required Technical Skills

Agentic AI & Orchestration

LangGraph
LangChain
Amazon Bedrock
Amazon Bedrock AgentCore
AI agents, multi‑agent orchestration, tool calling, workflow management

Generative AI & RAG

Large Language Models (LLMs)
Retrieval‑Augmented Generation (RAG)
Embeddings and vector search
Prompt engineering and context management
LLM application development

LLM Evaluation & Testing

DeepEval
LLM‑as‑a‑Judge techniques
Evaluation metrics and benchmarking
Automated evaluation and regression testing
Assessment of hallucination, faithfulness, relevance, and response quality

AI Observability & Monitoring

OpenTelemetry
LangSmith
Langfuse
LLM tracing, debugging, and performance monitoring

Production Engineering

Deploying and operating production‑grade GenAI applications
API integration and backend engineering
CI/CD and automated testing integration
Scalability, reliability, security, and performance optimization

Preferred Qualifications

8+ years of software engineering or IT experience.
Hands‑on experience developing and deploying GenAI or Agentic AI applications.
Experience with enterprise‑scale AI implementations.
Familiarity with AWS cloud services and enterprise AI security practices.
Experience establishing AI quality standards and evaluation methodologies.
Strong problem‑solving, communication, and technical collaboration skills.

What Success Looks Like

Development and deployment of production‑grade agentic AI applications.
Reliable orchestration and execution of AI agents and workflows.
Effective LLM evaluation and automated AI testing frameworks.
Improved AI application accuracy, reliability, observability, and performance.
Reusable engineering practices for building and maintaining enterprise GenAI solutions.

Important: This is a hands‑on engineering position. Candidates with practical experience building and evaluating AI applications are preferred over those whose experience is limited to AI strategy, architecture documentation, conventional QA automation, or using AI coding assistants.

Flexible work from home options available.

Apply About employer

More about this job

Skills

LangChain
Workflow
Debugging
AWS
CI/CD
Test automation
Problem solving
Communication skills
Collaboration

Report this job