Jobs in the United States

25+ jobs

Save this search

Added just now
Engineering Director, Google Cloud
PricewaterhouseCoopers Advisory Services LLC
Chicago, IL · Raleigh, NC · Charlotte, NC · Cincinnati, OH · Cleveland, OH · Columbia, SC · Columbus, OH · Dallas, TX · Baltimore, MD · Richmond, VA · Rochester, NY · Rosemont, IL · Boston, MA · St. Louis, MO · Salt Lake City, UT · San Antonio, TX · Seattle, WA · Spartanburg, SC · Albany, NY · Stamford, CT · Tampa, FL · Atlanta, GA · Toledo, OH · Austin, TX · Tulsa, OK · Washington, DC · Denver, CO · Des Moines, IA · Detroit, MI · Boca Raton, FL · Buffalo, NY · Florham Park, NJ · Fort Worth, TX · Greensboro, NC · Hartford, CT · Houston, TX · Grand Rapids, MI · Jacksonville, FL · Kansas City, MO · Las Vegas, NV · Little Rock, AR · Louisville, KY · Birmingham, AL · Fayetteville, AR · Melville, NY · Miami, FL · Milwaukee, WI · Minneapolis, MN · Montpelier, VT · Nashville, TN · New Orleans, LA · NY · Oklahoma City, OK · Orlando, FL · Philadelphia, PA · Phoenix, AZ · Pittsburgh, PA · Portland, OR
- Driving development of generative AI solutions using Google Vertex AI, LLM APIs, LangChain, LangGraph, and retrieval-augmented generation
Added just now
Engineer II, Google Cloud
PricewaterhouseCoopers Advisory Services LLC
Chicago, IL · Raleigh, NC · Charlotte, NC · Cincinnati, OH · Cleveland, OH · Columbia, SC · Columbus, OH · Dallas, TX · Baltimore, MD · Richmond, VA · Rochester, NY · Rosemont, IL · Boston, MA · St. Louis, MO · Salt Lake City, UT · San Antonio, TX · Seattle, WA · Spartanburg, SC · Albany, NY · Stamford, CT · Tampa, FL · Atlanta, GA · Toledo, OH · Austin, TX · Tulsa, OK · Washington, DC · Denver, CO · Des Moines, IA · Detroit, MI · Boca Raton, FL · Buffalo, NY · Florham Park, NJ · Fort Worth, TX · Greensboro, NC · Hartford, CT · Houston, TX · Grand Rapids, MI · Jacksonville, FL · Kansas City, MO · Las Vegas, NV · Little Rock, AR · Louisville, KY · Birmingham, AL · Fayetteville, AR · Melville, NY · Miami, FL · Milwaukee, WI · Minneapolis, MN · Montpelier, VT · Nashville, TN · New Orleans, LA · NY · Oklahoma City, OK · Orlando, FL · Philadelphia, PA · Phoenix, AZ · Pittsburgh, PA · Portland, OR
- Developing generative AI solutions using Google Vertex AI, LLM APIs, and Python
Added 3 mins ago
AI Developer
Family Dollar
Chesapeake, VA
The AI Developer Engineer is responsible for developing new AI applications and software including agentic AI applications, analytical solutions and pilot new ideas for deployment. This…
Added 3 mins ago
Senior Data Scientist – Payment Accuracy
CVS Shared Services Resources LLC
NY
2+ years of experience designing, building, and fine-tuning LLM-based solutions, including RAG applications, enterprise search, conversational interfaces, and autonomous AI agents.
Added 8 mins ago
U
Staff Software Engineer - Uber Health
Uber
San Francisco, CA · Sunnyvale, CA · Seattle, WA · New York City, NY
- $232,000 to $258,000 USD / year
…operating production-grade AI systems, agentic frameworks, or LLM-integrated workflows connected directly to enterprise backend…
Added 11 mins ago
Sr. Prospect Research and Intelligence Analyst, Principal Gifts
Johns Hopkins University
Baltimore
Added 13 mins ago
Back-End Engineer
HelloGov AI
Miami, FL
Familiarity with AI-powered applications, LLM integrations, and modern AI tools.
Added 13 mins ago
HA
Front-End Engineer
HelloGov AI
Miami, FL
- $100,000 to $120,000 USD / year
Experience building AI-powered applications or integrating LLM APIs.
Added 20 mins ago
C
Senior Director, Engineering - ICM
CaptivateIQ
Remote, United States
- $237,440 to $373,630 USD / year
Hands-on experience shipping AI/ML-powered product features, ideally LLM-based, including how you measure and maintain their quality. Experience applying AI to improve how engineering teams…
Added 22 mins ago
RS
Full Stack Development Lead
Ryan Specialty, LLC
Carmel, IN · Chicago, IL
- $128,000 to $160,000 USD / year
The Lead Full Stack Developer drives the design, delivery, and evolution of modern web applications, APIs, and system integrations, using AI to accelerate development and deliver…
Added 25 mins ago
E
EverHealth - Forward Deployed Engineer (Remote, US)
Evercommerce
Remote, United States
- $140,000 to $170,000 USD / year
Added 25 mins ago
E
EverHealth - Lead Forward Deployed Engineer (Remote, US)
Evercommerce
Remote, United States
- $170,000 to $200,000 USD / year
Added 25 mins ago
E
EverHealth - Software Engineer
Evercommerce
Remote, United States
- $130,000 to $160,000 USD / year
· AI: LLM and agent-based capabilities, including AWS Bedrock and Bedrock AgentCore
Added 35 mins ago
H&
Principal Machine Learning Engineer
Hims & Hers
Remote, United States
- $180,000 to $200,000 USD / year
- Define and drive the architectural vision for ML and LLM systems that support treatment recommendation, personalization, and intelligent care delivery at scale
Added 36 mins ago
Principal AI Platform Engineer
Avaya
United States
Advanced LLM Orchestration: Hands-on experience designing and operating LLM provider integrations, multi-model routing systems, runtime usage and cost controls, semantic drift monitoring,…
Added 41 mins ago
Insurance Product Forward Deployed Engineer – Products & Platforms
Deloitte US
Arlington Heights, IL · Atlanta, GA · Austin, TX · Baltimore, MD · Bellevue, WA · Birmingham, AL · Boise, ID · Boston, MA · Charlotte, NC · Chicago, IL · Cincinnati, OH · Cleveland, OH · Colorado Springs, CO · Columbus, OH · Costa Mesa, CA · Dallas, TX · Davenport, IA · Dayton, OH · Denver, CO · Des Moines, IA · Detroit, MI · Fort Worth, TX · Fresno, CA · Ft. Lauderdale, FL · Gilbert, AZ · Grand Rapids, MI · Hartford, CT · Hermitage, TN · Honolulu, HI · Houston, TX · Huntsville, AL · Indianapolis, IN · Inglewood, CA · Jacksonville, FL · Jericho, NY · Jersey City, NJ · Kansas City, MO · Lake Mary, FL · Lansing, MI · Las Vegas, NV · Los Angeles, CA · Louisville, KY · McLean, VA · Mechanicsburg, PA · Memphis, TN · Miami, FL · Midland, MI · Milwaukee, WI · Minneapolis, MN · Monterey, CA · Morristown, NJ · Nashville, TN · New Orleans, LA · NY · Omaha, NE · Philadelphia, PA · Pittsburgh, PA · Portland, OR · Princeton, NJ · Raleigh, NC · Richmond, VA · Rochester, NY · Rosslyn, VA · Sacramento, CA · Salt Lake City, UT · San Antonio, TX · San Diego, CA · San Francisco, CA · San Jose, CA · Seattle, WA · St. Louis, MO · Stamford, CT · Tallahassee, FL · Tampa, FL · Tempe, AZ · Tulsa, OK · Washington, DC · Westlake, TX · Wichita, KS · Williamsville, NY
Practical understanding of LLM integration patterns, prompt engineering, and AI-powered application design
Added 41 mins ago
Senior Technical Product Manager – AI Agents
NVIDIA USA
CA
…software is composed to be embedded into agent frameworks, developer tools, observability platforms, and third-party solutions, helping customers build agents that are safer, more…
Added 50 mins ago
O
Process Consultant
OpenTent
Denver, CO
- $90,000 to $115,000 USD / year
Daily use of LLM tools (Claude, ChatGPT, Gemini, or Copilot) for real work, and a point of view on where they help and where they don't
Added 1 hour ago
Technology Strategy Technical Lead
McLean, VA
Own technical and product-quality outcomes, including availability, latency, throughput, task completion, developer productivity, and cost per successful outcome, and drive corrective…
Added 1 hour ago
Senior AI Engineer, Finance AI & Automation
BMO Bank N.A.
Chicago, IL
Act as the AI Developer under the Risk and Finance AI Governance Program: complete use case documentation, testing evidence and Ongoing Monitoring Plans address conditions raised in Second…
Added 1 hour ago
AI Data Science Lead – PDM & Tech Ops (Gilead & Kite)
Gilead Sciences, Inc.
Raleigh, NC
Experience with prompt engineering, LLM testing, or AI model experimentation
Added 1 hour ago
AI Platform Engineer
Insight Global
Charlotte, NC
Enable secure access to multiple LLM providers through centralized gateway architecture
Added 1 hour ago
DevSecOps Engineer
BOOZ, ALLEN & HAMILTON, INC.
Fayetteville, NC
Experience with basic AI prototyping, including LLM API use, RAG workflows, or automation assistants, and using AI-assisted engineering tools responsibly
Added 1 hour ago
Staff Application Security Engineer
BambooHR
Remote, United States
…in models and tools; familiarity with the OWASP Top 10 for LLM Applications, the OWASP Top 10 for Agentic Applications, or comparable…
Added 1 hour ago
Staff Engineer, Engineering-wide
Plaud
San Francisco, CA · Palo Alto, CA
…stack runs from devices and mobile to Go/Python services and LLM pipelines, and you'd report to the head of…

Insight Global

AI Platform Engineer

Charlotte, NC, United States

Apply About employer

Applications open in a new tab.

Job details

Posting language: English
Posted: Oct 16, 2026

Original job description

Job Description

Day-to-Day:

Design and implement enterprise-scale AI Gateway solutions utilizing Kong AI Gateway
Configure AI policies including prompt logging, content filtering, token controls, and guardrails
Enable secure access to multiple LLM providers through centralized gateway architecture
Implement AI observability, token analytics, usage monitoring, and cost governance strategies
Develop intelligent AI routing strategies based on latency, availability, and cost
Integrate RAG-based AI services into secure API frameworks
Ensure compliance with AI governance, security, and regulatory requirements
Establish reusable AI APIs and enterprise GenAI best practices
Support AI agent and MCP-based integrations
Maintain platform reliability, scalability, and operational excellence
Administer and support Kong Gateway environments
Develop and manage AI Gateway proxy solutions for GenAI and LLM services
Implement API authentication, security, throttling, and governance policies
Deploy and manage Kong within Kubernetes environments
Monitor, troubleshoot, and optimize platform performance
Automate deployments and operational processes through DevOps tooling
Collaborate with application, security, cloud, and AI teams on gateway strategy and modernization initiatives
Track project delivery, mitigate risks, and communicate with stakeholders •

Job Description:

Insight Global is seeking an AI Platform Engineer with deep expertise in Kong Gateway Administration, API Management, and AI Gateway technologies for a leading enterprise technology client. This individual will serve as a technical leader responsible for driving AI gateway strategy, implementing secure and scalable API platforms, and enabling enterprise adoption of GenAI capabilities. The ideal candidate will have extensive experience with Kong AI Gateway, LLM proxy development, multi-model integrations, and cloud-native technologies. This role will partner closely with application, security, cloud, and AI teams to deliver innovative AI platform solutions, establish governance standards, optimize AI consumption, and ensure secure, reliable access to enterprise AI services across multiple LLM providers.

Skills and Requirements

Must-Haves:

8+ years of experience in API Management, Middleware, or Platform Engineering
5-8+ years of hands-on Kong Gateway Administration experience
Strong experience with Kong Gateway (OSS/Enterprise) and Kong Konnect
AI Gateway and LLM Proxy development experience
Experience integrating OpenAI and Azure OpenAI environments
Expertise in API Management and API Lifecycle Management
Strong understanding of REST APIs and GraphQL
Experience with OAuth2, JWT, OIDC, and API Security
Kubernetes, Docker, and Helm deployment experience
CI/CD experience using Jenkins, GitHub Actions, or Azure DevOps
Experience with Prometheus, Grafana, ELK, or Splunk
Experience working in Azure, AWS, or GCP environments
AI Security, Responsible AI, and Model Governance knowledge
Multi-LLM integration experience (OpenAI, Azure OpenAI, Claude, Gemini, Mistral, Llama)
Experience building governance frameworks for API and AI platforms
Strong stakeholder management and project leadership experience

Plusses:

Experience with Retrieval-Augmented Generation (RAG) architectures
Experience with Vector Databases
LLMOps and AI Observability experience
Prompt Management, Semantic Caching, and Response Optimization expertise
Token monitoring, cost governance, and usage analytics experience
MCP (Model Context Protocol) and AI Agent integration experience
Experience establishing enterprise GenAI platform standards
Cloud-native and microservices architecture experience
Vendor management and coordination experience

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.

Apply About employer

More about this job

Skills

Regulatory compliance
Kubernetes
Troubleshoot
Communicate with stakeholders
IBM Middleware
Microsoft Azure
API development
GraphQL
Docker
CI/CD
Jenkins
GitHub
DevOps
Prometheus
Grafana
Splunk
AWS
Google Cloud
Stakeholder management
Leadership
Microservices Architecture
Vendor management

Report this job