AI Engineer

Job Title: AI Engineer (Mid-Level)

About Us:

Metas Solutions excels in providing strategic consulting, program management, and data-driven analytics to federal public health agencies. Our expertise enhances health systems and delivers measurable outcomes, helping agencies achieve their mission. We collaborate with federal partners to implement agile solutions for national public health initiatives, driving impactful changes through cutting-edge programs that strengthen communities and promote well-being. See www.metassolutions.com for further details about us and careers with Metas.

Job Description:

Metas Solutions has an "immediate opening" for a talented AI Engineer Facilitator. In this role, you will build, enhance, and support generative AI web applications, including retrieval-based knowledge assistants, chatbots, and agent workflows. You will implement features, integrate enterprise data and services, troubleshoot issues, and improve application quality. You will work with senior AI engineers, architects, product owners, data engineers, and DevSecOps teams to deliver secure, maintainable production applications. assess and suggest areas of improvement and potential solutions.

Responsibilities:

• Build, enhance, and support production generative AI applications and web-based AI solutions.
• Develop Python backend services and AI integrations using Azure OpenAI, Azure AI Foundry, and related Azure services.
• Implement RAG pipelines, including document processing, chunking, embeddings, search, context preparation, and source citations.
• Implement agent workflows using tool/function calling, structured outputs, conversation context, error handling, execution limits, and human review where needed.
• Integrate AI applications with APIs, enterprise data sources, databases, cloud services, and MCP-based tools.
• Test and evaluate retrieval relevance, answer correctness and grounding, reliability, latency, and cost.
• Add logging, tracing, and metrics to monitor model calls, retrieval steps, tool execution, errors, and token usage.
• Troubleshoot application issues, fix defects, and support deployments and production monitoring.
• Participate in code reviews, document implementation decisions, and collaborate with engineering and DevSecOps teams.

Qualifications:

• 3+ years of technical experience, including developing and supporting production software applications
• 1+ year of hands-on generative AI development, including RAG-based assistants or chatbots
• Experience with Python backend development, including asynchronous APIs, using FastAPI, Pydantic, or comparable tools
• Experience with Git, code reviews, automated testing, CI/CD, and Agile team delivery
• Experience with Azure, including Azure OpenAI, Azure AI Search, and integration with databases and external services
• Ability to demonstrate agent workflow experience with tool calling, structured outputs, and context management using PydanticAI, Microsoft Agent Framework, LangGraph, Foundry Agent Service, or similar tools
• Ability to conduct LLM evaluation and troubleshooting using test datasets, logs, and traces to assess quality, latency, and cost
• Possession of hands-on RAG experience with document processing, chunking, embeddings, vector or hybrid search, and citations
• Bachelor's degree in computer science, engineering, or a related field

Additional Qualifications:

• Experience with Langfuse, Pydantic Logfire, or similar AI observability tools, and OpenTelemetry
• Experience with advanced RAG, multi-agent workflows, or MCP integrations
• Experience with Docker, Azure deployment services, or frontend development using React, Angular, or TypeScript
• Knowledge of open-source LLM hosting using vLLM, SGLang, or similar frameworks
• Knowledge of LLM fine-tuning and optimization, including PEFT, LoRA/QLoRA, and quantization

Security Requirements:

• Must be US Citizen and with the ability to obtain a US Government security clearance (Public Trust 5) within a reasonable period.
• Market competitive salary, commensurate with experience and education.
• Comprehensive benefits package available, Medical, Dental, Vision and Life Insurance, Paid Time Off (PTO), 401K with company match, growth, and promotion opportunities.

Notice on Candidate AI Usage

Metas Solutions is committed to maintaining a fair and competitive interview process for all candidates, based on their experience, skills, and education. To preserve the integrity and fairness of our interview process, candidates are expected to respond to all interview questions based on their own knowledge, skills, and experience. The use of artificial intelligence (AI) tools or other third-party resources to generate, assist with, or provide interview responses during phone, virtual, or in-person interviews is not permitted. Any use of AI-assisted responses during the interview process may result in disqualification from further consideration for employment.

We are an Equal Opportunity Employer/Veterans/Disabled