Archived listing. The details below describe a past opening.
Job Summary:
The Context Engineering Experienced Manager serves as the senior context and knowledge lead for all DT&I product and process development, with primary emphasis on the knowledge, skill, and instruction infrastructure that AI systems and engineers consume. This role leads the design, governance, and continuous improvement of reusable skill libraries, agent-instruction standards (CLAUDE.md and equivalents), retrieval-grounding corpora, and domain-knowledge encodings that make AI-accelerated delivery reliable, repeatable, and audit-ready across the DT&I product portfolio. The role works in close coordination with the AI Engineering Experienced Manager and the Data & Analytics Lead to ensure assurance domain knowledge is captured as high-quality, governed, agent-consumable context. The Context Engineering Experienced Manager partners closely with cross-functional teams to align context-engineering practices, knowledge standards, and product delivery with assurance service delivery objectives, firm policies, and security standards.
Job Duties:
Context Architecture & Knowledge Engineering
- Designs and maintains the firm’s context infrastructure including hierarchical skill libraries (foundation and archetype layers) and agent-instruction standards (CLAUDE.md and equivalents) with defined inheritance, ownership, and versioning
- Serves as the principal technical authority on prompt and context patterns, reusable scaffolding, and context-as-code discipline across the DT&I portfolio
- Defines how assurance domain knowledge is captured, structured, and surfaced to AI systems, and codifies BDO methodology (AKB) into retrievable, governed knowledge
- Evaluates and integrates emerging context-engineering tools, frameworks, and knowledge platforms to continuously improve grounding quality and developer enablement
- Designs context evaluation, provenance tracking, and citation discipline to ensure traceable, trustworthy grounded outputs
- Establishes reusable context architectures, templates, standards, and reference implementations for product teams and engineers
- Provides technical direction for complex context architecture decisions involving scalability, maintainability, security, cost, and operational support
Retrieval & Grounding Engineering
- Owns retrieval-corpus curation and grounding quality including source selection, chunking strategy, embeddings, and index design using Azure AI Search and vector stores
- Designs and tunes retrieval pipelines (hybrid search, re-ranking, metadata filtering) for accuracy, cost, and latency across DT&I products
- Establishes corpus lifecycle management including freshness, versioning, deduplication, and retirement of stale knowledge
- Partners with the AI Engineering Manager to integrate grounded context into agent and application runtimes
- Establishes and implements grounding evaluation frameworks, regression tests, benchmark datasets, and quality metrics for retrieval-augmented features
- Identifies retrieval and grounding deficiencies and leads corrective actions across affected products
- Guides cross-functional teams through complex retrieval, indexing, and knowledge-representation challenges
Context Governance & Enablement
- Governs the skill and context catalog as a managed asset with named ownership, review cadence, and change control consistent with the Advantage SDLC and Architecture Review Board
- Provides governed context scaffolding and standards for the Advantage Forge citizen-engineer program and product teams
- Coaches engineers on context-engineering practice and maintains documentation so AI-native development scales across the practice
- Establishes standards for token economics, context-window management, and prompt efficiency across the portfolio
Risk Management
- Ensures context infrastructure and grounded knowledge comply with firm security policies, privacy requirements, and regulatory standards (SOC 2, PCAOB AS 2201, QC 1000, ISO 27001)
- Establishes controls that prevent sensitive or restricted data from entering prompts, corpora, or model context, and maintains auditability and traceability of grounded knowledge
- Partners with risk and compliance stakeholders to maintain alignment between context infrastructure and firm governance requirements
Performs other duties as assigned
- Willingly accepts share of less desirable assignments
Supervisory Responsibilities:
- Acts as a direct supervisor to engineering and development team members, as assigned
- Acts as a career advisor and mentor to engineering and development team members as assigned
Qualifications, Knowledge, Skills, and Abilities:
Education:
- High School Diploma/GED, required
- Bachelor’s degree with a focus in Computer Science, Information Systems, Engineering, Information Technology, preferred
Experience:
- Eight (8) or more years of experience in software, data, or AI engineering, or related technology fields, required
- Four (4) or more years of experience building LLM context, retrieval-augmented generation (RAG), or knowledge-management systems, required
- Three (3) or more years of experience defining reusable engineering assets, developer-enablement tooling, or technical standards, required
- Experience leading technical teams or directing complex cross-functional initiatives, preferred
- Experience extracting and codifying domain knowledge into machine-consumable formats, preferred
- Experience delivering enterprise-scale AI or knowledge solutions in professional services, assurance, or accounting industries, preferred
- Experience with context governance, prompt management, or AI evaluation frameworks, preferred
License/Certifications:
- Microsoft Certified: Azure AI Engineer Associate, or equivalent, preferred
Technology:
- Expert-level knowledge of Microsoft Azure AI services including Azure AI Foundry, Azure OpenAI, and Azure AI Search, required
- Strong understanding of LLM context windows, prompting, retrieval, and grounding, and how each affects accuracy, cost, and reliability, required
- Experience with retrieval and vector technologies (Azure AI Search, embeddings, hybrid search, re-ranking), required
- Extensive knowledge of agent-instruction and skill systems (CLAUDE.md and equivalents) and Markdown-based knowledge structures, required
- Experience with agentic development tooling (Claude Code or equivalent) and Git-based workflows, preferred
- Experience with .NET/C# and/or Python for context and evaluation tooling, preferred
- Experience with AI evaluation and observability tooling, preferred
Knowledge, Skills, & Abilities:
- Expert-level knowledge of context engineering, retrieval design, and grounding for production LLM systems
- Proven ability to serve as a hands-on context architect while providing standards, governance, and team enablement
- Deep knowledge of information architecture and the ability to translate subject-matter expertise into machine-consumable knowledge
- Familiarity with AI application and agent runtimes and the ability to collaborate with engineering teams on context dependencies
- Excellent problem-solving skills with a focus on accuracy, reliability, and grounding quality
- Strong communication skills with the ability to convey technical concepts to non-technical stakeholders and leadership
- Experience presenting context and AI governance recommendations to governance bodies (e.g., Architecture Review Boards)
- Strong knowledge of data privacy, security, and compliance considerations for AI and knowledge systems
- Ability to work across technical teams and business stakeholders in complex, fast-paced enterprise environments
- Self-directed with the ability to manage multiple priorities and competing deadlines
- Collaborative mindset with the ability to build relationships across all levels of the organization
- Ability to travel up to 10%, no relocation required
Individual salaries that are offered to a candidate are determined after consideration of numerous factors including but not limited to the candidate’s qualifications, experience, skills, and geography.
National Range: $150,000 - $180,000
Maryland Range: $150,000 - $180,000
NYC/Long Island/Westchester Range: $150,000 - $180,000
At BDO, how we show up matters. We build strong relationships by supporting one another, our clients, and our communities with care, curiosity, and a commitment to helping one another grow and succeed. Here, you’ll find meaningful work, leaders invested in your success, and opportunities to build a career around what matters most to you.
Our purpose is to be the people our clients count on to grow with confidence and achieve what matters most. Our values guide how we bring that purpose to life each day. Together, they shape how we work with one another, serve our clients, and create meaningful impact.
BDO provides assurance, tax, and advisory services to clients across the U.S. and around the world. No matter your role, you’ll be part of a team helping clients navigate complexity and move forward with clarity.
As technology continues to shape how we work, BDO values the ability to apply generative and agentic AI solutions to develop work products, improve workflows and identify potential risks. Across our firm, we emphasize professional judgment in validating AI-generated outputs for accuracy, quality, and compliance.
We are proud to be an ESOP company, offering participants a stake in the firm’s success through beneficial ownership and a unique opportunity to enhance their financial well-being. As a qualified retirement plan, the ESOP is a meaningful addition to our comprehensive compensation and Total Rewards benefits* offerings. It also reinforces an ownership mindset that strengthens our connection to one another, our clients, and the future we’re building together.
Learn more about our benefits: BDO Total Rewards encompass more than traditional benefits. Click here to find out more!
*Benefits may be subject to eligibility requirements.
Equal Opportunity Employer, including disability/vets Click here to find out more!