Back to results

Practice Architect-Testing

  • Dallas, TX, United States

$128,000 to $192,000 USD / year

Apply on careers.teksystems.com About employer

Applications open in a new tab.

Job details

Pay
$128,000 to $192,000 USD / year
Posting language
English
Posted

Original job description

Think of TEKsystems Global Services (TGS) as the growth solution for enterprises today. We unleash growth through technology, strategy, design, execution and operations with a customer-first mindset for bold business leaders. We deliver cloud, data and customer experience solutions. Our partnerships with leading cloud, design and business intelligence platforms fuel our expertise. We value deep relationships, dedication to serving others and inclusion. We drive positive outcomes for our people and our business, and we stay true to our commitments and act in harmony with our words. We exist to create significant opportunity for people to achieve fulfillment through career success. Ready to join us? Heres what the opportunity supported through our TGS Talent Acquisition Team requires:We are seeking a Practice Architect to lead the design and delivery of AI-driven quality engineering solutions across client engagements. You will architect test strategies and frameworks for both traditional and AI-enabled systems, including ML models, GenAI, LLMs, RAG, and agentic applications, and apply AI to transform how testing itself is designed, automated, and governed. This is a senior, client-facing architecture role. You will shape solutions and Statements of Work, build reusable AI testing accelerators, guide delivery teams, and advise clients on trustworthy, responsible AI adoption. Proven architecture experience is required; AI is central to the role, grounded in strong quality engineering fundamentals. KEY RESPONSIBILITIES Solution Architecture and Practice Leadership

  • Architect end-to-end quality engineering solutions and reference architectures for enterprise applications, data platforms, and AI-enabled systems.
  • Provide architectural direction across engagements; review designs, set standards, and ensure solutions are scalable, secure, and maintainable.
  • Evaluate and recommend tools, platforms, and AI models based on fit, cost, risk, security, and client constraints.
  • Grow the CQ practice by identifying improvement opportunities, defining best practices, and documenting reusable patterns.
  • AI Quality Engineering
  • Design testing methodologies for deterministic and non-deterministic systems, covering data quality and lineage, model behavior and performance, bias, fairness, explainability, drift, robustness, and security.
  • Define evaluation approaches for GenAI, RAG, and agentic systems, including golden datasets, LLM-as-judge, rubric-based scoring, groundedness, hallucination, prompt injection, and tool-use validation.
  • Embed AI quality gates into CI/CD and MLOps/LLMOps workflows, with production monitoring, observability, and drift detection.
  • Define and track AI quality metrics (accuracy, precision/recall/F1, drift, bias indicators, latency, cost, production stability) and support AI governance aligned with client, regulatory, and risk requirements.

AI-Driven Testing Accelerators

  • Architect and build reusable accelerators using LLMs, copilots, prompt engineering, agentic AI, and MCP-based integrations, such as AI-assisted test generation, self-healing automation, prompt validation, and AI regression suites.
  • Establish guardrails for AI-assisted delivery: human review, deterministic validation, traceability, secure data handling, and measurable ROI.
  • Client Advisory and Delivery Leadership
  • Serve as a trusted AI quality advisor through workshops, AI quality assessments, solution design, demos, proofs of concept, and proofs of value.
  • Lead creation and revision of Statements of Work, estimates, and proposals with clear assumptions, dependencies, and scope boundaries.
  • Provide technical leadership and mentorship across delivery teams, scaling AI testing capability and raising maturity in CQ principles, test automation, and quality architecture.
  • Partner with engineering, data science, product, and security teams to embed quality early and continuously across Agile, Waterfall, and hybrid delivery.

REQUIRED QUALIFICATIONS

  • 10+ years in software development or quality engineering, or system integration, including at least 3 years in an architect role (test, solution, or QE architect) at a recognized technology organization.
  • Proven track record designing enterprise test strategies, automation architectures, and frameworks from scratch using Java, Python, or JavaScript/TypeScript.
  • Demonstrated hands-on experience designing and executing testing strategies for AI/ML and GenAI systems, with a strong understanding of AI risks such as drift, bias, hallucination, and security.
  • Expertise in using open-source and commercial AI models, copilots, prompt engineering, and agentic AI to build testing solutions or accelerators.
  • Strong knowledge of UI and API automation (e.g., Playwright, Selenium, Rest Assured, Karate), CI/CD, and cloud platforms (AWS, Azure, or GCP).
  • Familiarity with model evaluation metrics, AI observability, and data validation strategies for data-driven applications.
  • Experience shaping Statements of Work, proposals, and estimates in a consulting or client-facing environment.
  • Excellent communication, presentation, and executive stakeholder skills; able to explain AI risk and quality trade-offs to technical and business audiences.
  • Bachelors degree in computer science or a related engineering field, or equivalent experience.
  • Ability to travel to the United States or Canada, and satisfactory completion of standard employment screening.

PREFERRED QUALIFICATIONS

  • AI evaluation: Experience with evaluation frameworks such as DeepEval, Ragas, promptfoo, or Azure AI / Vertex AI evaluation tools.
  • AI platforms: Exposure to MLOps/LLMOps platforms, vector databases, and AI observability tools.
  • Specialization: Depth in one or more domains such as performance, ETL/data, security, or accessibility testing.
  • Industry: Experience in financial services, healthcare, telecommunications, energy, or other regulated industries.
  • Certifications: One AI testing or cloud certification (e.g., ISTQB CT-AI/CT-GenAI, Azure AI Engineer, AWS ML) and optionally SAFe. Valued, not required.

WHAT SUCCESS LOOKS LIKE

  • Clients adopt AI-enabled quality solutions with clear, measurable improvements in speed, coverage, and risk reduction.
  • Reusable AI testing accelerators are adopted across multiple engagements.
  • SOWs and solutions are well-scoped, delivered predictably, and positioned for expansion.

Job Type & LocationThis is a Permanent position based out of Dallas, TX. Pay and BenefitsThe pay range for this position is $128000.00 - $192000.00/yr. Individual compensation offered for this position within this range will depend on many factors, including qualifications, skills, relevant experience, job knowledge, geographic location, internal equity, and other pertinent job-related factors.We reserve the right to pay above or below the posted wage based on factors unrelated to sex, race, or any other protected classification. Additional earnings may be available through incentive programs like annual bonuses, profit sharing, etc.

Our full-time, internal employment benefits include the following:

Medical, Dental, and Vision Critical Illness, Accident, and Hospital 401(k) Retirement Plan Pre-tax and Roth post-tax contributions available Life Insurance (Voluntary Life and AD&D for employee and dependents) Short and Long-Term Disability Health Spending Account (HSA) Transportation Benefits Employee Assistance Program Time Off/Leave (PTO, Vacation or Sick Leave) Job Type & LocationThis is a Permanent position based out of Dallas, TX. Application DeadlineThis position is anticipated to close on Nov 25, 2026. Workplace TypeThis is a fully remote position.

About TEKsystems

We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.

The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.

About TEKsystems and TEKsystems Global Services

Were a leading provider of business and technology services. We accelerate business transformation for our customers. Our expertise in strategy, design, execution and operations unlocks business value through a range of solutions. Were a team of 80,000 strong, working with over 6,000 customers, including 80% of the Fortune 500 across North America, Europe and Asia, who partner with us for our scale, full-stack capabilities and speed. Were strategic thinkers, hands-on collaborators, helping customers capitalize on change and master the momentum of technology. Were building tomorrow by delivering business outcomes and making positive impacts in our global communities. TEKsystems and TEKsystems Global Services are Allegis Group companies. Learn more at TEKsystems.com.

The company is an equal opportunity employer and will consider all applications without regard to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.

San Francisco Fair Chance Ordinance: Pursuant to the San Francisco Fair Chance Ordinance, for all positions located in the city and county of San Francisco, we will consider for employment qualified applicants with arrest and conviction records.

Massachusetts Lie Detector: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

Use of Artificial Intelligence (AI): We may use Artificial Intelligence (AI) to support parts of our hiring process, including sourcing, screening, and evaluating candidates. AI helps assess applications and qualifications, but final decisions are made by our hiring team. By applying, you acknowledge and agree that your application may be reviewed using AI tools.

Report this job

Get in touch
MovoJobs

Contact us