Analyzes system requirements and concept of operations documents, acquisition plans, and system descriptions to develop evaluation and test plans and procedures, prepare for and conduct the data collection and analysis, and report status and results.
Supports the development of customer test and evaluation documentation e.g., Test and Evaluation (TandE) Strategy, Test and Evaluation Master Plan, Event Test Plans, Test Readiness Assessments, and TandE Reports.
Works with other test organizations to support TandE program integration. Provides specialized TandE capabilities tailored to system functions, level, maturity, and performance area as assigned in the SOW.
Assist with any or all of the Level 1 tasks as constrained by technical training and previous testing experience
Conduct research into and apply knowledge of customer test and evaluation concepts all related engineering acquisition and operations activities as needed to support the TandE activities
Plan and Execute Performance Analysis
Review planned acquisition approaches to support TandE schedule alignment with decision maker needs for TandE support
Analyze performance risk areas to focus TandE planning
Specify, validate, and adapt Modeling and Simulation for TandE use
Apply Statistical Analysis of variations in performance behavior to characterize confidence in performance estimates
Select, develop, and use analysis tools
Execute the evaluation plan of data collected by the Testing Task
Plan and Execute Performance Data Collection
Plan program and event level testing for collection of data required for analysis and to synch TandE events with supported decision points
Establish and employ Data and Configuration Management capabilities
Support Data Authentication group functions; and comply with program Discrepancy Reporting criteria and processes
Assess operational and system performance requirements for testability and criticality to frame and prioritize TandE objectives and enable evaluation planning
Coordinate with program Systems Engineering (SE) and review TandE-related SE information to leverage functional analysis, system descriptions parameter selection and dependencies, Modeling and Simulation, and initial performance risk assessments to inform evaluation planning
Assess operational environments and priorities for evaluation attention and scenario selection, and to coordinate user participation in TandE
Plan project and event level risk-tailored performance estimation and analysis of system and operational Effectiveness and Suitability metrics and conditions levels of TandE include inspection, demonstration paper analysis, survey simulation, and physical test
Design surveys for evaluation of Subject Matter Expert (SE input and user as estimates of performance)
Participate in the TandE Working-level Integrated Product Team (WIPT) and/or Integrated Test Team for coordination of evaluation plans
Produce Evaluation Plans (metric framework, scenarios/threads, timelines, requirements/TandE cross-walk), Analysis Plans Data Requirements Risk Assessments, Evaluation Reports Status reports; provide input to customer TandE products (e.g., Technology Readiness Assessments, Test and Evaluation Strategy, Test and Evaluation Master Plan, TandE Plans and Procedures and Test
Readiness Reports)
Design data sampling schemes to optimize the information/resource balance and to control testing uncertainties
Select, coordinate. and calibrate Instrumentation, collection and data management tools, targets, and facilities
Ensure test readiness including training of test event participants re conduct of the event; equipment readiness, and security legal, and privacy compliance arrangements
Participate in TandE WIPT and/or Integrated Test Team for coordination of data collection plan -
Execute Testing and Data Collection per plan
Produce associated Test Plans, Procedures, and Reports /Briefings, Data Management Plan
Define and provide technical direction and guidance for the Level 1 tasks to the Level 0 and Level 1 TEs assigned to the task
Recommend draft plans and reports from the Level 1 tasks for approval by the task leader
Work directly with the customer to coordinate task implementation
Maintain knowledge of current and evolving customer, national, and international standards applicable to the system development of interest
Provide overall leadership of the TandE task and serve as primary liaison to the customer for supporting contract coordination and task execution
Communicate issues and solutions to the broader cusomter and contract management structure as requested by the customer
Ensure the appropriate level of independence of the team from the solution provider to support customer management of objectivity risk
Manage TandE resources and tasks; ensure quality assurance of test processes and product
Coordinate and integrate Evaluation and Testing tasks and products
Participate in TandE WIPT and /or integrated Test Team as needed to ensure proper coordination of TandE activities
Drive innovation and responsiveness to program changes and evolving TandE status to help manage program risk; develop alternative courses of action, work-arounds, and fall-back positions with a recommended course of action for each risk and monitor and re-evaluate risks at appropriate milestones