Exam Developer

Title: Exam Developer Reports to: Director of Certification Development, CAS Scope of Responsibilities The Exam Developer is responsible for supporting the CAS examination construction process to ensure that it is reliable, fair, and valid and meets testing industry standards. The position will work closely with the CAS Certification team, the Exam Working Groups, and task forces and 3rd party testing vendors. The Exam Developer conducts activities across the CAS certification development lifecycle, including but not limited to exam construction, item bank management, security, and publishing. The Exam Developer is responsible for supporting the development, implementation, and management of various assessments and services offered by Admissions.

Duties and responsibilities include but are not limited to the following:

Assessment Development

• Support practice analyses projects.
• Support internal blueprint creation.
• Edit items to ensure psychometric standards, organization standards, and grammar/spelling standards are met.
• Support the item development process and workflow. Work closely with the Certification Program Managers on maintaining the item bank.
• Manage the translation development process for exams that need translations, as needed, acting as a liaison with 3rd party vendors and volunteers to complete the work.
• Assure quality control, maintain accountability, and protect examination integrity throughout the examination process.

Assembly and Production

• Manage the exam/assessment publishing process with the testing delivery vendor and other CAS departments or 3rd party vendors.
• Assemble and review exam forms and provide formal acceptance to the testing delivery vendor.
• Produce electronic assessment forms to send to test delivery vendor.
• Conduct quality control checks on electronic assessment forms assembled by test delivery vendor.
• Assist Certification Analysts in setting up exam grading rubrics and solution files.
• Maintain the security of item bank, exam forms, and confidential candidate and vendor information.

Scoring, Analysis, Reporting

• Develop and maintain a robust security program with support from the Certification Development team.

Operational Support

• Maintain all sections related to form creation and publishing in the Exam Development Processes and Policies document.
• Maintain written instructions and standard operating procedures for accomplishing key functions that is owned.
• Support in-person meetings and logistics as needed.
• Monitor and analyze program specific performance metrics.
• Support the team with programmatic operations and consistency between key transition points within development.
• Handle other projects and assist other operating areas of the CAS Office as assigned.

Required Experiences and Qualifications

• Four year fully accredited bachelor’s degree in Education, Measurement & Statistics, I/O psychology or related field preferred.
• A minimum of three years’ experience as an Exam Developer or comparable position preferably in an association/member-service oriented environment.
• At minimum three years’ knowledge of testing and certification assessment practices to accepted industry standards.
• Experience with ISO 17024 standards for certification programs preferred.
• Ability to manage a high volume of tasks with excellent attention to detail and accuracy.
• Excellent time management skills and ability to coordinate and prioritize production-oriented tasks.
• Excellent communication skills to respond to and interact with the certification team, volunteer working groups, task forces, and candidates.
• Ability to work in a changing environment.
• Experience in project, vendor, and volunteer management.
• Advanced proficiency in Microsoft Office applications.
• Knowledge of computer applications for database management and data analysis. Proficiency in Cobalt is not required, but a plus.
• Knowledge of item banking software and publishing software. Pearson’s ExamDeveloper software experience is not required, but a plus.
• Ability to travel – up to 10%.

Measures of accountability Delivers in accordance with CAS project timelines and annual performance goals.