TSA – AMTAP
(Automated Multi-level Training Assessment Program)

The Transportation Security Administration (TSA) was created by the Aviation and Security Act as signed by President Bush in November of 2001 to federalize and secure all major modes of transportation after the September 11th terrorist attack. TSA recognized the critical need for comprehensive and timely assessment of training, as a way to shorten the time between hire and the development of operationally acceptable, mission critical competencies.

TSA turned to PTG for help in quickly and effectively addressing this need.

PTG responded by developing and implementing the Automated Multi-Level Training Assessment Program (AMTAP) for TSA, and continues to support this project. The objective of this system is to assure that TSA trainers, site training supervisors, managers, and executives are able to make informed decisions about the effectiveness of training conducted at TSA. These decisions require the availability of accurately gathered information that can be reviewed and analyzed as part of a constant and consistent process of training assessment, modification and improvement. These analyses and their conclusions impact the effectiveness of courses and their delivery, as well as the degree to which courses / curricula increase knowledge, enhance skills, and build competencies.

AMTAP comprises a centralized training evaluation process based on collecting Kirkpatrick Level 1, Reaction; Level 2, Achievement, and Level 3, Performance data from training courses, tests administered to trainees, surveys administered to class participants, and On-the-Job Training Daily Observation Reports recorded at screening/scanning checkpoints throughout the country. This multi-level training evaluation process collects Level 1 and Level 3 data through a combination of scannable paper evaluation forms, electronic data input, telephone response, supervisor-observed electronic assessment of OJT performance, and transcribed handwritten comments provided by students and instructors. The data inputs provided to the Contractor are stored in relational databases. Reports are generated and distributed via email, secure Internet web site and other means. Various class roll-up and management reports are created as required by TSA.

An automated Level 2 system for building, administering, scoring and recording tests that provide valid and reliable results has been put in place for TSA. Since inception of AMTAP, TSA has collected evaluation data for tens of thousands Level 1 and Level 2 training and testing activities.