IRS - ITEMS

Integrated Training and Evaluation Measurement Services
PTG developed, implemented and continues to support the Integrated Training Evaluation and Measurement Services (ITEMS) System, a multi-year project for the Learning and Education Division of the Internal Revenue Service. This project currently encompasses the gathering and interpretation of trainee reactions to the training they received, and instructor reaction to the training they taught. Trainee data are used to gauge learning style preferences, other course design effectiveness issues, and overall satisfaction with the course and with the competence of the instructor(s). Instructor data are used to gauge "teach-ability" issues. Course evaluations completed by trainees and instructors for the over 16,000 courses taught by the IRS annually, provide quantitative and qualitative detail that are critical to assessing the strengths and weaknesses of all courses taught.

PTG developed, implemented and continues to support the Level 3 or Post-training evaluation process within the IRS. This level of inquiry determines the extent to which changes in behavior and job performance - competency improvements - have occurred because a participant attended the training. Level 3 evaluation is accomplished by means of a fully web-based survey design, preparation, distribution, collection, evaluation and reporting system. This system allows course developers to develop and administer surveys to course participants and their managers any time after course completion.