Our Approach To Evaluation
The Office of Training and Workforce Development uses evaluation tools and strategies to support its efforts to equip child welfare and juvenile justice direct service staff and supervisors with the skills necessary to support children, youth, and families.
This includes:
- Measuring program performance and quality and fidelity.
- Using data for continuous process improvement.
- Assessing transfer of learning, training outcomes and impact.
Evaluation is essential to promoting effective use of public resources in training and workforce development programs that best support child welfare and juvenile justice direct service staff and supervisors as they work to protect and promote the safety and well-being of New York City’s children, youth, and families.
Reaction
The degree to which participants find a training favorable, engaging and relevant to their jobs.
Methods & Results
Participant reaction is measured through a survey called a reactionnaire, distributed at the end of every instructor-led training, virtual instructor-led training, workshop and eLearning module. Positive reactions to the classroom experience support meaningful learning outcomes. Reactionnaires also collect a Net Promoter Score®, a core metric used to assess customer satisfaction by asking customers how likely they are to recommend a product.
Click the dropdown below to view data from our different courses.
Learning
Knowledge checks are the degree to which participants acquire the intended knowledge, skills, attitude, confidence, and commitment based on their participation in the training.
Methods & Results
The Office of Training and Workforce Development administers pre and post tests for every Continuing Education Unit (CEU)-eligible learning program, which seek to measure the knowledge gained over the course of the learning event. These assessments are piloted and analyzed for their validity and reliability.
Click the dropdown below to view data from our different courses.
Behavior
The degree to which participants apply what they learned during training when they are back on the job.
Methods & Results
Transfer of learning is the process by which individuals apply knowledge gained from a learning situation to the job environment. The Office of Training and Workforce Development uses a strengths-based learning culture to support child welfare staff with the transfer of learning.
To measure the transfer of learning, the Office of Training and Workforce Development distributed surveys to better understand the use of coaching and motivational interviewing skills since taking the Building Coaching Competency and Motivational Interviewing learning programs. Below are the results of our transfer of learning surveys.
Motivational Interviewing
The Use Of Coaching
If you are interested in viewing the full results of our transfer of learning surveys, click below
Building Coaching Competency transfer of learning results >
Motivational Interviewing transfer of learning results >
Impact
We partner with stakeholders across the agency to evaluate how learning and professional development can effectively impact family outcomes and contribute to increased child safety, permanency, and well-being.
