Kirkpatrick's 4 layers of evaluation

Many of you will hear about this in the CPPW scrum, but i wanted to quickly update you on the evaluation data and how we are collapsing in into Kirkpatrick's 4 layers of evaluation.The four levels of evaluation include: 1) reactions, 2) learning, 3) behaviors and 4) results, with each level building upon the other. 

 
We used the first level, reaction, to design our curriculum. That feedback was used to improve our storytelling training. Data collected in this level include the review of existing literature, interviews with story trainers, and the learning layer at each training.

The second level, learning, was conducted using a Readiness Assessment developed by our team. In order to assess learning pre- and post-training, a readiness graph is administered. Readiness in this context refers to an individual or organization’s shared resolve to implement a change and shared belief in their individual or collective capability to do so (Weiner 2009).

The third level, behavior, looks to understand whether and how competencies are transferred and participants use the strategies learned in the training. Are the principles being conveyed actually applied post-training? We capture these data via a follow-up interview technique we call Following the Story.

Finally, the fourth level, results, focuses on the success and impact of our training. We want our participants to use strategies to achieve social action and change. The impact of story system develops an infrastructure of measurable action outcomes (The Harvard Family Research Project).



Quick peek at data collected: 

1. Reactions - literature review, Conceptual Model, toolkit interviewing trainers and refine training
2. Learning  - readiness and learning layer,
3. Behavior - following the story and use interviews and key informant interviews with Maui folks and other CPPW affiliates like the DHS and CDC
4. Results - overall survey of CPPW storytelling impact