Kineo guide outlines 7 smart data approaches for learning
Wondering what data you should be collecting? How it will inform design decisions? How it can help prove learning impact? Kineo proposes these 7 approaches to learning analytics in its new guide.
The irony of data being almost immeasurable when it comes to proving the impact of your L&D is not something that’s lost on Kineo. The secret to getting the most out of your data is being able to prove and measure what value has been added.
Kirkpatrick’s Model of Evaluation first pioneered by Dr Don Kirkpatrick in 1993, is still one of the most popular training models used in evaluating training programmes today. It consists of four training evaluation levels with each level building on the previous one. These include Reaction, Learning, Behaviour and Results.
Make it meaningful
The levels outlined in the Kirkpatrick Model of Evaluation set clear defined objectives to achieve productive metrics. This is one of the golden rules when it comes to getting the most effective results and understanding your business outcomes. Know how the data you’re collecting will help you – will it inform design decisions, help you learn something about the training or audience, or help prove impact?
“1 in 2 L&D leaders is being asked to prove that they're adding more value. That's a pretty strong stat, with only 6% saying they were under less pressure to prove more value” - David Wilson, Fosway
7 steps to smarter data
In its new guide 'Drowning in Data?', Kineo outlines the following 7 approaches to data gathering for smarter measurement:
- Business Impact: Business impact is about trying to establish a direct correlation between training and a business metric. A common example is making a connection between a new sales training program and the success of your salespeople. It can be one of the trickiest data points to measure, but it can be done, by thinking creatively about how learning maps to business outcomes, or by conducting a control test for example.
- Behaviour Change: This approach starts with building a behavioural model as part of your needs assessment. The behavioural model identifies both positive behaviours – those we want our audience to continue or increase, and negative behaviours – those we want to decrease or eliminate. The measurement strategy revolves around different methods to quantify the frequency of these behaviours before and after the training.
- Application: Assessing application is about creating different experiences in which the skills and knowledge covered in the training need to be used. The most common approach is a scenario-based assessment that provides the opportunity to evaluate learners using hypothetical or expected work situations. This approach is especially useful for assessing learners on things where mistakes and/or failure on the job has great consequences.
- Knowledge Retention: Knowledge assessments are ubiquitous in corporate learning events or courses to measure a learner’s ability to recall facts and terminology. Most often, these assessments appear at the end of a course or module as knowledge checks or quizzes, and at the end of the course as final assessments.
- Confidence: Confidence ratings are metacognitive (that means thinking about your own thinking!), requiring the learners to report their own awareness of their thinking. It is the learner’s self-assessment of their own confidence about a choice or decision, usually given retrospectively after the choice has been made. Learners answer a question and then rate their confidence in their answer.
- Engagement: Unlike the categories above, engagement data isn’t about the content being taught. Instead, it’s about measuring activity. The most common data in this category includes registrations or starts to a course, completions, and time spent.
- Reaction: Reaction data is typically collected via 'smile sheets'. This data reflects the learner’s opinion about or reaction to learning. Questions can range from generic satisfaction – “did you like it”, to gauging helpfulness to the learner’s job, to likeliness to improve performance.
Check out Kineo's eBook Drowning in Data to find out how you can start measuring each of these data types today.