Posted tagged ‘assessment first’

Micro-learning’s unsung sibling

9 April 2019

Micro-learning is so hot right now.

But I’m not going to deliberate over its definition. If you’re into that, check out Shannon Tipton’s Microlearning: The Misunderstood Buzzword and 7 Deadly Myths of Microlearning.

Nor am I going to try to convince you to jump on board, or abandon ship.

Instead, I’m going to consider firstly how micro-learning might be used in a corporate training context; and secondly, pivot towards something slightly different.

And if you were to find any value in these musings, I’d be delighted.

How micro-learning might be used

The nature of micro-learning lends itself to the campaign model.

Independent but related packets of content that are distributed over time can be woven into the working day of the target audience, and hence reduce time “off the floor”. In this context, the micro-learning is the training.

Similarly I see an opportunity for micro-learning to be deployed before the training. The content can prime the target audience for the experience to follow, perhaps in the form of a flipped class.

And of course I also see an opportunity for micro-learning to be deployed after the training: what one may call “reinforcement” to improve retention and increase the probability of knowledge transfer.

Sure, but does it work?

Well cognitive science suggests it does. I recommend reading up on the forgetting curve, subsumption theory, Piaget, cognitive load, the spacing effect and interleaving. It’s worth it.

A hand holding a pen pointing to a chart.

The pivot

While I’m obviously an advocate of micro-learning, a less buzzy but perhaps just-as-important variant is micro-assessment.

This is similar to micro-learning except the content is in question format – preferably scenario based and feedback rich.

In one sense, the two approaches may be conflated. Formative assessment is nothing new, and a few daily questions over a set timespan could constitute training, or prompt critical thinking pre-training, or promote application post-training.

If you want more bedtime reading, I suggest looking up the testing effect or its synonyms, retrieval practice and active recall.

However I feel the untapped potential of micro-assessment lay in its summative power. As the bank of results builds up over time, the data can be used to diagnose the population’s understanding of the subject matter. If the questions are aligned to competencies, the knowledge gaps can be identified and closed with further interventions.

Hence, micro-assessment can be leveraged to execute an assessment first strategy, thereby increasing the relevance of the L&D service offering to the business.

And if you want yet more bedtime reading, I suggest exploring metacognition and its effect on motivation.

On that note, good night!

Advertisements

The L&D maturity curve

4 March 2019

Over the course of my career, I’ve witnessed a slow but steady shift away from formal learning to informal learning.

Of course, remnants of the “formal first” philosophy still exist, whereby every conceivable problem is attempted to be fixed by a training solution, typically in the form of a course. Over time, the traditional classroom-based delivery of such courses has increasingly given way to online modules, but that’s merely a change in format – not strategy.

While courses certainly have their place in the L&D portfolio, the forgetting curve places a question mark over their longterm effectiveness on their own.

The informal first philosophy balances the pendulum by empowering the employee to self-direct their learning in accordance with their personal needs.

While in some cases informal learning obviates the need for training, in other cases it will complement it. For example, I see the informalisation of learning as an opportunity to deliver the content (for example, via a wiki) which can be consumed at the discretion of the employee. The focus of the course then pivots to the application of the content, which is the point of learning it in the first place. Similarly, the assessment evaluates the learning in the context of real-world scenarios, which is what the learner will encounter post-course.

And since the content remains accessible, it can be used for ongoing reference long after the course has been completed.

A hand holding a pen pointing to a chart.

While I consider the informal first philosophy a giant leap in L&D maturity, it essentially pertains to instructional design. For a more holistic view of L&D, I propose an “assessment first” philosophy by which the capability of the target audience is analysed prior to any design work being undertaken.

The rationale for this philosophy is best appreciated in the context of an existing employee base (rather than greenhorn new starters). Such a group comprises adults who have a wide range of knowledge, skills and experiences. Not to mention they’ve probably been doing the job for a number of years.

Sheep dipping everyone in this group with the same training doesn’t make much sense. For a minority it might be a worthwhile learning experience, but for the majority it is likely to be redundant. This renders the training an ineffective waste of time, and an unnecessary burden on the L&D team.

By firstly assessing the target audience’s proficiency in the competencies that matter, a knowledge gap analysis can identify those in which the population is weak, and targeted training can be delivered in response. Individuals who are “not yet competent” in particular areas can be assigned personalised interventions.

This approach avoids the solution first trap. By focusing the L&D team’s attention on the real needs of the business, not only does the volume of demand reduce, but the work becomes more relevant.

The assessment first philosophy may appear incongruent where new starters are concerned, who by definition are assumed to be weak in all competencies – after all, they’ve only just walked through the door! – but I counter that assumption on two fronts.

Firstly, not all new starters are doe-eyed college grads. Many have had previous jobs in the industry or in other industries, and so they arrive armed with transferable knowledge, skills and experiences.

And regardless, the informal first philosophy holds true. That is to say, the new starter can consume the content (or not) as they see fit, demonstrate their understanding in the scenario-oriented “course”, and formalise it via the assessment.

The results of the assessment dictate any further intervention that is necessary.

Of course, some topics such as the company’s own products or processes will necessitate significant front-end loading via content development and maybe even curricula, but these may be considered the exception rather than the rule. By looking through the lens of assessment first, the L&D team works backwards to focus that kind of energy on where it is warranted.

It is also worth noting the assessment first philosophy renders the traditional “pass mark” obsolete, but such a radical idea is a story for another day!

Laptop showing business metrics.

While the assessment first philosophy represents an exponential leap in the maturity of L&D, there is yet another leap to make: “performance first”.

The raison d’être of the L&D team is to improve performance, so it’s always been a mystery to me as to why our work is so often disconnected to the business results. I do appreciate the barriers that are in our way – such as the inexplicable difficulty of obtaining the stats – but still, we can and should be doing more.

Under the performance first paradigm, it is not knowledge gaps that are analysed, but rather performance gaps. A root cause analysis identifies whether the cause is a capability deficiency or not – in the case of the former, a capability analysis feeds into the assessment first approach; in the case of the latter, a solution other than training is pursued instead.

As with assessment first, performance first may appear incongruent where new starters are concerned. After all, their stats thus far are zero, and waiting to recognise poor performance may have unacceptable consequences.

So again we have another exception to the rule whereby some folks may be scaffolded through L&D intervention prior to their performance being analysed. However the point is, we needn’t force everyone down that road. It depends on the circumstances.

And again, by looking through the lens of performance first, the L&D team works backwards to focus its energy on where it is needed. But this time with results at the forefront of the team’s purpose, its relevance to the business goes through the roof.

The L&D Maturity Curve, featuring Formal First rising to Informal First rising to Assessment First rising to Performance First. The x-axis represents maturity of the L&D function and the y-axis represents its relevance to the business.

I realise my take on L&D maturity might freak some of my peers out. Concurrently, others will argue that we should leapfrog to performance first now and get on with it.

Personally I consider the maturity curve a journey. Yes, it is theoretically possible to skip stages, but I feel that would be a shock to the system. From a change management perspective, I believe an organisation at one stage of the curve would achieve more success by growing into the next stage of the curve, while ironing out the bugs and creating the new normal along the way.

Besides, it isn’t a race. Important journeys take time. What matters is the direction in which that journey is heading.