Tag: proficiency

Semantics, semantics

I dislike grammar jokes, pedants, and Oxford commas.

That’s my jovial way to end a year that will be remembered as a tough one for a long time to come.

I found blogging a welcome distraction, so much so that in addition to my annual list of e-learning conferences in Australia (which took a beating!) I churned out no fewer than ten thought pieces.

My joke at the start of this summary is a nod to the theme of semantics, which I maintain are important in the L&D profession. Because it is with shared meaning that we do our best work.

I invite you to share your own views on each piece, so feel free to drop me a like and contribute a comment or two…

A vintage poster depicting a group of dogs of different breeds

I hope you find my articulations helpful.

In the meantime, I wish that for you and your family the Christmas season will be a time of healing, rest and renewal.

Scaling up

In Roses are red, I proposed definitions for oft-used yet ambiguous terms such as “competency” and “capability”.

Not only did I suggest a competency be considered a task, but also that its measurement be binary: competent or not yet competent.

As a more general construct, a capability is not so readily measured in a binary fashion. For instance, the question is unlikely to be whether you can analyse data, but the degree to which you can do so. Hence capabilities are preferably measured via a proficiency scale.

Feet on scales

Of course numerous proficiency scales exist. For example:

No doubt each of these scales aligns to the purpose for which it was defined. So I wonder if a scale for the purpose of organisational development might align to the Kirkpatrick Model of Evaluation:

 Level  Label  Evidence 
0 Not Yet Assessed  None
1 Self Rater Self rated
2 Knower Passes an assessment
3 Doer Observed by others
4 Performer Meets relevant KPIs
5 Collaborator Teaches others

Table 1. Tracey Proficiency Scale (CC BY-NC-SA)

I contend that such a scale simplifies the measurement of proficiency for L&D professionals, and is presented in a language that is clear and self-evident for our target audience.

Hence it is ahem scalable across the organisation.

The future of learning management

People familiar with my blog will know that I’m not a member of the anti-LMS brigade.

On the contrary, I think a Learning Management System is a valuable piece of educational technology – particularly in large organisations. It is indispensible for managing registrations, deploying e-learning, marking grades, recording completion statuses, centralising performance agreements and documenting performance appraisals.

In other words – and the name gives it away – an LMS is useful for managing learning.

Yet while LMSs are widely used in the corporate sector, I suspect they are not being used to their full potential. You see, when most people think of an LMS, they think of formal learning. I don’t.

I think of informal learning. I think of the vast majority of knowledge that is acquired outside of the classroom. I think of the plethora of skills that are developed away from the cubicle. I think of reading a newspaper and chatting around the water cooler, and the myriad of other ways that people learn stuff. Relevant stuff. Stuff that actually makes a difference to their performance.

And I wonder how we can acknowledge all of that learning. We can hardly stick the newspaper or the water cooler into the LMS, although many will try in vain.

No – the way we can acknowledge informal learning is via assessment. Assessment represents the sum of learning in relation to a domain, regardless of where, when or how that learning was done.

The assessment need not be a multiple-choice quiz (although I am not necessarily against such a device), nor need it be online. The LMS only needs to manage it. And by that I mean record the learner’s score, assign a pass or fail status, and impart a competency at a particular proficiency.

In this way, the purpose of learning shifts from activity to outcome.

Aliens lined up in the style of the video game Space Invaders.

Having said that, the LMS suffers a big problem: portability.

I’m not referring to the content. We have SCORM to ensure our courses are compatible with different systems. Although, if you think migrating SCORM-compliant content from one LMS to another is problem free, I have an opera house to sell you. It has pointy white sails and a great view of the harbour.

No – I’m referring to the learner’s training records. That’s the whole point of the LMS, but they’re locked in there. Sure, if the organisation transfers from one LMS to another, it can migrate the data while spending a tonne of money and shedding blood, sweat and tears in the process.

But worse, if the learner leaves the organisation to join another, they also leave their training records behind. Haha… we don’t care if you complied with the same regulations at your last organisation. Or that you were working with the same types of products. Or that you were using the same computer system. We’re going to make you do your training all over again. Sucker.

It’s hardly learner-centered, and it sure as hell ain’t a smart way of doing business.

Enter Tin Can

According to my understanding, Tin Can is designed to overcome the problem of training record portability. I imagine everyone having a big tin can in the cloud, connected to the interwebs. When I complete a course at Organisation A, my record is recorded in my tin can. When I leave Organisation A for a better job at Organisation B, no worries because I’ve still got my tin can. It’s mine, sitting in the sky, keeping all my training records accessible.

This idea has taken the education world by storm, and some LMSs such as UpsideLMS have already integrated the API into their proprietary architecture.

Furthermore, I can update my tin can manually. For example, if I read a newspaper article or have an enlightening conversation with someone around the water cooler, I can log into my account and record it.

This sounds admirable prima facie, but for me it raises a couple of concerns. Firstly, the system is reliant on the learner’s honour – ! – but more concerningly, its philosophy reverts back to activity over outcome. Recording reams and reams of minor learning interactions all seems a bit pointless to me.

So where to from here?

Enter Plurality

Plurality is a brilliant short film watched by the participants in Week 2 of The University of Edinburgh’s E-learning and Digital Cultures course.

The film paints a dystopian vision of the future whereby everyone’s personal details are stored in an online grid, which is controlled of course by the government. When you swipe your finger over a scanner, the computer reads your DNA and identifies you. This is convenient for automatically deducting the cost of a sandwich from your bank account, or unlocking your car, but not so convenient when you are on the run from the cops and they can track you through everything you touch.

Despite the Big Brother message pushed by the film, it prompted me to recognise an emerging opportunity for Tin Can if it were to re-align its focus on assessment and exploit the Internet of Things.

Suppose for example you are sitting in a jumbo jet waiting to take off to London or New York. If the cockpit had a scanner that required the pilot to swipe his finger, the computer could check his tin can to confirm he has acquired the relevant competencies at the required proficiencies before activating the engine.

Or suppose you are meeting a financial advisor. With a portable scanner, you could check that she has been keeping up with the continuing education points required by the relevant accreditation agency.

Competencies and assessment tend to cop a beating in the academic sphere, but in the real world you want to be reasonably confident that your pilot can fly a plane and your financial advisor knows what she’s talking about.

If the film’s portrayal of DNA is too far-fetched, it need not be the mechanism. For example, the pilot could key in his personal credentials, or you could key in the financial advisor’s agency code.

But maybe it’s not so far-fetched after all. The Consortium for the Barcode of Life – based at the Smithsonian Institution’s National Museum of Natural History, no less – is currently researching DNA barcoding.

And still, maybe Plurality is looking at it the wrong way around. We can already store digital information in synthetic DNA. Perhaps in the not-too-distant future our training records will be coded into our natural DNA and injected back into our bodies. Then instead of the scanner referring to your tin can in the cloud, it mines your data right there in your genes.

And you thought science fiction was scary!