Posted tagged ‘learning management system’

The dawn of a new generation

22 July 2014

User-generated content (UGC) is not a novel concept, but most of us in the corporate sector have barely scratched its surface.

Beyond enterprise social networks – which are hardly universal and face substantial challenges of their own – UGC in the broader sense is beset by concerns about content quality, accountability, organisational culture, job security and power dynamics.

And yet… the world is changing.

Notwithstanding either the validity or the importance of our concerns with UGC, the traditional training model is becoming increasingly unsustainable in the modern workplace. And besides, I think most of our concerns can be addressed by a change in mindset, a little imagination, a dash of trust, and a collective commitment to make it work.

To explore the practicalities of user-generated content, the Learning Cafe sponsored a webinar entitled Learner Generated Learning Content – Possibilities, mechanics and chaos? The event was hosted by Jeevan Joshi and presented by myself, Andrew Mazurkiewicz and Cheryle Walker.

My part comprised a proposed solution to a fictional caselet. Both the caselet and the transcript of my proposal are outlined below…

Call centre

Ron is the manager for a 250 seat contact centre at an insurance company in 3 locations. Ron has made sure that there is a comprehensive training program to cover all aspects of the job. However in the past 6 months improvements have plateaued despite improving the content and structure of the training workshops. Ron did an analysis of contact centre data and concluded that further improvements were only possible if practical knowledge and better practices known to the team were shared in the team.

Denise, a team leader suggested that operators would be keen to share how they dealt with difficult or complex calls using the web cam on the PC and post it on the intranet. Ron was concerned that recording may be a distraction and may be perceived by some as monitoring performance. Kit, the Learning Consultant insisted the videos should be loaded on the LMS so that the time spent and results could be tracked. There were also concerns that inappropriate videos may be posted. Denise was however convinced that it was a good idea and the only way to improve further performance. What should Ron do?

Formal training

Well firstly I think Ron should retain his formal training program. It’s important for the organisation to cover off its “must know” knowledge and skills, and formal training can be a quick and efficient way of doing that. Besides, moving away too radically from formal training would probably be a culture shock for the company, and thus counter-productive. So in this case I suggest it would be best to build on the foundation of the training program.

Training is the front end of an employee’s learning & development. I know from first-hand experience that there is a lot for contact centre staff to take in, and they can’t possibly be expected to remember it all. So the formal training needs to be sustained, and a powerful way of doing that is with an informal learning environment.

Formal training complemented by a content repository

A key component of the informal learning environment is the content repository – such as an intranet or a wiki – that contains content that the employee can search or explore at their discretion. The logical place to start with this content is with the existing training collateral. Now, I don’t mean simply uploading the user guides, but extracting the information and re-purposing it in a structured and meaningful way on-screen.

If Denise knows operators who are keen to generate content, then I would certainly welcome that. These people are the SMEs – they live and breathe the subject matter every day – so they are the obvious choice to add value.

However, I’m not sure if web cams are necessarily the way to go. In the case of dealing with difficult calls, audio would be a more authentic choice; visuals wouldn’t add anything to the learning experience – in fact, they’d probably be distracting. The operator could request a particular recording from the quality system and write up in text how they handled the call. And if they used a tool like Audacity, they could easily cut and edit the audio file as they see fit.

Another way of generating content – especially for process and system training – might include Captivate or Camtasia, which are really easy to use to produce handy tutorials.

An important point to remember is that the operator on the phone might need to look up something quickly. For example, if they have an angry or abusive caller on the other end of the line, they won’t have the luxury of wading through reams of text or listening to a 7-minute model call. So it’s important that the practical knowledge be provided in the form of job aids – such as a template or a checklist – that the operator can use on-the-job, just-in-time.

I don’t agree with Kit that this content should be put on the LMS. Frankly, no one will go in there – and in my opinion, that’s not what an LMS is for. By definition, an LMS is a Learning Management System – so use it to manage learning. It makes sense to use the LMS for the formal training program – for things like registrations, grading, transcripts, reporting etc. In contrast, what we’re talking about here is the act of learning – not its management. The operator needs a resource that is easy to access, easy to navigate, to learn what they need to do their job in the moment.

We must remember that the point of learning is performance – so the focus of our measurement and evaluation energies should be on the performance stats. The employees would have been thoroughly assessed during the formal training program, so now is not the time to go loading the LMS with more stuff just for the sake of tracking it. The real tracking now should be done with the business scorecard.

Formal training complemented by a content repository, which in turn is complemented by a social forum.

OK, a missing link in this solution is a social forum.

If an operator can’t find what they need, a social forum enables them to ask their crowd of peers. And again, because these peers are themselves SMEs, someone is likely to have the answer. Not only does this approach service the operator with the information they need, but other operators can see the interaction and learn from it as well.

Also, by keeping tabs on the discussions in the forum, the L&D professional can identify gaps in the solution, and review the content that is evidently unclear or difficult to find.

So in summary, my solution for Ron is an integrated solution comprising his formal training program, complemented by an informal learning environment including a structured content repository, which in turn is complemented by a social forum.

Those among us who like the 70:20:10 model will see each component represented in this solution.

Formal training (10) complemented by a content repository (70), which in turn is complemented by a social forum (20).

Do you agree with my integrated solution? What else would you recommend, or what would you propose instead?

Are we witnessing the dawn of a new generation? Can user-generated content be a core component of the corporate L&D strategy? Or is it just a pipe dream?

Is the pedagogy of MOOCs flawed?

26 August 2013

This is a question that I tackle in my Udemy course The Wide World of MOOCs.

Almost immediately after I uploaded this preview to YouTube, someone on Twitter politely challenged me.

She took umbrage to my assertion that MOOCs are pedagogically richer than “regular” online courses.

Her counter argument was that the pedagogical devices that I cited – readings, online discussion forums, social media groups and local meetups – are the same learning and teaching functionalities available in any LMS.

While this claim is partly true, I wish to share with you my [elaborated] defence of my initial assertion. Why? Because I think it’s important to hear all POVs, and I’d like to know whether you agree…

Hand on keyboard

Right off the bat, I don’t believe that all the pedagogical devices that I cited are available in any LMS. They may be available in many LMSs, but certainly not all of them. Moreover, although an organisation may have a subscription to an LMS that offers these devices, it may not have them activated.

That of course is not to say that the e-learning designer is prevented from using these devices; for example, he or she might leverage other non-LMS technology within the organisation or in the cloud. However, in my experience and in conversations with others, it is clear that they often don’t.

Again, that’s not to say that no e-learning designers integrate devices such as online discussions and social media groups into their LMS-hosted courses, but even if they do, the target audience tends not to play ball. How to encourage active participation on social platforms is a hot topic in the L&D sphere, and there is no easy answer because it’s a question of organisational culture which can’t be “fixed” over night.

As for local meetups, in all my years I have never seen this offered in a regular online course!

Network Analysis of the EDCMOOC Facebook group

MOOCs, on the other hand, are the polar opposite. All of the MOOCs I have experienced include readings, online discussion forums, social media groups and local meetups. And the participants do participate. Sure, that’s to be expected given the massive scale of MOOCs, but that doesn’t make it any less true.

Case in point, the University of Edinburgh’s E-learning and Digital Cultures MOOC is one of the best online courses I have ever experienced. While it had its fair share of pro’s and cons, it was a hell of a lot richer than the boring page turners that too many among us have learned to associate with “e-learning”.

And there was no LMS in sight.

Udemy for you and me

13 August 2013

It seems like every time you blink, another free tool becomes available to help you create online learning resources.

One of them is Udemy – a web-based platform that enables anyone to create and deliver online courses for free. Simply open an account and you are provided with the tools you need to structure your curriculum, upload your content, and publish your course to the world.

Udemy has actually been around since 2010, but I only recently decided to dabble in it. In so doing, I created Audacity Crash Course and The Wide World of MOOCs.

Audacity Crash Course landing page The Wide World of MOOCs landing page

I thoroughly enjoyed using Udemy. I found it to be a simple yet powerful tool.

Having said that, everything has its pro’s and cons, and this was no exception. In case you are considering using Udemy for your own purposes, I will share some of my experience with you now…

Thumbs up

Pro’s

  • Udemy is incredibly easy to use. Creating lectures, rearranging them and uploading the content is a dream. I jumped straight into it without referring to the instructions, and while I’m familiar with authorware, I expect it’s intuitive enough for Average Joe to work out too. If not, it’s carefully scaffolded each step of the way.

  • The help resources are helpful. When I couldn’t figure out how to delete a lecture, for example, I found the solution via someone else who had raised a similar problem.

  • Every course undergoes a quality review process by the Udemy team. If and when it meets their standards they will add it to the marketplace, which means it will be discoverable by the public. The turnaround time for this process is 3-4 business days, which I consider reasonable.

  • When you publish your course, it is immediately live on the interwebs. That means prior to (and even regardless of) it being accepted into the marketplace, it will have a URL which you can promote to your target audience.

  • The business model enables you to monetise your course by assigning a price to it, of which Udemy claims a 30% cut. This seems reasonable to me, as it is the same cut that Amazon takes via its Kindle Direct Publishing service.

  • A coupon generator allows you create discount coupons at your discretion, empowering you to set the discounted price, the number of coupons, and the deadline. Of course, your cut will then come out of the discounted price rather than the full price. (The algorithm is slightly different for coupon-derived sales.)

  • You can also add your course to the Udemy affiliate program, which makes it available for others to promote for a share of the spoils. Conversely, you can earn a cut by promoting other people’s courses too.

Thumbs down

Cons

  • Udemy assumes that the bulk of your course will be lectures. In fact, one of their standards is that the course contains a minimum of 30 minutes of video content. While I understand why they do this, I also suspect it encourages “padding” and might make the course longer than it ought to be.

  • Another standard maintains that the lectures be 2-15 minutes in length on average “or appropriately long based on the instructional content”. I ran afoul of this one when I published The Wide World of MOOCs because – as you can see on the landing page – most of my lectures are less than 2 minutes each, which I argued was instructionally sound in light of the nature of the content.

    If Udemy had rejected my argument, I would have had no choice but to consolidate my Q&A videos into one long clip – which not only would have compromised the integrity of the instruction IMHO, but also would have affected the marketing as prospective students would not be able to see the full outline of the contents.

    Luckily though, the Udemy folk were true to their word and honoured the “or appropriately long based on the instructional content” aspect of the standard.

  • Udemy’s predilection for video presents another unexpected quibble. Leaving aside academic arguments about the pedagogy of lectures – which I think, for the record, depends on the circumstances – the curriculum builder labels every stage of your course a “lecture”. This makes it awkward when, for example, you want to upload a reading list, or web links, or a template. None of these things is a lecture, but they’re called one nonetheless.

  • While Udemy allows you to pick the thumbnail of each video lecture, it offers you only a limited selection. Typically you would want to pick the first frame; otherwise the video appears jumpy as it briefly shows the thumbnail drawn from somewhere midway before autoplaying from the beginning. Unfortunately, though, this first frame is often left out of the selection.

  • The method for deleting a lecture isn’t obvious. Having to click the little pencil first as if you were changing its title doesn’t make sense.

  • While rearranging the lectures is beautifully afforded via dragging and dropping, the same can’t be said of the downloadable materials. Murphy’s Law dictates that you need to make an edit or an update to the file at the top of the list, which means you must delete them all and then re-upload them.

  • You have to send an email to the affiliate team to request them to add your course to the affiliate program. This is a bit clunky, and naturally you want to fire off the request straight away. The problem is, your course can be added to the affiliate program only when it is live in the marketplace – which it won’t be for another 3-4 business days!

Open palm

Suggestions for improvement

In case anyone from the Udemy team is reading this, I respectfully suggest the following improvements…

  • Relax the enforcement of the standards. If a particular course doesn’t technically meet a requirement, the review team should be authorised to make a judgement call on whether to let it slide.

  • Consider labelling each stage of the course a “topic” rather than a “lecture”.

  • Allow the course owner to upload a customised thumbnail like YouTube does. That way, if the system doesn’t automatically pick up the first frame as a thumbnail, the owner can plug it in manually.

  • Place the trash can icon on each lecture’s banner so that it’s obvious how to delete it. A warning message should be sufficient to prevent accidental deletions.

  • Enable the dragging and dropping of the downloadable materials in the curriculum builder for resequencing purposes.

  • Incorporate an option during the publishing process to add the course to the affiliate program. Then, as soon as it is live in the marketplace, it is automatically added to the program.

UFO

All in all, though, I must re-emphasise that I thoroughly enjoyed using Udemy. I think it’s an excellent tool.

Not only can you use it to distribute your own expertise, but it’s so easy to use that the SME’s in your organisation can use it to distribute their expertise too.

Anyone interested in leveraging Udemy for workplace training should look into Udemy for Organizations which provides a private, branded portal with exclusive access only for your employees.

UFO might be a viable option for companies that don’t have an LMS, or for others that are seeking an alternative delivery platform.

Badges of honour

17 June 2013

“Will I get a certificate for this?”

No matter how much we try to cultivate an informal learning culture within our organisations, this question pops up time and again. It’s a symptom of the way workplace education (and education more generally) has been administered over the years, and while I don’t blame people for thinking this way, I confess to being frustrated by the redundancy of it all. It reminds me of that episode of Peep Show in which Mark presents Jeremy with a life coaching certificate, replete with 4 stars.

The fact remains: people love recognition for what they do. Mozilla’s Open Badges initiative leverages this phenomenon by gamifying the learning experience. The initiative allows training providers to issue digital “badges” to the participants in their courses, who thereby earn online representations of their newly acquired skills. Each learner can earn badges from all manner of verified issuers, collect them in their online “backpack”, and show them off by plugging them into their website or blog.

Open badge

And you know what, it works. When self-confessed cynic Mark Smithers earned his first badge after completing a jQuery course, he was chuffed:

“I have to say that my feelings were of enormous pleasure at finishing my course and being able to display that quickly and easily. It also made me very eager to get another badge to add to my collection. If feelings like this can be engendered in someone as notoriously cynical as me then that’s a pretty powerful reaction.”

Powerful indeed. And yet I suggest that open badges have more powerful potential still.

To put this into context, let me first explain that Australia is one of the most regulated nations on earth. And that, of course, includes our financial services industry.

Partly credited with shielding our economy from the worst of the GFC, the flipside of our regulation is that it is widely considered to hamper productivity, agility and innovation. Moreover, mandatory compliance training is universally disdained and dreaded in equal measure.

There are reasons for this – and in Take the law out of compliance training I argue that it shouldn’t be so – but the point I wish to make here is: how do we know the training is legally sufficient? Of course we draw the content from SMEs and run it by Legal, but at the end of that long and winding road, we effectively roll the dice and hope it never gets tested in court. I personally believe it would stand up nonetheless, but without going to such extremes, how else could we ever truly know…?

Blue dice

In a conversation I had with a friend the other day, I suggested one solution might be for the various regulatory agencies to develop their own training courses for their minions in Workland to complete. But I have since realised this is a terrible idea. Not only would it put a lot of e-learning developers out of business (compliance being their bread and butter) but government is in the business of governing, not training.

This is where I think open badges can play a role. Instead of a badge representing the provision of training by a particular organisation, it can represent the endorsement of the training by the organisation. It is a subtle difference but an important one. It means training providers such as employers can continue to endorse their own courses (naturally) but so too can other organisations such as ASIC, APRA and Standards Australia. The latter don’t produce the content, but rather review it and stamp it with their seal of approval if it meets their exacting requirements. All for a fee, no doubt.

This slightly modified approach to open badging promises significant benefits for the stakeholders:

  • For the regulatory agency, it weaves its governance more tightly into the workplace, not to mention generating a new revenue stream.
  • For the employer, it instills a sense of confidence in their training program, not to mention a legal defence.
  • For the employees, it gives them the shiny recognition they crave, not to mention better protection of their and their customers’ safety and security – which of course is the whole point of compliance.

And that’s not all: open badges can also facilitate the portability of employee training records. Currently, if you complete your training at one organisation and then leave to join another, you leave your training records behind and thus have to do your compliance all over again. What a laughable and desperately inefficient proposition.

If, however, you earned ASIC- and APRA-endorsed badges from your previous compliance training, all you would need to do is authorise the connection of your backpack to your new employer’s LMS.

Backpack

In other words, you wear your badges wherever you go.

They are, after all, badges of honour.

The future of learning management

11 February 2013

People familiar with my blog will know that I’m not a member of the anti-LMS brigade.

On the contrary, I think a Learning Management System is a valuable piece of educational technology – particularly in large organisations. It is indispensible for managing registrations, deploying e-learning, marking grades, recording completion statuses, centralising performance agreements and documenting performance appraisals.

In other words – and the name gives it away – an LMS is useful for managing learning.

Yet while LMSs are widely used in the corporate sector, I suspect they are not being used to their full potential. You see, when most people think of an LMS, they think of formal learning. I don’t.

I think of informal learning. I think of the vast majority of knowledge that is acquired outside of the classroom. I think of the plethora of skills that are developed away from the cubicle. I think of reading a newspaper and chatting around the water cooler, and the myriad of other ways that people learn stuff. Relevant stuff. Stuff that actually makes a difference to their performance.

And I wonder how we can acknowledge all of that learning. We can hardly stick the newspaper or the water cooler into the LMS, although many will try in vain.

No – the way we can acknowledge informal learning is via assessment. Assessment represents the sum of learning in relation to a domain, regardless of where, when or how that learning was done.

The assessment need not be a multiple-choice quiz (although I am not necessarily against such a device), nor need it be online. The LMS only needs to manage it. And by that I mean record the learner’s score, assign a pass or fail status, and impart a competency at a particular proficiency.

In this way, the purpose of learning shifts from activity to outcome.

Wheelbarrow

Having said that, the LMS suffers a big problem: portability.

I’m not referring to the content. We have SCORM to ensure our courses are compatible with different systems. Although, if you think migrating SCORM-compliant content from one LMS to another is problem free, I have an opera house to sell you. It has pointy white sails and a great view of the harbour.

No – I’m referring to the learner’s training records. That’s the whole point of the LMS, but they’re locked in there. Sure, if the organisation transfers from one LMS to another, it can migrate the data while spending a tonne of money and shedding blood, sweat and tears in the process.

But worse, if the learner leaves the organisation to join another, they also leave their training records behind. Haha… we don’t care if you complied with the same regulations at your last organisation. Or that you were working with the same types of products. Or that you were using the same computer system. We’re going to make you do your training all over again. Sucker.

It’s hardly learner-centered, and it sure as hell ain’t a smart way of doing business.

Enter Tin Can.

Tin can in the cloud

According to my understanding, Tin Can is designed to overcome the problem of training record portability. I imagine everyone having a big tin can in the cloud, connected to the interwebs. When I complete a course at Organisation A, my record is recorded in my tin can. When I leave Organisation A for a better job at Organisation B, no worries because I’ve still got my tin can. It’s mine, sitting in the sky, keeping all my training records accessible.

This idea has taken the education world by storm, and some LMSs such as UpsideLMS have already integrated the API into their proprietary architecture.

Furthermore, I can update my tin can manually. For example, if I read a newspaper article or have an enlightening conversation with someone around the water cooler, I can log into my account and record it.

This sounds admirable prima facie, but for me it raises a couple of concerns. Firstly, the system is reliant on the learner’s honour – ! – but more concerningly, its philosophy reverts back to activity over outcome. Recording reams and reams of minor learning interactions all seems a bit pointless to me.

So where to from here?

Enter Plurality.

Plurality is a brilliant short film watched by the participants in Week 2 of The University of Edinburgh’s E-learning and Digital Cultures course.

The film paints a dystopian vision of the future whereby everyone’s personal details are stored in an online grid, which is controlled of course by the government. When you swipe your finger over a scanner, the computer reads your DNA and identifies you. This is convenient for automatically deducting the cost of a sandwich from your bank account, or unlocking your car, but not so convenient when you are on the run from the cops and they can track you through everything you touch.

Despite the Big Brother message pushed by the film, it prompted me to recognise an emerging opportunity for Tin Can if it were to re-align its focus on assessment and exploit the Internet of Things.

Suppose for example you are sitting in a jumbo jet waiting to take off to London or New York. If the cockpit had a scanner that required the pilot to swipe his finger, the computer could check his tin can to confirm he has acquired the relevant competencies at the required proficiencies before activating the engine.

Or suppose you are meeting a financial advisor. With a portable scanner, you could check that she has been keeping up with the continuing education points required by the relevant accreditation agency.

Competencies and assessment tend to cop a beating in the academic sphere, but in the real world you want to be reasonably confident that your pilot can fly a plane and your financial advisor knows what she’s talking about.

DNA strand

If the film’s portrayal of DNA is too far-fetched, it need not be the mechanism. For example, the pilot could key in his personal credentials, or you could key in the financial advisor’s agency code.

But maybe it’s not so far-fetched after all. The Consortium for the Barcode of Life – based at the Smithsonian Institution’s National Museum of Natural History, no less – is currently researching DNA barcoding.

And still, maybe Plurality is looking at it the wrong way around. We can already store digital information in synthetic DNA. Perhaps in the not-too-distant future our training records will be coded into our natural DNA and injected back into our bodies. Then instead of the scanner referring to your tin can in the cloud, it mines your data right there in your genes.

And you thought science fiction was scary!


Follow

Get every new post delivered to your Inbox.

Join 474 other followers