25 more real-world examples of Virtual Reality

A couple of years ago I started up Virtual Reality Working Out Loud Week to promote real-world applications of virtual reality.

The inaugural #VRwolweek unearthed 20 real-world examples of the emerging technology, and the enduring popularity of that blog post tells me that we are hungry for more.

Loath to disappoint, I hereby present 25 more real-world examples of virtual reality, drawn from this year’s and last year’s events. I thank everyone who contributed to the following list.

• Kicking off with the Colonel, it would be remiss of me to omit KFC’s virtual escape room The Hard Way. Widely criticised for its evil genius paradigm, I urge us to appreciate the game’s otherwise authenticity. If used as a primer for training in real life, then it’s an engaging example of setting up an employee for success.
• Anchor Construction uses virtual reality to train its construction workers, while UPS uses it to train its truck drivers.
• South Wales Fire and Rescue uses interactive 360° video to train its new recruits on extricating a casualty from a road traffic incident.
• The Dutch Fire Department uses 360° video to teach the public how to react in case of an emergency, while on the other side of the flames in Australia FLAIM Trainer combines VR with haptics and heat-generating clothing to immerse firefighters in realistic situations.
• In Africa, Meet the Soldier aims to increase empathy among warring cattle farmers, while Cisco and Dimension Data are helping save the rhino.
• This charming Kiwi uses 360° video to record pov tutorials for mobile productivity apps. “See the apps and devices in action, in the context of where we work, live and play.”
• A group of middle school students has used 360° photos to create a virtual tour of Fort Vancouver, while the Chatham Historic Dockyard Trust uses 360° video to take you on a tour of their Age of Sail galleries.
• This Australian agency creates virtual tours and visualisations for the mining, architecture and tourism industries.
• Have you ever wondered how a self-driving car senses the world around it? Wonder no more with the Waymo 360° experience.
• Emmy Award winner for Outstanding Innovation in Interactive Storytelling, Pearl is a beautiful 360° animation that heralds the future of narrative.
• Virtual reality isn’t new to gamers, but now it’s social. Check out Evasion and Poker VR.
• I’m continually amazed at what can be achieved with CoSpaces Edu, such as the Virtual Reality Learning Lab’s uber cool reboot of Frogger. And while we’re going retro, have a laugh at Mario in real life.
• Topshop allows their customers to ride a virtual waterslide over the black cabs and double-deckers of central London.
• SeaWorld hybridises the real world with the virtual. Patrons of The Kraken Unleashed ride a rollercoaster while wearing VR headsets that plunge them into the abyss.It reminds me of Batman Adventure at Australia’s Movie World back in 1992, when we all sat on moveable seats in front of a big screen simulating the batplane screaming through Gotham City.A rollercoaster ramps the immersion up a few notches, to say the least, and I can see why it’s the perfect vehicle for a pre-recorded experience because the timing is precise.
• In Norway, Audi lets you test-drive their new Q5 in a giant virtual sandbox. It took me a while to work out the prospective customer would dig the racetrack in a real sandbox, which was then scanned and transformed into virtual reality. It’s a modern-day twist on Daytona USA presumably intended to attract the Amazon generation in-store to be worked over by the sales reps.Incidentally, I see the clever Scandi’s have now moved on to Augmented Reality with the Quattro Coaster app, which lets you build a road and drive a mini car on it in your living room.
• VR needn’t have an Audi-sized budget to be effective for marketing. A product manager in the medical industry created a WebVR experience to promote the hi-tech material in her range of surgical gowns. Given her name you may deduce I know this person, so I can tell you this impressive project was done on a shoestring.
• Finally, these other examples of virtual reality in healthcare – for autism, disability and pain management – must surely turn the most ardent of sceptics.

Oh how far we’ve come since Hugo Gernsback strapped on his teleyeglasses back in 1968. Long may this wonderful technology continue to evolve!

The future of entertainment

In the space of a couple of weeks, I have previewed the future of entertainment twice.

The first instance was at AFTRS in Sydney, where I attended a presentation of VR Noir: A Day Before The Night.

Billed as an “interactive crime thriller”, this immersive virtual reality experience might best be described as a combination of a film and a game. Set in the style of the gumshoe genre we know so well, you play the part of a private detective who must decide whether or not to take on a client’s case. Your actions drive the story forward, and your decisions along the way impact the final outcome.

While I thoroughly enjoyed the experience and commend AFTRS on the quality of their work, I was also fascinated by the unique technical challenges they encountered. One of the most pressing ones was point of view: in a 360° environment, there is simultaneously no POV and all POVs. (Maybe their next VR film will be about Schrödinger’s cat?)

Another challenge was the stitching: the actors had to remain within the narrow confines of the frame, lest be sliced in two.

However the medium also afforded opportunities. One of them was the audio: by plotting the source of a sound at particular coordinates, its realism increased by orders of magnitude as I moved my head, or stepped closer or further away, while the stereophonics adjusted accordingly.

If and when multiple users can interact in the same VR film at the same time – that is to say, when the experience becomes social – the opportunities to replicate real-life situations will increase exponentially.

Indeed, my second preview of the future of entertainment was social.

The virtual reality experience offered by Zero Latency in Melbourne might best be described as laser tag on steroids. Armed with a headset, earphones, mic, and a plastic gun, your mission is to seek and destroy the hordes of zombies that have taken over the city.

Up to 6 players can traverse the 400m² physical floor space as a platoon. Of course, the virtual world is much larger than that – as the website states, “We reuse the space with some nifty tricks we have developed.”

Saying that Zero Latency is loads of fun feels like I’m committing an injustice. Suffice to say the shoot’em-up genre has been elevated to a whole new level. I think my adrenalin is still pumping!

Beyond the novelty factor, I was deeply engaged by both the interactive film and the ambulatory game. Having now experienced both, I am left in no doubt that virtual reality is the future of entertainment.

And if that’s true, then it’s also the future of lots of other things, such as learning.

Good gear

I was in the market for a new smartphone recently, so I took up Samsung’s offer of a free Gear VR headset with a purchase of the new S7.

As readers of Paper cuts will know, I’ve been toying with virtual reality via the Google Cardboard headset. Now I had the opportunity to compare my experience with another headset one step higher up in the food chain.

Here I share with you my observations…

Headset

There’s no doubt about it, Cardboard’s ace in the pack is its price. For about $20 you obtain your very own portal into virtual reality.

Having said that, the Gear VR is only around $150, which I find surprisingly cheap and dare I suggest affordable. Whether it’s worth the greater investment will depend on your needs, but the following advantages that it holds over Cardboard may influence your opinion:

• The Gear VR headset is sturdier than its Cardboard counterpart, provides a snugger fit, and is more comfortable to wear.
• My S7 snaps perfectly into place on the Gear VR, whereas it sometimes goes a little off-kilter in the Cardboard.
• Gear VR’s tracking wheel allows me to focus my lenses, whereas Cardboard’s one-size-fits-all approach can result in blurry vision.
• Gear VR’s sensor responds to a simple tap of the finger, whereas the push button on Cardboard feels clunky.

Gear VR’s sensor also has scrolling functionality, but I find this tricky to use. I never seem to put my finger in the right spot, and I find the act of scrolling imprecise. I suggest an Xbox-like control stick (or perhaps a ball) would be a superior mechanism for both scrolling and selecting.

Apps

To use Cardboard, you need the Cardboard app. To use Gear VR, you need the Oculus app.

Third-party apps are searchable in Google Play, but as I mentioned in Paper cuts the results can not be filtered out by Cardboard compatibility. In contrast, the Oculus app has its own store that I can access via the headset, and while all the apps I see are compatible with Gear VR, there’s no search facility. That means I must scroll through the apps, which is tedious to say the least.

Then I worked out I can access the Oculus Store on my phone via the app without using the headset, which affords a much better user experience – complete with search facility.

As for the Oculus apps, I’ve found their quality to be a notch above the Cardboard offerings. So far I’ve tried Smash Hit VR, The Body VR, Speech Center, and The Night Cafe – all are excellent.

While some of the apps that I know via Cardboard – such as Vrse and Inmind – are also available via Oculus, not all are. I wonder if one day VR apps will be standardised so they work across all the major platforms. A pipe dream… I know.

360° photos

In Paper cuts I reported a drop-out problem when taking VR photos with my S4. I’m glad to say this is no longer an issue on my S7.

I must point out that VR photos taken via Cardboard Camera are not 360° photos; they are simply panoramic shots that are stitched together at their ends. While these are impressive, the black spots above and below the photo fall short of the definition of “virtual reality”.

Again in Paper cuts I expressed my surprise at the absence of multi-directional photo-stitching as per Photosynth, and it appears the boffins at Samsung read my blog. The S7 has a “surround shot” mode that enables you to take multiple photos in all directions, which are then stitched together to produce a true 360° photo. Mind you, this mode is not available on the phone by default – you must download it!

Here’s my effort with a surround shot at a wharf on Sydney Harbour. As you can see, the stitching is by no means perfect. I think the differences between the light and shade caused problems, not to mention the skills of the operator. However I’m pleased to report that adding my photo to Google Maps via Street View worked perfectly and immediately. The app still doesn’t say something to the effect of “Thank you for publishing your photo”, but I’ve grown to expect this kind of UX from Google.

I’m pleased to report that Flickr also recognises my photo as a photo sphere and automatically enables user manipulation, though I found it unreliable in Edge so try Chrome instead. Flickr also provides embed code that you can insert into your website – with user manipulation similarly enabled.

Back to Cardboard Camera, its VR photos can be viewed via the Cardboard headset – as you would expect. However a problem arises when you try to import a photo (such as a panorama) that wasn’t taken by Cardboard Camera. No matter whether I change the file name to PANO_date_x.jpg or run it through the Photosphere XMP Tagger, as user forums suggest, I’m invariably confronted by “This is not a VR photo”.

In contrast, all you need to do with Gear VR is create a subfolder called “360Photos” in the Oculus folder on your phone – though why it’s not already there is a another head scratcher – then transfer your photo into it. When you choose to see all photos in the Oculus app, you can go to “My Photos” and select yours. In fact, your photo need not be a true 360° photo; the app will stretch it into place (with mixed results).

A gripe I have with Oculus’s 360° viewing functionality, though, is that the slideshow mode is on by default. Just as you’re immersing yourself into the glorious coastline of Budva, you’re teleported somewhere else. Uber annoying!!

360° videos

Whereas Gear VR has the wood over Cardboard in relation to 360° photos, I maintain the reverse is true in relation to 360° videos.

On YouTube, all you need to do is click the little goggles icon in a 360° video to render it Cardboard compatible. It would be marvellous if we could similarly click a little oval icon to render it Gear VR compatible, but there I go again with another pipe dream…

A workaround for Gear VR is to use the Samsung Internet app to get to YouTube, play a video, toggle full screen, then change the mode to 360. Yet while this works, it’s inelegant.

Implications for business

Whether you intend on using virtual reality for e-learning, digital marketing, or some other business-related activity, I suggest Gear VR and Cardboard both have pro’s and cons.

In my opinion, Gear VR provides the better overall experience and looks more professional to boot. It’s handling of 360° photos is superior to Cardboard’s, and the S7’s compatibility with Flickr is useful for presenting them to the public. However, while $150 per headset is arguably affordable for an individual, you might think twice before buying 100 of them for your sales force.

Furthermore, Cardboard retains the upper hand with 360° videos. While Gear VR has a work around, it’s not really workable in a business setting. Until Oculus gets up to speed with third-party video, it might be worth having a Cardboard or two handy.

Paper cuts

I’m late to the party, but finally I’ve gotten my hands onto Google Cardboard.

I’ve been tinkering with it and, in the spirit of Virtual Reality Working Out Loud Week, I’ve decided to share with you what I’ve learned so far.

I’ll also share my problems – and there are plenty of them – so if you can solve any for me I’d be grateful!

The device

The ROI for Google Cardboard is through the roof. For about $20, you gain access to a world of wonder.

While high-end virtual reality hardware is available – and more will become available this year – the folded paper option is the perfect gateway for exploring this emerging technology.

Apps

Some brilliant Cardboard apps are available at Google Play.

Vrse showcases the 360° nature of VR, while Inmind VR is a somewhat childish game that nonetheless demonstrates the order of magnitude that immersive 3D animation offers over 2D. I foresee biotech companies leading the way on this.

Evidently, though, VR apps are still very much in their infancy. While a sizeable number are currently available, they are accompanied by reams of poor reviews. Many are free, but an astronomy app I tried stopped part way and wanted me to buy the premium version to continue.

I also found it tricky to identify the apps that were compatible with Cardboard. Most that are have the little goggles icon integrated into their artwork, but it would be preferable if the Play Store simply let us filter the results.

360° videos

These are great! A couple of my favourites are Red Bull F1 360° Experience and MythBusters: Sharks Everywhere!

On your PC, you can use the navigation arrows or your mouse to shift your point of view; on your smartphone, you can physically move your device; and if you watch it through Google Cardboard, you get the full immersive experience.

Strangely, 360° videos don’t work on my iPad. I either get the Cardboard-oriented double vision, or else the regular pov stuck in one direction.

I also find the videos a little blurry. This may have something to do with the age of my S4, but I recently read that Facebook is getting serious about resolution.

The good news is you can record your own 360° videos using special cameras that are reasonably priced IMHO. A virtual tour, perhaps?

360° photos

These are just like 360° videos, but they’re static. Don’t let that put you off – they’re surprisingly immersive.

Google calls them “photo spheres” and they remind me of Microsoft’s Photosynth. Whereas Photosynth stitched together discrete photos, you record your photo sphere in a continuous circular motion.

Here’s my effort from a friend’s rooftop. (Note: This link is not supported in the mobile web version of Google Maps. Oh the irony.)

All you need to record your own photo sphere is the Cardboard Camera app. Having said that, I found it highly temperamental. The app is not very forgiving of human shaking, so a tripod would be helpful. It also drops out frustratingly easily. Clearing the app’s cache and my phone’s RAM appears to help, as does keeping a super-tight turning circle and moving painfully slowly.

Any kind of movement in the scene is a no-no; I tried it at Circular Quay and had no chance. Again, this could be due to the age of my phone, but still I’m surprised there is no photo-stitching option as per Photosynth.

Yet I struck more problems. My photo sphere works perfectly within my Cardboard Camera app; I wear my papery goggles and it’s like I really am surveying Sydney Harbour. Alas, that’s where it stayed.

I tried to upload my photo sphere to SphereShare (not a Google site) but it doesn’t play nice with IE11. Even in Chrome I received the following error: Please provide valid Photo Sphere JPEG image. Umm…?

Then I found out Google had a site called Views, but not any more. It appears they now want photo spheres uploaded to Google Street View. There’s an app for that, but I couldn’t open it – and I’m not the only one. (It appears I need Android 5. My phone only goes up to 4.4.2.)

Google has a slick Street View website, complete with PUBLISH subsite, which inexplicably fails to explain how to publish photo spheres. Thankfully I stumbled on this article by Phil Nickinson and learned that instead of starting at the map and uploading your photo sphere, you start at the photo sphere in your phone’s image gallery and share it to Maps. Then nothing happens, which is disconcerting, but Phil warns that Google must approve your photo sphere which takes about a day or so. It would have been nice for Google to have explained that. A week later, I’m still waiting.

However a more pressing problem was that my photo sphere was rendering in Maps as a photo. This I could not understand, given the file was being transferred from one Google application to another Google application via Google’s operating system. I even tried uploading it via PC, but again it rendered as a regular photo. I posted this conundrum to Reddit’s Google Cardboard subreddit and to one of LinkedIn’s virtual reality discussion groups, both in vain.

Thankfully I stumbled upon this discussion thread in the Google Photos Forum about a different problem, for which Russ Buchmann refers to the Photosphere XMP Tagger app (not a Google app). Hurrah! After using this app to tag my file, it rendered in Maps as a photo sphere.

A final tip: Populate your tagged file’s property details (eg title) in Windows Explorer prior to uploading it to Maps.

Milestones and millstones

My VR learning journey thus far may be described as joy punctuated by disappointment.

I applaud Google for giving Average Joe the gift of virtual reality – not only to consume, but also to produce.

Yet I am astonished by the lack of interoperability between Google’s own platforms, our reliance on third party products to perform seemingly simple tasks, and the tech giant’s customer uncentricity.

No doubt the boffins at Mountain View know exactly what they’re doing… but how about the rest of us?

They’d probably tell us to Google it.