Dieter Bohn and Tom Warren at The Verge had an amazing mixed realities experience at Microsoft. They tried out the HoloLens, a headset that projects holograms into real space. They report about having Minecraft on a coffee table and about an amazing experience during which an engineer who was communicating via Skype helped a reporter to fix a light switch, not only by talking but also by actually drawing on ‘his reality’. Sounds very weird but have a look at the video:
The applications go far beyond gaming of course: all kinds of support and learning situations could benefit from this.
A short but beautiful video featuring the grandfather of virtual reality, professor Tom Furness. He can be situated directly into a tradition which goes back to Vannevar Bush, who in 1945 described the Memex-device in As We May Think – a technological dream of making knowledge accessible in ways corresponding to the complexities and challenges of the contemporary world.
Bush and Furness have a military background in common, and the desire to give humanity the tools needed to do something about very urgent and complex issues.
Without further ado, here is the video from Sebastian Sanchez:
Virtuix, the maker of the virtual reality treadmill Omni, prepares applications beyond gaming. Here you see the treadmill in a gaming context:
Roel Verrycken, the US correspondent of the Belgian newspaper De Tijd, had an interview with founder Jan Goetgeluk and asked which new applications his company is developing. Goetgeluk:
For training police or military personnel. We have a special military version which is a bit bigger and sturdier and which has some additional functions. Recently we participated at a specialized fair and there’s a lot of interest from that sector. Remember the attack on Osama bin Laden? The US military built the house in which he was hiding. Using the Omni the training coould be done virtually without having to build a complete house. Every possible environment can be programmed virtually for training purposes. We see a very important market there.
Asked how dependent Virtuix is on the development and commercial launch of the Oculus Rift headset, Goetgeluk explained Omni is compatible with all devices. He referred to the Samsung VR goggles, and said that smartphones will have the capacity to be transformed into virtual reality devices. “Everyone in the industry is determined to advance virtual reality. It’s still a fledgling industry, now we’ll have to gain mass market traction. That’s something for 2015.”
You can read the complete interview (Dutch language) on our newspaper website.
How would immersive journalism look like? Immersive as in ‘immersing the reader/viewer/participant into a situation in such a way she learns something new’? Actually there exists a website immersivejournalism.com where journalist and scholar Nonny de la Peña discusses her work and ideas about this topic.
I first encountered this work of hers in Second Life in 2010:
But you’ll notice how she evolves and now uses virtual reality tools for her newest projects, about food banks…
…or about Syrian refugees:
Now I learned about a project by another team “which will be centered on live video, delivering an experience that feels more like documentary and photo journalism than a console game.”
They use new experimental cameras which are able to capture live motion 360° and 3D virtual reality footage.
The kit is made from 12-16 cameras mounted to a 3D printed brace, and then stitched onto a virtual sphere to form a 360 degree virtual environment. These new kits are also stereoscopic, adding depth of field.
The project is a partnership between Frontline, The Secret Location, and the Tow Center. You can read more about it on the Tow Center site.
Neal Stephenson is the author of Snow Crash, a book which helped me ‘get’ virtual worlds. Today he announces in a blog post that he agreed to become Chief Futurist of Magic Leap, which is a secretive company working on something which seems to get rid of keyboards and other clunky computer stuff in order to make things appear out of thin air. As Snow Crash was all about virtual reality and augmented reality (in 1992!), it seems to make sense to ask such a visionary author to become Futurist of this secretive company.
This is how Stephenson describes Magic Leap:
Yes, I saw something on that optical table I had never seen before–something that only Magic Leap, as far as I know, is capable of doing. And it was pretty cool. But what fascinated me wasn’t what Magic Leap had done but rather what it was about to start doing.Magic Leap is mustering an arsenal of techniques–some tried and true, others unbelievably advanced–to produce a synthesized light field that falls upon the retina in the same way as light reflected from real objects in your environment. Depth perception, in this system, isn’t just a trick played on the brain by showing it two slightly different images.
This is what our author hopes to do:
I’m fascinated by the science, but not qualified to work on it. Where I hope I can be of use is in thinking about what to do with this tech once it is available to the general public. “Chief Futurist” runs the risk of being a disembodied brain on a stick. I took the job on the understanding that I would have the opportunity to get a few things done.
He adds that Magic Leap is “not exclusively about games. It’s also going to be a great tool for readers, learners, scientists, and artists. Games, however, are a good place to start talking about why this tech is different.”
Keep an eye on his blog!
(Hat tip to Colin Dwyer on the two-way for bringing the news).
In my previous post I mentioned Virtuix, the company behind the virtual reality treadmill Omni. The founder is the Belgian Jan Goetgeluk. The Omni allows you to exercise and game at the same time, it’s exergaming. Have a look:
In 2013 the project was launched on Kickstarter and 2.500 devices were ordered for $1.1 million. The company got two financing rounds for in total almost $6 million, the latest was closed recently. My newspaper De Tijd learned (Dutch) that among the investors are investor Mark Cuban, owner of the Dallas Mavericks, and Howard Schultz, founder and CEO of Starbucks. Mark Cuban believes in the potential of virtual reality for sports.
The Omni costs $499.
In case you still have any doubts: virtual reality is hot. News from the Digits blog (The Wall Street Journal) by Timothy Hay: Oculus/Facebook bought two start-ups: Nimble VR, which was formerly known as 3Gear Systems (San Francisco), they are specialized in skeletal hand-tracking using tiny cameras, and Swedish start-up 13th Lab which uses cameras making 3-D recreations of various physical environments.
Here you see some magic from Nimble VR (video from the Kickstarter Campaign). Notice the Minecraft game and the school examples but of course there is much more in this:
13th Lab shows some nice videos about SLAM or Simultaneous localization and mapping. This is the computational problem of constructing or updating a map of an unknown environment while simultaneously keeping track of an agent’s location within it. This is one example where the technology is used for the recreation of a stairway:
This is a game application by 13th Lab:
The post on Digits mentions also various companies in the VR industry getting venture investment such as Survios (resulting from Project Holodeck at the University of Southern California), Jaunt (toolset for cinematic VR) and Virtuix (a company founded by the Belgian Jan Goetgeluk and specializing in a VR treadmill, Omni).
I’m pretty sure that the way we interact with the digital world and how we integrate the digital into the physical is about to change dramatically.
In June 2014 Google showed the world the Cardboard VR headset, today it has been announced 500,000 of those devices have been shipped. This is extraordinary, realizing the project was ‘just’ an experiment done by two engineers in the Google Cultural Institute in Paris, David Coz and Damien Henry, during the 20 percent time Google engineers get for personal projects.
As explained in the previous post, cheap and mobile VR headsets could be crucial in turning virtual reality into something which is used by a mainstream audience. Especially students and learners could benefit (one can assemble a Cardboard oneself or buy it for around $25).
At the LeWeb conference in Paris this week people could try the Cardboard, it seems it was quite a success.
Connectivism guru Stephen Downes is right to point out alternatives for Oculus Rift such as Google Cardboard. You can buy these things (which allow to convert smartphones into VR devices) from others or build it yourself. I never tried it out myself so I cannot compare with Oculus Rift, but I see the pedagogical advantages of building oneself a virtual headset. Downes refers to a blog post by Donald Clark: 7 learning principles that work in VR (one of those principles being “learning by doing”).
In the meantime Samsung Gear VR is now officially available in the US, it launches internationally ‘early 2015′, so Road to VR says. The interesting thing about these smartphone-based VR headsets is that they allow for short-term immersive experiences, untied to desktops or laptops so the devices are easier to share.
Immersive experiences for short attention spans
One of my doubts about immersive media such as virtual worlds is that they are often extremely time-consuming – either you ‘get it’ and stay for hours in-world or you don’t and you leave without ever returning. In this new mutation of immersive media however one can dip into an immersive environment – for instance to enjoy a song in a VR setting as suggests Maria Korolov on Hypergrid Business:
Obviously, the killer app for virtual reality is going to be music videos. The length of a song is just about the right amount of time for an easy introduction to VR, and after you’ve watched it, you can pass it around to all your friends.
Now imagine the typical short educational videos used for Massive Open Online Courses (MOOCs) – one could imagine using lightweight mobile VR headsets for accessing short immersive experiences in this context. I first had to smile looking at the smartphone-based headsets, but now I realize they open up very new possibilities.
People don’t get ideas, they make them. That’s the pedagogy of constructionism explained in the shortest possible way, I guess, and Colin Lewis at RobotEnomics is very good at that. He posted about why employees should be playing with Lego Robots – because it makes it so more obvious what the Internet of Things is all about, more so than by letting people watch Powerpoint presentations.
However, you don’t need to despair if you don’t have a robot around. There’s something called Robot Virtual Worlds which is a high-end simulation environment that enables students, without robots, to learn programming.
Now let’s take another step and use the Oculus Rift, like these guys:
I’ve no experience at all with Robot Virtual Worlds nor do I have any information about which virtual robot programs are compatible with which virtual headset, but it seems obvious that virtual headsets, robots, virtual worlds and programming lessons are made for each other.