Category Archives: VR Head Mounted Displays

Demonstrating Virtual Reality at the University of Hertfordshire

It’s not often that we get the chance to demonstrate what we’re working on as, in education, it’s more about the finished product and conclusions. Nevertheless, during the HEaTED East of England network event , we were given the opportunity to allow people to wonder around a bespoke 3D environment while using our HTC Vive headset and touch controllers. We used the controllers themselves emulate the functional behaviours of a smartphone. The reactions were all positive and I managed to have chats with some senior managers about where it is we’re hoping to take our vision for VR at the University.

You can find a brief video depicting the space below:



The idea was to illustrate how intuitive behaviours can be replicated inside a 3D space to allow for simple interactions. A lot of people tend to be confused by their initial transition into a virtual world but by including recognisable elements, it makes the experience much less daunting. It’s for that reason the 3D environment in question is a lecture theatre, based on a real-world equivalent, only a few metres away from the stand. This made the experience all the more compelling as, after having spent a few minutes in the 3D version, the attendees would then enter the same room shortly afterwards.

We’re going to be demonstrating again in the near future in a bid to capture the imaginations a few academics. VR promises a lot of interesting things, everything from multi-user role-playing exercises between people in two different locations (partner institutions overseas) to single user familiarisation exercises. We’re hoping to establish some more usage case scenarios.

The HTC Vive in a smaller space

Granted, there are plenty of videos showing how the Vive works in large, open environments but few of them deal with the real-world scenarios faced by many when it comes to introducing virtual reality to their living rooms. Much like how the Nintendo Wii needed a similar amount of space in order to allow the user to swing their arms around as they participated in sword fights, golf and bowling, the Vive needs even more to do it justice.

Having said that, it seems to work incredibly well, even in something of a cramped space. I don’t doubt that, as the prevalence of VR continues to grow, we may undergo a radical culture shift involving how we set up our home environments. With that in mind, please enjoy the quick 60 second video I’ve put together below.


As seen in the video, you can still have an incredibly immersive experience even while remaining in the same spot, just be sure to move your tea mugs out of arms reach as it’s not a question of ‘if’ but ‘when’ you knock them over.

The demos shown are just a few of those available through the Steam store on the PC. They’re a hint at what’s to come in the future and the promise offered by applications like ‘Big Screen‘ are likely to impact everything from individual to collaborative working environments. Although I only show it from a single user perspective, you can have multi-user sessions over the internet and have people join remotely to share a virtual space, all whilst sharing their individual screens (security risks need to be considered in that respect).

I’m hoping to create a few more videos in the future as they’re able to convey things far more eloquently than with words alone.

HTC Vive Commercial Release – First Impressions

Shortly after receiving our HTC Vive, I rushed to set everything up in a bid to sample the delights of the virtual reality applications available through Steam. For those of you unfamiliar with Steam, it’s an online content distribution service, initially set up for gaming but has since diversified its offerings in a bid to reach out to wider audiences. We’re hoping to improve the student experience by creating engaging visual content for use in our concept classrooms and the promise of virtual reality in this area is quite something.




Unboxing the headset and its accompanying assortment of wires made me wonder how portable a solution the Vive could be. Much of what we do involves showing others what can be done in the classroom and it’s clear that, at the moment, working with a head-mounted display is something which is best kept to dedicated spaces. That is unless you have a dedicated team of technical support staff on hand. As a University with a “Learning and Teaching Innovation Centre“, we’re quite fortunate in that regard.

Initially, the headset wouldn’t connect to my laptop, which only had VGA and display port inputs. The HTC Vive comes just with an HDMI cable (despite also having a mini display port) and so I had to purchase a “mini display to display port” wire separately. Upon arrival, everything worked beautifully and I invited everyone in to have a go with some of the “the lab” demos on Steam along with “theBlu“, a marine life experience wherein the user is surrounded by schools of fish and underwater flora, all of which are interactive and react to being touched by the controllers.

People were ducking down in order to crawl through some of the underwater arches and flinching as a whale got a little bit too close for comfort, before which its giant, reflective eye gave a knowing wink. All of this took place both on the headset and on the laptop display, allowing others to see what the user was experiencing. The emotional bandwidth of these experiences is nothing short of amazing and I say that after having used the Oculus Rift Devkit 2 extensively. The affordance of the Vive is that, as described, it allows you to physically walk around and interact with an environment using your body whereas with the Oculus you are required to use a joypad at the moment. This will no doubt change in the future but, as of writing this, the HTC Vive is where we are likely to be focusing our virtual reality development.

It’s worth mentioning that the laptop we used ran the 3D experiences poorly – around 25 frames per second – (despite being an i7-4290MQ with 32GB ram) due to an under performing graphics chip (Quadro FX). It just goes to show that you can have a machine which is incredibly fast for video and high resolution image editing yet, without a proper game-based GPU, it will not perform well. There are a number of 3D benchmarks you can consult to see if your hardware is up to scratch and I opted to use a laptop if only because it provided for a much simpler setup. I will be bringing out the big guns for future demonstrations.

I’ll be posting more as we continue to experiment with things. At the moment, we’re brainstorming some usage scenarios involving role-play exercises.

Mixed Reality with the Oculus DK2

The irony of virtual reality is that, despite being a visual medium, it remains incredibly difficult to convey in a faithful manner. It’s not just about the visual impact of an experience but also the immersion factor.

I made a post a few months ago in which I filmed myself using the Oculus Rift at a desk. In that video, I cross-faded the perspectives of a bystander and user in an attempt to communicate how people can interact with a 3D environment using a headset.

Virtual Reality represents something of a growth industry right now but it will take time to convince people of its promise as a means for channelling emotional bandwidth. In the right hands, it could become a powerful educational tool. As always, the issues around how to establish best practice will take time to address and, because of this, it’s a great time for both experimentation and innovation.

In the video below, I’m using a green screen to chroma key the output of Oculus, thereby creating the effect of allowing people to see as I do during the session. This is far less complicated (and looks very 1980s) than the method used by Valve, which you can see here.

It does mean having to restrict movement in some ways, no facing the camera, not looking straight down etc… These tend to create confusing visual effects.

I’ll be posting more in the future as I continue to experiment with things. We’re at the beginning of something which promises to revolutionise the human computer interface and contribute to the human condition in ways we’ve yet to envisage.

The Weston Auditorium at the University of Hertfordshire in Virtual Reality

Much has changed these last few years in the gaming industry. Until recently, real-time/interactive 3D has had something of a stigma associated with it when it came to education. Happily, in the spirit of inquiry, research has continued to verify its potency for creating memorable and engaging experiences.

Click here to view the search trend data on Google

We’ve been in possession of an Oculus Rift (development kit 2) for a while now and it’s provided us with some exciting opportunities to do with Learning & Teaching Innovation. We’re currently working with Psychology staff to create virtual environments for use in research and have been awarded funding to pursue some other ideas with measurable outcomes. We’re trying to establish best practice in this new medium and need to figure out what works and what doesn’t. Trying to force the use of VR in a non-complimentary medium would be a massive waste of time and could end up as redundant work.

It’s not so easy to identify the areas of use however as some of the most text-heavy subjects (Land Law as an example) stand to benefit greatly from the offerings of VR. Imagine being able to walk around a virtual village and identify disputes over property boundaries or the potential VR has to create dynamic data visualizations. If you thought 2D infographics were informative, imagine where it could go with something more immersive and with a real sense of scale.

The obvious choices for VR would be things like paramedic science, subjects involving roleplay scenarios. Potentially we could have partner institutions interacting with one another overseas in ways which were previously impossible. Multi-user VR environments hold a lot of promise in this regard and I’m hoping to be able to explore those ideas further.

More recently, I’ve completed some work with the Oculus Rift, it’s a virtual representation of our largest presentation space (sometimes used as a lecture theatre), the Weston Auditorium at the University of Hertfordshire. See the video below for a demonstration!

 

 

This is based on work I did some time ago, I’ve just made it work with the Oculus Rift. It’s taken a long time but I’ve optimised my workflow substantially since the old days.

Click here to read about the creation of this environment

Getting serious with virtual and augmented reality at the VRTGO conference

Last week I attended the VRTGO conference in Newcastle, a day of talks from various industry representatives describing how they were using Virtual and Augmented Reality in their businesses. Happily, not all of it was gaming-related, something which has been difficult to exclude from these events as, understandably, the gaming sector is what is driving the VR agenda at this time. Having said that, one of the representatives from Crossrail (a London-based project to link various underground railway networks) was able to answer my question of whether there was still any stigma surrounding the term ‘gaming technology’, responding that most people with any interest in the medium already had prior exposure to gaming and that, as a generational phenomenon, it was starting to become acceptable.

Outside of Gaming

Much of the non-educational work was centered around heritage, mainly architectural visualisations with added features such as the ability to see a site as it exists in its current, ruinous, state compared to how it might have been in its prime, complete with depictions of how people of the era dressed and interacted. Much of the development work involved the use of photogrammetry and, where available, the expensive LIDAR scanning of sites with historical significance. All in all, it was inspiring to see people getting creative and innovating with technology at the forefront of its respective medium. Of note were two companies, ‘DigitalVR‘ and ‘ChroniclesVR‘, based in the UK, who have been doing some work with photogrammetry. There’s a lot to establish by way of conveying narratives but these two groups seem to be in the right place at the right time when it comes to the learning process.

Referring back to Crossrail, the presentation started with a drone flying through tunnels designed to accomodate London’s bulging underground railway system. There was talk of using augmented reality to allow workers to focus on items at fault, report them via photo, and being able to call up servicing instructions through video feedback. Things were somewhat vague and theoretical in this regard but the idea is sound and is indeed what we’re expecting to see with the advent of Microsoft’s Hololens. There was no statement of intent with respect to committing to one type of interface device and things are very much in the innovation stage. Given that the companies associated with the building work are so vast and the project so logistically intensive, it’s unlikely that anyone is going to change the way they work overnight. It does, however, present a prime opportunity for data gathering and workflow optimisation.

Tackling Navigation in VR

One of the highlights for me involved a company called ‘nDreams‘. They exist solely for the purpose of creating VR experiences, which while at this moment in time sounds like a risky venture, is something which is likely to become a growth industry. It was a wonderful surprise to see this team examining how users engage with various interface devices and head-mounted displays. They were examining everything from rotational head movement speed to navigating 3D environments using a stare and click method. The data they had sourced from hours of research and experimentation was phenomenal and will surely be of use when it comes to establishing standard control interfaces for console and PC-based titles. This is the sort of work that excites me the most, rather than stabbing in the dark and doing something which seems ‘cool’, this group of people have brought their brains to bear on this problem with a view to creating a better user experience. It was as much of an academic pursuit as a games authoring workflow.

Interestingly, Samsung also sent a representative, the head of the UK division for the development and promotion of the Gear Headsets we’ve read so much about in the news. I quizzed him on when we’d see mobile GPUs catching up to high-end desktop configurations but the focus seemed to be more on providing novel VR experiences which, rather than being graphically compelling, focussed on the strengths of mobile VR to provide unique experiences. That’s understandable, especially given that one of the benefits of the Google cardboard-based approach is the exclusion of wires. It just made me wonder how long before we see phones with thunderbolt 3 ports through which an external GPU can be added (and put in the users pocket) in order to boost the graphical fidelity of the experience, alas no comment on that. Using Gear headsets would certainly cheapen the cost of our games nights at the University of Hertfordshire.

Browser-Based Virtual Reality

Of note was the work by a company called ‘PlayCanvas‘. They’re focusing on a browser-based approach to 3D and have developed a beautiful suite of tools designed to assist in getting real-time 3D content working through WebGL and HTML5. It should be worth noting that one of the main reasons I adopted Unity 3D so many years ago was due to its ability to render 3D content online, in the browser, by simply going to a web address and downloading a plugin. Sadly, Unity’s browser-based solution is lacking at present (due to most browsers having disabled the use of such plugins) though promises great things as they’re also looking at similar solutions. Interestingly, the PlayCanvas engine comes to around 125KB, which is a fantastic achievement when it comes to optimisation and efficiency. PlayCanvas are also looking at interfacing directly with VR headsets from within the web browser window, which would increase the accessibility by an order of magnitude.

Final Thoughts

There’s so much to talk about and take in when attending these conferences but yet another curiousity was to do with interface devices, or more specifically, seats with feedback mechanisms. The representatives of a kickstarter project called VRGo were on scene showcasing their product, a seat through which you are able to navigate a virtual environment by leaning in different directions. It’s certainly the right way to go about things when considering the implications for health and safety as, once someone stands up, virtual reality has proven to be quite unsafe (many people end up losing their balance due to conflicting brain signals regarding spatial awareness).

I regret arriving a bit late and missing the Sony VR presentation but, all in all, it was a great day out and well worth the 6 hour journey there and back (on the same day) to see what people were doing. I remain very excited at having seen the work nDreams are doing and hope to factor it into my PhD studies. It’s a great time to be in this industry as an entirely new frontier unfolds right in front of us. There are questions not just of usability and engagement but also ethics and how to develop content in a responsible manner so as not to contribute to the problems of escapism through gaming and internet addiction, which we are starting to see more of. I truly believe that the VR experience has the potential to improve the human condition and contribute to our collective mental evolution. Let’s see how much we can get right at the start and set a precedent for a tradition of excellence.

Oculus Rift – Development Kit 2

I’ve recently been loaned an Oculus Rift with a view to creating a few technical demonstrations of what the head mounted display is capable of. This will go some way to allowing me to obtain closure on my workflow as I’ve been at odds for some time with regards to which devices I ought to spend my time developing for. The primary annoyance is that though my authoring environment of choice, Unity, exports to multiple platforms, compatibility problems still exist. The libraries I use for windows executables might not work as well on Android and with the death of the unity browser-based plugin, I am now limited to HTML5/WebGL in that particular medium.

dk2-product

Windows 10 offers some hope in that it is attempting to converge devices ranging from mobile to desktop, something which initially made me paranoid due to the stability of having something of a standard in place (iOS and Android for mobile). I didn’t see a compelling reason to have that ecosystem disturbed until the devices started getting more powerful and, rather than being used as portable devices, they started to branch into desktop usage scenarios.

That suits me fine, it is always easier to stick to one platform provided that it remains flexible, and that’s something Windows 10 promises. The university is investing in technology and, with it, some Surface Pro tablets. The affordance this provides is a standardised set of hardware to develop ‘normal windows compatible software’ for in a mobile/tablet-based form factor. That is quite powerful and frees us up to innovate new ideas for classroom-based learning at higher education.

Inclusivity and engagement remain key factors, it remains to be seen how this pans out but I’ll be posting my experiments with the Oculus Rift in due course.

A better interface for “Google Cardboard”

In my ongoing search for a suitable alternative to the standard “Google cardboard” headset I’ve procured yet another phone housing. I prefer the phone-based approach to virtual reality as it’s far more accessible to people than head-mounted displays are at this moment in time. In addition to that, the camera throughput allows for interesting uses of augmented reality. I’ll be writing more on that in the future. This entry is a small hands-on review of the Durovis Dive 5 headset.

My first experiment with alternative approaches to cardboard began with the colorcross headset. While the approach provided for a more robust alternative to an ever-deteriorating cardboard product, it was still lacking. The phone housing wasn’t very comfortable around the eyes and it would leave tell-tale marks outlining where it had been digging into the users face. This rendered it somewhat unsuitable for my purposes as my interest is in rolling this out to students at some point and comfort is of paramount importance. In addition to that, with the colorcross approach, the phone wasn’t entirely secure. The Duros Dive 5, however, seems to fix these issues.

durovis1
A better build quality than most housing alternatives

The Duros headset feels a lot sturdier than the cheaper colorcross, which is what you’d expect given it’s price tag of €59.98, making it three to four times more expensive. What this affords you, however, is a very comfortable experience. The foam padding around the eyes eliminates the indentation marks inflicted by the housing and ensures that it remains in place without biting into your head.

durovis2
Both lens can be adjusted independently

Each lens can be adjusted separately and they don’t feel loose. This feature makes it great for accessibility in my books. They can be moved in two directions, closer to the screen and out to each side. In terms of the size of the phone it can house, this model isn’t meant for large phones. My Galaxy S3 fits inside nicely but if you have it augmented with an extended battery (resulting in a thicker phone, it won’t fit). The full compatibility list is on the manufacturers website.

The field of vision is relatively good, moving the lens closer tends to improve things but, due to the size of the phones the Dive 5 is capable of housing, it’s not a completely immersive experience. It’s worth mentioning that the Dive 7 model is designed to house 7 inch tablets which is something I’m keen to try next. I’d expect that the field of vision in something of that size would make for a very interesting experience. The housing alone for the Dive 7 costs €119, which still provides for a more scalable and cost effective solution than a separate head-mounted display device.

durovis3
The foam padding isn’t just for your eyes, it’s also used to keep your phone in place

You can purchase a magnetic upgrade kit for the Dive 5 separately from the website, if you ordered before the 9th of March 2015 as it’s stated that anything ordered after the date comes with one (though mine did not)!

I’ll be using my colorcross for the moment as my S3 uses a giant battery, bringing its size slightly outside of the comfort zone of the Dive 5. The product is solid however and if you’re looking for an alternative to the cardboard housing, this is a great step to take and makes a world of difference. It’s an order of magnitude more comfortable.

Low cost virtual reality

One of my current projects involves coming up with a way to implement a low cost virtual reality training simulation. Traditionally, most immersive environments used for such a purpose tend to cost a lot of money. Some of you will be familiar with the Igloo method, something which takes up a lot of space and isn’t really practical due to its logistical constraints.

With all the buzz around VR headsets, it has become painfully apparent (with all the competition from various manufacturers attempting to get their head-mounted displays out first) that there is no standard. Nobody knows what protocol is going to become the most widely adopted in the coming years and nobody knows what the reception is going to be like. Interest is at an all-time high however and it would be negligent not to explore the possibilities for education. To that end, I’ll divulge a little of what I’m attempting to do by way of interface devices, just as a means of exploring interactivity in a practical sense.

zeemote
I’m using a zeemote, cheap, responsive and wireless

As our interface device for navigation, I’m exploring the use of a bluetooth analog stick with three buttons. The stick allows you to move backwards and forwards in addition to strafing to the left and right. The headset, which is a phone using the Google cardboard SDK, is responsible for directional input and displaying the scene, rendered from different perspectives, one for each eye. Rather than use a tacky cardboard housing, which is what the idea originally stemmed from, I’ve found a manufacturer who produces a more robust housing made from plastic, it’s a lot more professional. VR is always a hard sell if only because it looks so awkward to the onlooker, having a cardboard box strapped to someone’s head is certainly not going to help a pitch aimed at cutting edge technology.

colorcross
The housing is a colorcross phone mount, it comes with an adjustable lens

In all, the equipment costs under £20 versus the hundreds you’d be paying for a soon to be redundant first generation headset. It’s also highly functional. The training environment I’m developing in Unity3D has been based around an existing multi-user environment I developed previously and allows the host to manipulate the scene in real-time. Analytics are also important and so I’m working on a bespoke solution to make sense of all the data being gathered as each user engages with the various 3D scenes.

I’ll be posting more information in the coming days.