An Introduction to Positional Tracking and Degrees of Freedom (DOF)

6

The Oculus Rift developer kit is set to reach devs next month. It is widely expected to have significant impact in the future of gaming. While we’re quite excited for the Oculus Rift, there’s an issue that plagues virtual reality gaming that even the Rift doesn’t counter: positional tracking.

The Oculus Rift includes an impressive custom sensor unit that makes for extremely tight head-tracking. Unfortunately, like all other sensors in its class, it lacks the ability to accurately detect translational movement which is highly desirable for virtual reality gaming.

This article is a brief introduction to positional tracking and ‘degrees of freedom’; necessary concepts for discussing the mechanics of VR.

This guest article is written by Jordi Batallé, who is a virtual reality enthusiast and holds a master’s degree in computer science. Batallé has been hard at work on a solution to the positional tracking problem. You’ll be seeing more of his work on the matter soon.

What does Degrees of Freedom (DOF) mean?

Degrees of Freedom (commonly abbreviated as DOF) refers to the movement of a rigid body inside space. It could be explained as “different basic ways in which an object can move”. There are only 6 DOF in total, and we can actually divide them into 2 different types, translations and rotations:

Translation Movement

A body is free to translate in 3 degrees of freedom: forward/back, up/down, left/right.

translations diagram

Rotation Movement

A body can also rotate with 3 degrees of freedom: pitch, yaw, and roll.

rotations diagram

Thus, 3 types of translation + 3 types of rotation = 6 DOF!

There are 2 ‘directions’ in which an object is free to move inside any particular DOF. For instance an elevator is constrained to 1 DOF (a vertical translation), but inside this DOF it can freely move up or down. Similarly a Ferris wheel is also constrained to 1 DOF, but in this case it’s a rotational DOF, where it can roll one way or the opposite way.

Continuing with the amusement park theme, a bumper car has 3 DOF in total: it can translate in only 2 of the 3 axis (it cannot move up and down like an elevator), and it can rotate in only one way (it cannot change its pitch or roll like an airplane). So 2 translations + 1 rotation makes 3 DOF.

Any possible movement of a rigid body, no matter how complex it is, can be expressed as a combination of the basic 6 DOF. For instance when you hit a tennis ball with a racket, the complex movement of the racket can be expressed as a combination of translations and rotations.

IMUs and DOF

The Oculus Rift IMU
The Oculus Rift IMU

An Inertial Measurement Unit (also called an IMU or sometimes ‘tracker’), is an electronic device that measures and reports velocity, orientation, and gravitational forces, using a combination of sensors (accelerometers, gyroscopes and magnetometers). One of the main applications for IMUs in the past was aircraft instrumentation, but nowadays they are used in all sorts of devices, including mobile phones. This has taken the cost down a lot, and we can consider the 3DOF orientation problem “solved” nowadays. Unfortunately in practice IMUs can only accurately measure and report orientation values, not translations.

What Does 9 DOF Mean Then?

In the world of IMUs, some funny terminology has sprung up. There are numerous references to ‘9 DOF’ IMUs, but this is rather confusing given that there are only 6 DOF total.

Basically many companies that build IMUs have coined the term 9 DOF in order to sell their products, but these do not refer to ‘real-life’ DOF. The 9 DOF comes from adding up the DOF that each type of sensor contained inside the IMU can detect. So if the IMU has an accelerometer that is able to detect 3 DOF, a gyroscope that can detect 3DOF and a magnetometer that can detect 3DOF then they call it a 9DOF IMU. That doesn’t correspond to reality because the 3 sensors measure the same 3 DOF (orientation only).

A 9 DOF IMU is potentially better than a 6 DOF IMU because it can use sensor fusion (mixing the data from different sensors) in order to improve the quality of the final output, but it will still not be able to detect translations.

What is Positional Tracking and Why is It So Important for Virtual Reality?

Positional tracking is a mix of hardware and software which is able to detect the absolute position of an object. It’s important for VR because in combination with orientation tracking it becomes possible to measure and report all the 6 DOF of real-life. It’s important that we can track accurately how objects (like the head or the hands) move in real life in order to represent these inside VR, since virtual reality is about emulating (and altering) reality.

The Oculus Rift, for instance, provides 3 DOF (rotational) head-tracking which is not positional. While you’ll be able to look around the virtual reality world by tilting and turning your head, you won’t be able to lean down to inspect objects on the floor or lean around corners because there’s no way to tell exactly where you head is.

Positional tracking can also help improve the 3D perception of the virtual environment thanks to an effect known as ‘parallax’. Parallax is the way that objects that are closer to our eyes move faster than objects far from our eyes. This effect helps our brains to perceive distance in conjunction with stereoscopy (the difference between what our left and right eyes see). Some people argue that parallax is actually more important for perceiving 3D than stereoscopy.

Here is a famous example by Johnny Lee using the wiimote that shows very clearly how parallax helps us to perceive 3D:

Finally, real 6 DOF tracking helps avoid motion sickness commonly associated with 3 DOF HMDs, which happens due to the disconnect between what your eyes see and what your inner ear vestibular system (equilibrium) is telling you.

Exclusive: Project Holodeck Hands-on Demo and Interview with Director Nathan Burba [video]

15

Recently I got a chance to meet up with Project Holodeck director Nathan Burba. Not only did we sit down for a detailed interview, but I was also fortunate enough to get a hands-on demo of the system. Project Holodeck is an immersive virtual reality multiplayer platform. Yes, that’s a mouthful, but it means something significant. This is a complete virtual reality platform. The Oculus Rift is great, and I can’t wait to get my hands on it, but I’m even more excited for Project Holodeck because it is the complete virtual reality package.

SMI Introduces 3D Glasses With Eye Tracking

0
smi eye tracking smart glasses

smi eye tracking smart glasses
SensoMotoric Instruments (SMI), based in Germany, recently introduced new 3D glasses capable of real-time eye tracking. These are active-shutter glasses like you’d find in use with a home 3DTV, but they also support eye tracking and have attachable markers for headtracking, making them ideal for a Cave Automatic Virtual Environment (CAVE). The glasses could be used to enhance such virtual reality experiences by adding an additional method of input, providing valuable usability metrics, and enabling more precise calibration of displays.

Details on Oculus Rift Pre-Kickstarter Orders and Limited 100 DIY Kits

0

pilot_run_unit2

If you’ve been following the Oculus Rift story closely as we have, you’ll know that it’s an entirely different beast than it once was. Originally Palmer Luckey, the creator of the Rift, expected to sell a limited quantity of DIY self-assembly kits to members of the MTBS3D forums. He intended to hand-build, package, and ship them himself. Indeed he took a number of these pre-Kickstarter orders, but then things blew up when John Carmack showed off the Oculus Rift at E3 2012.

With interest skyrocketing, Palmer realized Kickstarter would be a more sensible option and that he’d have to move to mass-production. To appease the early adopters who wanted to get a DIY s kit, the Kickstarter had a special DIY kit reward tier for $275. This was limited to 100 orders and was sold out just hours after the Kickstarter went live.  However, now that mass-production is happening, it’s been unclear exactly what the pre-Kickstarter and limited 100 DIY kit orders would turn out to be. We now have some info concerning the fate of these two legacy orders.

Oculus Rift Update: Pilot Run, Vision Correction, and Manufacturing Behind-the-scenes (on schedule!)

0
oculus rift palmer luckey development kit pilot run
Palmer Luckey holds the first Oculus Rift developer kit from a successful pilot run.

Oculus Inc. just dropped a big update on the Oculus Rift VR headset. Highlights include a successful initial pilot run at the factory, ‘eyecups’ to help those with less than perfect vision, an adjustable assembly if you want to use your glasses, and lots of behind-the-scenes info from the factory floor in China. Perhaps the best news of all is that the Oculus Rift is on schedule to ship the first batch in March!

Half Life 2 Modded for Oculus Rift Virtual Reality — Independent Head and Gun Movement [video]

4
half life 2 virtual reality headtracking

half life 2 virtual realityHere’s a brief video showing the work of Nathan Andrews who is modding Half Life 2 for virtual reality and the Oculus Rift. In almost all modern first-person shooters, where you look and where you aim are one in the same. Andrews has separated the two which enables the ability to aim your gun one way while looking another. Combined with a gun-prop and VR headset, this makes for an immersive and natural playing experience.

Oculus Rift News Bits: Late Night with Jimmy Fallon, Production Factory Photos, Johnny Chung Lee Visits, CES Awards [video]

2

oculus rift vr headset late show jimmy fallon

The Oculus Rift VR headset made a guest appearance on the Late Night Show with Jimmy Fallon on Wednesday and we’ve got the video for you. Oculus Inc. has posted a few photos of the production factory and Johnny Chung Lee visiting the offices. We also recap CES 2013 awards received by the Oculus Rift.

Google Glass Foundry Event Locked Down with Strict NDA

4
sarah price google glass
Sarah Price, Google Glass Community Advocate – photo credit: Max Braun

Google is set to hold two ‘Glass Foundry’ developer events for Google Glass at the end of January and early February. While we’ve been hoping to get fresh details out of the event, it sounds like we’ll have to rely on leaks — Google has sent a strict non-disclosure agreement (NDA) to developers who will be attending the event.

Sony HMZ-T2 Now Shipping in Canada, May Never Reach U.S.

0

sony hmz-t2 vr headset head mounted display

The Sony HMZ-T2 head mounted display / VR headset is now available for purchase in Canada. Back in October we caught the HMZ-T2 HMD available in a number of countries for some other outrageous prices. Sony Canada brings the price down a bit, but it’s still even more expensive than original HMZ-T1. Additionally, Sony U.S. has yet to roll out the HMZ-T2 and it’s possible that they never will.

Former Activision Executive Laird Malamed Joins Oculus Inc.

8
Laird Malamed oculus inc bio photo
Laird Malamed

Despite all of the company’s success with the Oculus Rift at CES 2013, Oculus Inc. is still a young startup. The company has had open spots for several senior positions for a few months now (see their Careers page). The latest name to join the Oculus team is Laird Malamed who takes the position of Chief Operating Officer (COO). Malamed was formerly the Senior Vice President of publisher Activision. Here’s his official description from Oculus:

Laird is a 20-year veteran of the entertainment industry. Malamed was Sr. Vice President and head of development at Activision Blizzard overseeing software, hardware and manufacturing for products such as Guitar Hero, Call of Duty and Skylanders. Malamed earned a joint BS degree from the Massachusetts Institute of Technology in Aeronautical & Astronautical Engineering and Film & Media Studies. He attended the Graduate School of Cinematic Arts at USC where he is currently an adjunct professor in the Interactive Media Division.

Innovega Demonstrates Progress on iOptik Contact Lenses for Augmented Reality [video]

8

innovega ioptik augmented reality contacts

The last time we heard from Innovega was back in April. They demonstrated their iOptik contact lens which allows users to focus their view on images that are extremely close to the eye. At CES 2013 last week, Innovega showed off it’s latest prototypes of the iOptik augmented reality system which combines contact lens with a low-profile head mounted display. The setup allows the creation of an AR display system which is compact but still retains a wide field of view.

Google Glass Developer Update: Devs Invited to ‘Glass Foundry’ Event

3
Google Glass Pre-order Token. Photo courtesy Techno Buffalo.
Google Glass Pre-order Token – photo courtesy Techno Buffalo

Google has sent out invites to a developer-focused event for Google Glass, the company’s upcoming wearable head mounted display. They’re calling it ‘Glass Foundry’ and it will be a two day ‘hackathon’ held in two locations: San Francisco and New York City. The invite is supposedly going out to those who pre-ordered the $1500 Google Glass ‘Explorer Edition’ at last year’s Google I/O conference. High profile developers are likely on the invite list as well. At the event developers will have access to Google Glass prototypes and begin learning how to build applications for the device.

Ibex Virtual Reality Desktop Environment News: Mac Beta, Windows Version Possible

0
Looking into Ibex through an HMD: display output is warped to correct for the Oculus Rift's high-FoV lenses
Looking into Ibex through an HMD: output is warped to correct for the Oculus Rift’s high-FoV lenses

Ibex is virtual reality desktop environment (let’s call it a VRDE) which allows you to float desktops of arbitrary number and dimensions around you in a virtual space. Combined with a head mounted display, Ibex creates a 360 degree virtual world where you can do your computing. The sole developer behind the project, Hesham Wahba, continues to work on the Ibex VRDE in preparation for the Oculus Rift VR headset / head mounted display. Wahba has now launched a beta of Ibex for Mac which users can test even without an HMD.

Valve Ports Team Fortress 2 for VR Headsets, Likely Oculus Rift, More Details at GDC 2013

2
Team Fortress 2 now supports the Oculus Rift

tf2 team fortress 2 oculus rift virtual reality

Valve, the famous developer who has demonstrated a particular interest in virtual reality, has ported the ever-popular Team Fortress 2 for use with VR headsets. This confirmation comes from the Game Developers Conference (GDC) website which has announced two keynotes to be given by Valve employees; one of which will talk explicitly about a “virtual reality version of TF2.”

Oculus Rift CES 2013 Interview with Palmer Luckey

0

palmer luckey ces 2013 interview

Here’s another interview from CES 2013 with details on the Oculus Rift head mounted display / VR headset. Again, we’ve heard most of it already, but if you’re like me you’re soaking up every scrap of info you can. In this interview Palmer Luckey, the creator of the Oculus Rift, talks to his long-time virtual friend Neil Schneider for the first time in person.

39,929FansLike
13,574FollowersFollow
66,541FollowersFollow
27,800SubscribersSubscribe

Latest Headlines

Features & Reviews