Next to sight and sound, haptics are one of the lowest hanging fruits for creating immersion in VR. But beyond the rumble we have in today’s VR controllers there’s lots of other immersive haptic tech yet to be widely adopted.
Over the years I’ve had the fortune to see a wide range of VR haptic solutions ranging from the ‘amazing but impractical’ to the ‘simple and somehow unadopted’. Here’s a look at the five most interesting haptic demos that have stuck with me in the last five years.
A Joystick that Pushes Back
Photo by Road to VR
While it might be difficult to imagine how some haptic technologies could feasibly fit into a standard pair of VR controllers, the force-feedback joystick from Foldaway Haptics looks like a prime candidate.
Back in 2019 I got to demo the device, which takes the form of an origami-like structure that can tilt itself in any direction. The company has managed to make it work like a regular joystick for thumb input, with the added benefit of it being able to push or pull against your thumb in any direction. And further, what’s normally a single ‘click’ when you press down on a thumbstick for input can become a continuous press with varying force depending upon the situation.
https://youtu.be/Ylye45pvatw
I tried the prototype running with a Vive headset and a small demo game that Foldaway built. In the game I saw a miniature cartoon farm in front of me at waist height; a few different animals were running around on the ground. When I reached out to grab an animal, I pushed down on the thumbstick to ‘grip’ the animal between my hand and my thumb. Upon grabbing the animal, the thumbstick became stiff (letting me know that I had successful grabbed something).
Each animal had somewhat different haptic properties. The pig, for instance, was a little bit ‘squishy’, allowing me to push my thumb down on the stick a bit. The penguin was ‘harder’ so the thumbstick resisted my thumb much more. If I squeezed too hard, the force-feedback would give out and the thumbstick would bottom out until I let go (I expect this is to protect the motors and mechanism from damage).
Co-founder Marco Salerno told me that the current prototype is capable of pushing back with two newtons (about the force of two apples resting on your hand), though they could feasibly push upward of 15 newtons with some different design tradeoffs.
Beyond force-feedback just in the up and down direction, the joystick can also tilt itself against your finger rather than just pushing back. This allows directional information to be conveyed to you through touch, which is a big deal because the simple vibrating haptics in any consumer controller (VR or otherwise) cannot convey arbitrary directional information.
Directional haptics like the Foldaway device are especially useful compared to rumble because they can indicate a force in arbitrary directions, rather than simply an amplitude with no specific position or orientation (which is all you get with typical rumble).
Call it ‘obvious,’ but this is the first time I’ve seen Go Touch VR’s approach to VR haptics, which provides nothing more than a variable force against the top of your fingertip using a flat piece of piece of plastic that moves back and forth with a little motor. Simple, and yet surprisingly compelling. The sensation is much like what you feel when you press your finger against a flat surface like a desk.
Typical controller rumble is widely applicable for shooting games where you’d expect a weapon to rumble in your hand. And yet in VR we also find lots of experiences where you aren’t shooting, but are instead grabbing, touching, and manipulating objects in VR which wouldn’t vibrate in real life, making it difficult to use rumble to convey meaningful, direct feedback.
It’s that grabbing, touching, and manipulation where Go Touch VR’s ‘VR Touch‘ haptics hopes to excel. Based on what CEO Eric Vezzoli calls a ‘Real Contact Sensation’ haptic approach, VR Touch is a simple, compact device which straps to the end of your fingers and provides nothing more than a plastic pad which can exert varying levels of force against the top of your fingertip.
That force can create a surprisingly compelling sensation of touching and grabbing objects with your fingers. Rather than abstract rumble, VR Touch gives the illusion of objects pushing back against your fingers directly.
The Go Touch haptic solution is fundamentally inexpensive given the way it works and seems like it would pair easily with a pair of VR gloves, or as a single module which would strap to the end of your finger to provide haptics and some input in conjunction with finger tracking.
Playing With Fire & Ice
Photo by Road to VR
Everybody knows that the best videogames always have a lava level and and ice level… in VR, what if you could feel them?
I’ve tried a few different thermal haptic devices throughout the course of my VR reporting, but nothing that really impressed me. Usually the effects are hard to notice because they don’t feel particularly hot or cold, and they take so long to activate that it’s hard to sell the illusion that the effect is being caused by something happening in the virtual world.
I got to try the ThermoReal thermoelectric skin at the Vive X Batch 2 demo day in San Francisco this week and it’s led me to become a believer in the value of thermal haptics for the first time. That’s thanks to three things:
Latency
ThermoReal—which is a thermoelectric generator based on something called the Seebeck Effect—is impressively quick to react. I held a prototype wand which had the ThermoReal skin embedded in it as I watched a video of a man jumping into a river. The moment he plunged into the water I could feel the wand get cold to the touch. Another video showed a car blowing up and the heat effect kicked in almost immediately with very little ‘spin up’ time. Keep an eye on the ‘thermal imaging’ section of the clip above to see how quickly the device changes temperatures.
In addition to hot and cold, the device can do both at the same time in close proximity, which is perceived as an amplified ‘pain’ effect compared to just using heat alone.
Amplitude
It isn’t just the speed of the hot or cold effect, but the extent of it too. I was impressed with how the device could achieve its maximum level of cold so quickly.
Even more than the cold effect, the heat effect was so great that I had to loosen my grip on the ThermoReal prototype at times; I was honestly concerned the device could burn me. I asked one of the creators if there was any risk of injury and was told that the device would only get up to 4°C hotter than body temperature. Based on how hot it felt, I’m still skeptical of that claim, though it’s possible that the rate of heat increase (rather than the measured temperature itself) could signal to my brain a more severe sensation of heat; I’ll be interested to learn more about the minimum and maximum possible temperatures of the device.
Form-factor
Photo by Road to VR
Thermoelectric generators like ThermoReal are not new. What is new, says TEGway, is the form-factor of their device. It takes the form of a flexible skin-like array of conductors which can be curved and wrapped around various surfaces, which could make it perfect for integration into VR controllers, gloves, or even suits.
The company showed a rudimentary but functional VR demo using the ThermoReal dev kit with an HTC Vive. In the demo, a character throws fireballs or snowballs at you; the gloves on each hand would respond with the appropriate temperature effect depending upon which was thrown and which hand you blocked the ball with. If the fireball or snowball hit you in the face, you’d feel the temperature on your face thanks to the forehead-mounted haptic unit.
Photo by Road to VR
The demo also demonstrated an interesting haptic effect which, while it made use of temperature differences, conveyed something different than simply hot or cold. In the demo you could expand a light shield on your hand which would block the incoming projectiles and disperse their energy across the shield. The glove and sleeve haptics responded by quickly alternating between hot and cold, creating a ‘force’ sensation that was really interesting; the feeling of hot and cold spreading rapidly over my arm created a unique feeling that could be used for more general haptic feedback than simply indicating which things are hot and cold.
Though the solution did offer a very interesting new dimension of haptic sensations for VR, expecting users to strap on additional accessories when jumping into VR is generally a non-starter for widespread adoption. As I concluded at the time: “it’s clear that thermal haptics would be much more viable if integrated into the things that VR users are already holding or wearing (like controllers and headsets). A separate ‘wearable’ accessory from ThermoReal would likely be relegated to non-consumer use-cases like training, rehabilitation, simulation, and maybe out-of-home VR attractions.”
