The company formerly known as AxonVR, which has raised more than $5 million in venture capital, is rebranding to HaptX, and revealing a feature prototype of a VR glove which uses micro-pneumatics for detailed haptics and force feedback to the fingers. After trying the prototype for myself, I came away impressed with the tech. The company's next challenge is to turn the prototype into something sleeker, smaller, and far more practical. Fitting Procedure [caption id="attachment_71372" align="aligncenter" width="640"] Photo by Road to VR[/caption] Meeting with HaptX co-founder Jake Rubin in Silicon Valley earlier this month, I got to try the latest prototype of the company's wild-looking haptic VR glove—a monstrous piece of equipment hooked up to some massive cabling. Putting it on—with the help of two people by my sides—I felt like I was preparing for a medical procedure, as the pair showed me how to carefully guide my fingers into the right places, pull out some fabric slack, and then tighten the glove to my hand with a ratcheting mechanism to ensure a snug fit. But the point of this prototype is not about size and fit, it's all about function. And function it did—the haptics and force feedback were the most responsive and detailed I've tried to date, in part thanks to the glove's micro-pneumatics. Micro-pneumatics [caption id="attachment_71368" align="aligncenter" width="640"] Photo by Road to VR[/caption] The HaptX gloves is based on innovative micro-pneumatic technology. The company has developed a method for essentially producing thin, bendable fabrics which are manufactured with a series of tiny air pipes along their length which eventually terminate in small inflatable circles which act as "haptic pixels," according to Jake Rubin, one of the company's two co-founders and its CEO. The inflatable circles, just a few millimeters across, are aligned into grids; by precisely controlling when and which haptic pixels to inflate, a convincing sensation can be created, simulating the feeling of an insect crawling along your finger or a marble rolling around in the palm of your hand. https://www.youtube.com/watch?v=2C2_kbjtjRU The glove also features force feedback: the ability to restrict the movement of your fingers to simulate holding objects. This too is based on the company's micro-pneumatic technology, which Rubin explained works by inflating stoppers along the joints of your fingers to restrict their movement. The effect is that when you reach out to grab an object, say, a baseball, your fingers stop right where they should be coming in contact with the baseball. [caption id="attachment_71369" align="aligncenter" width="640"] HaptX CEO Jake Rubin | Photo by Road to VR[/caption] Both effects were impressively responsive and quite convincing. I've tried a few other similar systems, but the haptics from the HaptX glove blew the others away. The glove puts the haptic material across the palm of your hand and on the tips of your fingers—totaling some 100 individual haptic pixels—allowing you to feel a finely detailed sensation of pressure in all those places. The range of tactile sensations was ultimately surprising; revealed to me when I was thrown in to the company's farm-themed menagerie of tactile examples. Feeling the Farm [caption id="attachment_71376" align="aligncenter" width="640"] Photo by Road to VR[/caption] Rubin walked me through the demo experience, built using an SDK of HaptX's design, which he says is largely created by leveraging Unreal Engine's physics system to tell the glove when and where to apply haptic effects and when and how to engage the force feedback. With the glove on my right hand, and wearing an HTC Vive headset, I was looking down at a miniature barnyard with some little sunflowers off to the right and a tiny patch of wheat in front of a barn. Rubin encouraged me to start poking and prodding at the scene. Each of the glove's fingers is tracked by a proprietary magnetic tracking system which Rubin claims is capable of sub-millimeter precision. Indeed it worked well. [irp] As I reached out with my index finger to gently touch the leaves on the side of the sunflower, I could feel pressure against my finger that quickly and closely followed the visuals, making it easy to connect the feeling with the image. Next to the sunflowers was a little grey storm cloud, and when I poked it, pea-sized raindrops began falling from within. Stretching out my palm to catch them, I felt a convincing pitter-patter of pressure right on my palm. A similarly convincing moment came when I brushed my palm across the tops of the tiny wheat plants. [caption id="attachment_71374" align="aligncenter" width="640"] Photo by Road to VR[/caption] Eventually a baseball-sized tractor came rolling out of the barn. When I went to pick it up like a little toy, my fingers stuck in place—seemingly right against the virtual tractors surface—and wouldn't budge. It was a convincing effect, especially combined with the haptics putting pressure on the tips of my fingers as though I was holding something. Although there's no way for the gloves to simulate the weight of the object, making it feel like it was at least real, as far as the volume that it takes up, is a big step up. 'Mock grabbing' items with controller-less VR hand input feels really unnatural, but the quality of this force feedback remedied that with ease. There was more to do and see in the demo, including some tiny critters that came out of the barn to dance around on my palm so that I could feel their little steps (including the eight legs of a spider, which Rubin tells me is the most contested part of the demo). In the end though, the whole ordeal provided me with a new benchmark for small-scale haptics in VR. Continued on Page 2: Enterprise First » Enterprise First [caption id="attachment_71377" align="aligncenter" width="640"] Image courtesy HaptX[/caption] There's other VR haptic solutions out there that are interesting in their own right, but as far as the level of detail, I haven't seen anything else come close. Granted, the HaptX glove demo was clearly built for what it does best; it was focused more on subtle, small-scale effectives, and didn't include any of the common VR game mechanics like gripping and shooting a gun, drawing a bow, throwing a grenade, or swinging a sword. [irp] I'll be interested to know how those sorts of actions feel through the HaptX glove, but the company has a fair excuse for not yet touting that sort of functionality; the product is headed first toward the enterprise sector (where shooting pistols and swinging broad swords isn't exactly the main focus). Rubin says that HaptX's goal is to offer a VR glove product which works as a generalized haptic display, and can be used to replace expensive, purpose-built props to make training and simulation uses of VR cheaper. He also notes the potential for design and manufacturing, architecture, engineering, construction and more as places where the glove could be useful. [caption id="attachment_71378" align="aligncenter" width="640"] Image courtesy HaptX[/caption] Rubin says that, following this feature prototype, the HaptX team is busy building the first productized version—an evaluation kit, with 20 companies already on board to receive the kits in 2018. And though it's targeting enterprise first, the company is also pursuing out-of-home entertainment usage for the HaptX glove, and, in the longer term, the consumer market. That's not to say it'll necessarily be an easy challenge though. A Fitting Challenge HaptX has clearly demonstrated the capability of their underlying haptic technology. But perhaps an even bigger challenge will be figuring out how to package the tech into something that's ergonomically agreeable. The monster prototype that I saw is simply too big, bulky, and too slow to put on to be useful (not to mention the large pieces of additional equipment needed to power it). It also didn't fit my hand particularly well; I found myself regularly tucking my fingers back into the finger tip caps in order to maintain the best haptic feeling. By the end of the demo, I could feel the circulation to my hand was significantly reduced. [caption id="attachment_71370" align="aligncenter" width="640"] Photo by Road to VR[/caption] Rubin tells me that the team is confident they can tackle these challenges. For one, the current prototype is a one-size-fits-all ordeal, and since human hands can vary quite drastically in size, this is far from ideal. A range of sizes will allow a more snug fit for more people. And when it comes to extra equipment (like the control box and the air compressor) needed to power the glove, Rubin says that in addition to using much smaller regulators to reduce the size of the control box, the company expects to be able to build the compressor directly into the control box, thereby simplifying the additional equipment. - - — - - The company's ultimate vision, Rubin says, is for HaptX to build its haptic tech into a full body suit for total immersion. The company is purportedly already experimenting with larger wearable arrangements of its micro-pneumatic material which could one day be sewn into vests, shoes, and more to bring an even greater amount of your body into VR.