Ok, these ARKit experiments and mashups are getting darn cool. Here VR development studio Emergent linked together HoloLens and an iPhone with ARKit to turn the iPhone into a 6DOF motion tracked controller.
The tracking may be somewhat rudimentary, but it’s becoming increasingly clear the many possibilities that come with smartphones that are able to understand their position in the world. From a fusion of AR and VR to a portal into volumetric video, we’ve seen some really cool ARKit experiments, but none that have used an iPhone as a motion controller instead of a display.
Emergent has demonstrated the possibility by turning an iPhone into a motion controller for a HoloLens game. In the game the HoloLens is represented as the player’s helmet, while the iPhone is a sci-fi laser gun that’s tracked in all dimensions. Taking things a step further, the studio demonstrates how bullet laser holes can be convincingly overlaid onto objects in the environment, thanks to the devices’ ability to map the geometry of the environment.
It’s clear from the video that there’s a good deal of latency and that the precision isn’t particularly high (after all, ARKit isn’t intended for immersive experiences), and keeping the tracking systems of both HoloLens and ARKit in sync over distance and time could post a challenge. But the potential for the use-case is clear—especially as smartphones begin to hit the mainstream with more precise motion tracking instruments—a well tracked smartphone can be a flexible and widespread tool for AR and VR alike.