Apple’s ARKit won’t officially launch until this fall. Already, however, we have seen some pretty amazing demos of the augmented reality framework. The most recent demonstration shows how ARKit could play a role in film-making.
As TNW first noted, independent game developer Duncan Walker used ARKit and Unity3D to create an augmented reality film experiment featuring virtual robot commanders on the street side by side with real humans.
Take a look:
According to TNW:
The final effect is frankly nothing short of impressive. In fact, the rendered models appear to be authentic enough to pass as natural human movement: The shaky hand-held camera dynamics coincide almost perfectly with the movement of the robots.
The other part of the magic is how credibly ARKit maps out renders onto footage from the real world. While professionals might be able to spot some inconsistencies in light sources, this is hardly a nuisance to the untrained eye.
In case you’re wondering how Walker achieved this outcome, he says he shot the footage with his iPhone 7. He then used Unity to model the characters and set up the scenes, before eventually resorting to the ARKit plugin to render the models into the video.