You are using an outdated browser. Please upgrade your browser to improve your experience.

See a Filmmaking Demonstration of Apple ARKit and Unity3D

Augmented Reality
August 1, 2017

Apple’s ARKit won’t officially launch until this fall. Already, however, we have seen some pretty amazing demos of the augmented reality framework. The most recent demonstration shows how ARKit could play a role in film-making.

As TNW first noted, independent game developer Duncan Walker used ARKit and Unity3D to create an augmented reality film experiment featuring virtual robot commanders on the street side by side with real humans.

Take a look:

According to TNW:

The final effect is frankly nothing short of impressive. In fact, the rendered models appear to be authentic enough to pass as natural human movement: The shaky hand-held camera dynamics coincide almost perfectly with the movement of the robots.

The other part of the magic is how credibly ARKit maps out renders onto footage from the real world. While professionals might be able to spot some inconsistencies in light sources, this is hardly a nuisance to the untrained eye.

In case you’re wondering how Walker achieved this outcome, he says he shot the footage with his iPhone 7. He then used Unity to model the characters and set up the scenes, before eventually resorting to the ARKit plugin to render the models into the video.

Awesome, no?

ARKit is expected to launch with iOS 11 this fall.

For the latest ARKit projects, visit the Made With ARKit website or subscribe to the site’s Twitter feed. You should also consider a new subreddit dedicated to all things ARKit located here.