Surprising Apple started this year’s WWDC with an extensive presentation of ARKit 2. This first included the introduction of a new file format called USDZ. With USDZ Apple wants to make 3D models available in the easiest way for mobile devices. The 3D models can not only be integrated into documents, websites or similar, but these can also be provided with animations.
In keeping with the new file format, Apple has released a new feature in ARKit 2. Called AR Quick Look, it allows you to leverage AR experience in iOS 12 in apps like Files, Mail, News, and Safari without having to leave the app.
Measure replaces third-party apps
Also new is Measure. While some developers used ARKit as a tape measure in the last year shortly after the release, Apple has integrated the feature as a stand-alone app directly into iOS 12. The app automatically detects flat rectangular surfaces and can show you the outside dimensions. Alternatively, you can measure distances and distances with a virtual tape measure. In addition, the app has inherited a well-known function from the compass app and can also be used as a spirit level.
Reflections & Object Recognition in ARKit 2
Using the example of the Animojis and the new Memojis, Apple showed Another feature of ARKit 2. The TrueDepth camera recognizes faces much better. It analyzes where you are looking, whether you stick out your tongue or if you wink. Especially the latter looked rather strange and is now better.
Not only faces are recognized, but also 3D objects. For example, at WWDC, Apple brought a Lego building to life. ARKit 2 assigned the objects and their orientation and was then able to create a virtual world around the building with assignments and additional information. The feature was supported by more realistic reflections that can be seen on the virtual content.
Shared AR Experiences
The core of ARKit 2 is probably the shared AR experience. For the first time, Apple’s update allows AR content to be assigned to a fixed location. They are quasi anchored and can be viewed again later. However, this not only works with one device, but several users can simultaneously view the content with their iOS devices exactly the same. This will make competitive AR games possible in the future.