WWDC2021-Create 3D models with Object Capture

https://www.youtube.com/watch?v=88rttSh7NcM 

 

https://developer.apple.com/videos/play/wwdc2021/10076/

Create 3D models with Object Capture - WWDC 2021 - Videos - Apple Developer

1. Photo Capture

  - You just need to make sure you get clear photos from all angles around the object.
  - If you capture on iPhone or iPad, We can use stereo depth data from supported devices to allow the recovery of the actual object size.

2. Photogrammetry API

you need to copy images to your mac, where you can use the Object Capture API to turn them into a 3D model in just minutes.
*The API is supported on recent Intel-based Macs, but will run faster on all the newest Apple silicon Macs  since we can utilize the Apple neural Engine to speed up our computer vision algorhitms.

3. Output model

Provide models at four detail levels. optimized for your different use cases.

* Output

4. On AR

You can view the new model in AR Quick Look right on your iphone or ipad.

 

*Work flow
Setup(Create session -> Connect output stream) -> 'Process':Request models.

1) Session input sources

2) output messages

3) Result

 

Interactive Work flow

The interactive workflow is designed to allow several adjustments to be made on a preview model before the final reconstruction, 
Which can eliminate the need for post-production model edits and optimize the use of memory.
* Notice that we've added a block in the middle where a 3D UI is presented for interactive editing of a preview model.

--> Preview Model

 

 

 

*** USD && USDZ : Pixar's 3D format

https://graphics.pixar.com/usd/docs/Introduction-to-USD.html

USD Documentation : Introduction to USD

https://developer.apple.com/videos/play/wwdc2021/10077

Create 3D workflows with USD - WWDC 2021 - Videos - Apple Developer