Apple also introduced Measure, an app that will focus on AR measurements. Measure will auto-detect dimensions of objects and is also capable of displaying dimensions for objects in 3D space.

New sensors being researched for a future Apple Pencil could allow users to use the device to trace both 2D and 3D objects, and send the data back to a connected iPad or Mac.

Visual coherence More robust 3D object detection People occlusion Video recording in AR Quick Look Apple Pay in AR Quick Look Multiple-face tracking Collaborative session Audio support in AR Quick ...

Boston Dynamics designed the robot’s vision system to handle these challenges through a combination of 2D and 3D awareness, object pose tracking, and tight calibration between what it sees and does.