3-D Augmented Reality — Microsoft HoloLens

Real-time 3-D Augmented Reality demonstrated at AWE USA 2017, Booth #543 CurvSurf.

This video is taken by Microsoft HoloLens and CurvSurf FindSurface, and edited in 3 cuts:

Cut #1: Finding and measuring sphere, cylinder, and plane in vertex points of spatial mapping with HoloLens.
— HoloLens provides spatial mapping and motion tracking information.
— CurvSurf FindSurface detects, recognizes, and measures the object size, position, and orientation from 3-D point cloud.
https://developers.curvsurf.com/docu.jsp

With the geometric information of real objects, we can make the following simple 3-D AR examples as in Cut #2 & #3.

Cut #2:
— Virtual flying ball around real gym ball with occlusion
— Virtual drawing on real doll house
— Virtual tiling on real floor.

Cut #3: Virtual rotating poster on real column.

We differentiate 3-D AR from current 2-D AR:
— 2-D AR: based on image processing and plane detection
— 3-D AR: based on 3-D object measurement of surface shape, size, position, and orientation of real objects.

Microsoft HoloLens, CurvSurf FindSurface, DirectX.
HoloLens provides FindSurface with point cloud & device motion.
FindSurface determines the position & size of gym ball.
For each video frame, the virtual sphere (of the gym ball) is rendered transparently i.e. in black with z-buffering & back-face culling.

Augmented reality, occlusion, least squares, orthogonal distance fitting, object tracking, object detection, object recognition, point cloud, plane, box, cuboid, sphere, cylinder, cone, torus, Microsoft Kinect, Google Tango, Intel RealSense, Microsoft HoloLens, LNCS 3151

Смотреть в источнике