Skip to content

cvg/hololens_ros

Repository files navigation

HoloLens2 Interface to ROS

[arxiv] [youtube]

IMAGE ALT TEXT HERE

A modified App based on based on HoloLens2ForCV and UnityRoboticsHub.

Note:

  • The reconstructed point cloud still has the offset problem as is described here for object beyond 1m.
  • To visualize the depth image, you need a grayscale shader applied to your preview plane. Example: grayscale shader.
  • For point cloud, current implementation only returns the reconstructed point cloud as a float array (in the format of x,y,z,x,y,z,...). If you want to visualize it, I find this project is a good example.
  • This project is mainly to show how to use Reseach Mode in Unity. I only provided implementation on AHAT camera image visualization and point cloud reconstruction (based on depth map of AHAT camera), two front spatial camera. The long-throw depth sensor and IMU sensor are also available thanks to @HoloAdventure. Feel free to modify the code according to your own need.
  • Only one of the short-throw(AHAT) and long-throw depth sensor should be enabled at the same time.
  • If you need a sample project to get started, you can refer to UnitySample folder.