Converting Depth Map Pixel Values to Real-World Units (Meters)

[Moeez-Muslim]

Thank you for making this great repository available! I’m using the ViT model, and I’m trying to convert the generated depth map pixel values into real-world units (like meters). I have a specific dataset that I would like to fine-tune the model on, and I’m particularly interested in calculating the distance of some already identified objects in the dataset images.

For reference, I have the ground truth distance of these objects from the camera in meters, and I would like to understand the process of converting the depth values produced by the model to match these real-world distances.

Could you please help clarify:

1. How can I convert the pixel values from the depth map to real distances (e.g., meters)?

2. Is there any scaling factor or specific transformation required to go from pixel values to actual physical units?

3. If not directly possible, could you suggest an approach or workaround to achieve this?

Any pointers or resources would be greatly appreciated! Thanks in advance for your help.