Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Not able to get data from /camera/imu, It stays blank, checked with mutiple threads but nothing solved #3145

Open
ShreyasK-alt opened this issue Jun 28, 2024 · 24 comments
Labels

Comments

@ShreyasK-alt
Copy link

Required Info
Camera Model D435i
Firmware Version 5.16.0.1
Operating System & Version Linux (Ubuntu 20) }
Kernel Version (Linux Only) 5.15.0-113-generic
Platform PC
Librealsense SDK Version 2.50.0
ROS Distro noetic
RealSense ROS Wrapper Version RealSense ROS v2.3.2

I have installed librealsense after removing previously built realsense package(dpkg -l | grep "realsense" | cut -d " " -f 3 | xargs sudo dpkg --purge), then installed by using apt package method(https://github.com/IntelRealSense/librealsense/blob/master/doc/distribution_linux.md).

then excuted this command:
roslaunch realsense2_camera rs_camera.launch

and in another terminal checked with rostopic echo /camera/imu as it was listed in the rostopic list.

When checked previous issues, Tried these fixes nothing worked:

  1. using gyro and accel enabled(roslaunch realsense2_camera rs_camera.launch enable_accel:=true enable_gyro:=true)
    this list imu topic but nothing streams in imu topic

  2. changing unite imu method to linear_interpolation method(roslaunch realsense2_camera rs_camera.launch enable_accel:=true enable_gyro:=true unite_imu_method:=linear_interpolation), Still nothing streams in the imu topic

  3. changing unite imu method to copy(roslaunch realsense2_camera rs_camera.launch enable_accel:=true enable_gyro:=true unite_imu_method:=copy), still nothing streams in the imu topic

AS the terminal output is same for three of the method will be attaching it only once:

Checking log directory for disk usage. This may take a while.
Press Ctrl-C to interrupt
Done checking log file disk usage. Usage is <1GB.

started roslaunch server http://192.168.1.24:37401/

SUMMARY
========

PARAMETERS
 * /camera/realsense2_camera/accel_fps: 250
 * /camera/realsense2_camera/accel_frame_id: camera_accel_frame
 * /camera/realsense2_camera/accel_optical_frame_id: camera_accel_opti...
 * /camera/realsense2_camera/align_depth: True
 * /camera/realsense2_camera/aligned_depth_to_color_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/aligned_depth_to_fisheye1_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/aligned_depth_to_fisheye2_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/aligned_depth_to_fisheye_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/aligned_depth_to_infra1_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/aligned_depth_to_infra2_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/allow_no_texture_points: False
 * /camera/realsense2_camera/base_frame_id: camera_link
 * /camera/realsense2_camera/calib_odom_file: 
 * /camera/realsense2_camera/clip_distance: -2.0
 * /camera/realsense2_camera/color_fps: 30
 * /camera/realsense2_camera/color_frame_id: camera_color_frame
 * /camera/realsense2_camera/color_height: 480
 * /camera/realsense2_camera/color_optical_frame_id: camera_color_opti...
 * /camera/realsense2_camera/color_width: 640
 * /camera/realsense2_camera/confidence_fps: -1
 * /camera/realsense2_camera/confidence_height: -1
 * /camera/realsense2_camera/confidence_width: -1
 * /camera/realsense2_camera/depth_fps: 30
 * /camera/realsense2_camera/depth_frame_id: camera_depth_frame
 * /camera/realsense2_camera/depth_height: 480
 * /camera/realsense2_camera/depth_optical_frame_id: camera_depth_opti...
 * /camera/realsense2_camera/depth_width: 640
 * /camera/realsense2_camera/device_type: 
 * /camera/realsense2_camera/enable_accel: True
 * /camera/realsense2_camera/enable_color: True
 * /camera/realsense2_camera/enable_confidence: True
 * /camera/realsense2_camera/enable_depth: True
 * /camera/realsense2_camera/enable_fisheye1: False
 * /camera/realsense2_camera/enable_fisheye2: False
 * /camera/realsense2_camera/enable_fisheye: False
 * /camera/realsense2_camera/enable_gyro: True
 * /camera/realsense2_camera/enable_infra1: True
 * /camera/realsense2_camera/enable_infra2: True
 * /camera/realsense2_camera/enable_infra: True
 * /camera/realsense2_camera/enable_pointcloud: False
 * /camera/realsense2_camera/enable_pose: False
 * /camera/realsense2_camera/enable_sync: True
 * /camera/realsense2_camera/filters: 
 * /camera/realsense2_camera/fisheye1_frame_id: camera_fisheye1_f...
 * /camera/realsense2_camera/fisheye1_optical_frame_id: camera_fisheye1_o...
 * /camera/realsense2_camera/fisheye2_frame_id: camera_fisheye2_f...
 * /camera/realsense2_camera/fisheye2_optical_frame_id: camera_fisheye2_o...
 * /camera/realsense2_camera/fisheye_fps: -1
 * /camera/realsense2_camera/fisheye_frame_id: camera_fisheye_frame
 * /camera/realsense2_camera/fisheye_height: -1
 * /camera/realsense2_camera/fisheye_optical_frame_id: camera_fisheye_op...
 * /camera/realsense2_camera/fisheye_width: -1
 * /camera/realsense2_camera/gyro_fps: 200
 * /camera/realsense2_camera/gyro_frame_id: camera_gyro_frame
 * /camera/realsense2_camera/gyro_optical_frame_id: camera_gyro_optic...
 * /camera/realsense2_camera/imu_optical_frame_id: camera_imu_optica...
 * /camera/realsense2_camera/infra1_frame_id: camera_infra1_frame
 * /camera/realsense2_camera/infra1_optical_frame_id: camera_infra1_opt...
 * /camera/realsense2_camera/infra2_frame_id: camera_infra2_frame
 * /camera/realsense2_camera/infra2_optical_frame_id: camera_infra2_opt...
 * /camera/realsense2_camera/infra_fps: 30
 * /camera/realsense2_camera/infra_height: 480
 * /camera/realsense2_camera/infra_rgb: False
 * /camera/realsense2_camera/infra_width: 640
 * /camera/realsense2_camera/initial_reset: False
 * /camera/realsense2_camera/json_file_path: 
 * /camera/realsense2_camera/linear_accel_cov: 0.01
 * /camera/realsense2_camera/odom_frame_id: camera_odom_frame
 * /camera/realsense2_camera/ordered_pc: False
 * /camera/realsense2_camera/pointcloud_texture_index: 0
 * /camera/realsense2_camera/pointcloud_texture_stream: RS2_STREAM_COLOR
 * /camera/realsense2_camera/pose_frame_id: camera_pose_frame
 * /camera/realsense2_camera/pose_optical_frame_id: camera_pose_optic...
 * /camera/realsense2_camera/publish_odom_tf: True
 * /camera/realsense2_camera/publish_tf: True
 * /camera/realsense2_camera/reconnect_timeout: 6.0
 * /camera/realsense2_camera/rosbag_filename: 
 * /camera/realsense2_camera/serial_no: 
 * /camera/realsense2_camera/stereo_module/exposure/1: 7500
 * /camera/realsense2_camera/stereo_module/exposure/2: 1
 * /camera/realsense2_camera/stereo_module/gain/1: 16
 * /camera/realsense2_camera/stereo_module/gain/2: 16
 * /camera/realsense2_camera/tf_publish_rate: 0.0
 * /camera/realsense2_camera/topic_odom_in: odom_in
 * /camera/realsense2_camera/unite_imu_method: copy
 * /camera/realsense2_camera/usb_port_id: 
 * /camera/realsense2_camera/wait_for_device_timeout: -1.0
 * /camera/stereo_module/emitter_enabled: 0
 * /rosdistro: noetic
 * /rosversion: 1.16.0

NODES
  /camera/
    realsense2_camera (nodelet/nodelet)
    realsense2_camera_manager (nodelet/nodelet)

ROS_MASTER_URI=http://192.168.1.24:11311

process[camera/realsense2_camera_manager-1]: started with pid [16119]
process[camera/realsense2_camera-2]: started with pid [16120]
[ INFO] [1719576207.990036630]: Initializing nodelet with 16 worker threads.
[ INFO] [1719576208.058590825]: RealSense ROS v2.3.2
[ INFO] [1719576208.058610116]: Built with LibRealSense v2.50.0
[ INFO] [1719576208.058617422]: Running with LibRealSense v2.50.0
[ INFO] [1719576208.083452786]:  
[ INFO] [1719576208.344128095]: Device with serial number 243522070607 was found.

[ INFO] [1719576208.344174060]: Device with physical ID 4-4-2 was found.
[ INFO] [1719576208.344202773]: Device with name Intel RealSense D435I was found.
[ INFO] [1719576208.344633781]: Device with port number 4-4 was found.
[ INFO] [1719576208.344657598]: Device USB type: 3.2
[ INFO] [1719576208.346673404]: getParameters...
[ INFO] [1719576208.369105945]: setupDevice...
[ INFO] [1719576208.369126804]: JSON file is not provided
[ INFO] [1719576208.369139956]: ROS Node Namespace: camera
[ INFO] [1719576208.369154429]: Device Name: Intel RealSense D435I
[ INFO] [1719576208.369172548]: Device Serial No: 243522070607
[ INFO] [1719576208.369184612]: Device physical port: 4-4-2
[ INFO] [1719576208.369196311]: Device FW version: 05.16.00.01
[ INFO] [1719576208.369207987]: Device Product ID: 0x0B3A
[ INFO] [1719576208.369219168]: Enable PointCloud: Off
[ INFO] [1719576208.369231069]: Align Depth: On
[ INFO] [1719576208.369244159]: Sync Mode: On
[ INFO] [1719576208.369285136]: Device Sensors: 
[ INFO] [1719576208.470141159]: Stereo Module was found.
[ INFO] [1719576208.479901699]: RGB Camera was found.
[ INFO] [1719576208.479993559]: Motion Module was found.
[ INFO] [1719576208.480011517]: (Infrared, 0) sensor isn't supported by current device! -- Skipping...
[ INFO] [1719576208.480020612]: (Confidence, 0) sensor isn't supported by current device! -- Skipping...
[ INFO] [1719576208.480208088]: num_filters: 1
[ INFO] [1719576208.480217895]: Setting Dynamic reconfig parameters.
hwmon command 0x80( 5 0 0 0 ) failed (response -7= HW not ready)
hwmon command 0x80( 5 0 0 0 ) failed (response -7= HW not ready)
hwmon command 0x80( 5 0 0 0 ) failed (response -7= HW not ready)
hwmon command 0x80( 5 0 0 0 ) failed (response -7= HW not ready)
[ INFO] [1719576212.003982848]: Done Setting Dynamic reconfig parameters.
[ INFO] [1719576212.004363076]: depth stream is enabled - width: 640, height: 480, fps: 30, Format: Z16
[ INFO] [1719576212.004512309]: infra1 stream is enabled - width: 640, height: 480, fps: 30, Format: Y8
[ INFO] [1719576212.004667287]: infra2 stream is enabled - width: 640, height: 480, fps: 30, Format: Y8
[ INFO] [1719576212.004969491]: color stream is enabled - width: 640, height: 480, fps: 30, Format: RGB8
[ INFO] [1719576212.006213071]: gyro stream is enabled - fps: 200
[ WARN] [1719576212.006228204]: No mathcing profile found for accel with fps=250
[ WARN] [1719576212.006236223]: Using default profile instead.
[ INFO] [1719576212.006243095]: accel stream is enabled - fps: 100
[ INFO] [1719576212.006254779]: setupPublishers...
[ INFO] [1719576212.007499328]: Expected frequency for depth = 30.00000
[ INFO] [1719576212.029864446]: Expected frequency for infra1 = 30.00000
[ INFO] [1719576212.044352995]: Expected frequency for infra2 = 30.00000
[ INFO] [1719576212.057273528]: Expected frequency for color = 30.00000
[ INFO] [1719576212.073444145]: Expected frequency for aligned_depth_to_color = 30.00000
[ INFO] [1719576212.082898614]: Start publisher IMU
[ INFO] [1719576212.083982925]: setupStreams...
 28/06 17:33:32,352 WARNING [140369773508352] (ds5-motion.cpp:473) IMU Calibration is not available, default intrinsic and extrinsic will be used.
 28/06 17:33:32,789 WARNING [140369748330240] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Success, number: 0
[ INFO] [1719576212.840518771]: SELECTED BASE:Depth, 0
[ INFO] [1719576212.852262687]: RealSense Node Is Up!
[ WARN] [1719576212.912595928]: 
 28/06 17:33:32,913 WARNING [140369748330240] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Success, number: 0
 28/06 17:33:32,964 WARNING [140369748330240] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Success, number: 0
 28/06 17:33:33,015 WARNING [140369748330240] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Success, number: 0
 28/06 17:33:33,067 WARNING [140369748330240] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Success, number: 0
 28/06 17:33:33,191 WARNING [140369748330240] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Success, number: 0
 28/06 17:33:33,242 WARNING [140369748330240] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Success, number: 0
 28/06 17:33:33,395 WARNING [140369748330240] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Success, number: 0

Tried mutiple methods nothing worked hence came out to create an issue.

When tried with realsense-viewer, I was able to check data of imu.

Screenshot from 2024-06-28 17-46-13

One thing i observed is if i close realsense-viewer and run roslaunch, I wont able to switch on imu , U can hcek below attached screenshot.
Screenshot from 2024-06-28 17-49-02

So, Can you please help through this on what to do about it?

@MartyG-RealSense
Copy link
Collaborator

Hi @ShreyasK-alt The recommended camera firmware driver version for ROS1 wrapper 2.3.2 and librealsense 2.50.0 is the old 5.13.0.50 version rather than the current latest 5.16.0.1.

I can appreciate though that downgrading to 5.13.0.50 would be problematic if you also need to use the latest 2.55.1 Viewer which requires firmware 5.16.0.1.

unite_imu_method is the paramater which combines the separate gyro and accel topics into a single /imu topic.

If the warning control_transfer returned is generating continuously in a log then it can indicate that there is a communication problem between the camera and the the computer / computing device, such as an issue with the USB port or the USB cable. Are you using the official 1 meter USB cable supplied with the camera or another cable of your own choice, please?


Does it make a difference if you perform an RGBD launch instead of using rs_camera.launch?

  1. Install support for an RGBD launch with the command below.

sudo apt-get install ros-noetic-rgbd-launch

  1. Do an RGBD launch. align_depth is enabled by default in this launch file.

roslaunch realsense2_camera rs_rgbd.launch enable_infra1:=true enable_infra2:=true enable_accel:=true enable_gyro:=true unite_imu_method:=linear_interpolation

@ShreyasK-alt
Copy link
Author

ShreyasK-alt commented Jun 28, 2024

  1. I am using the default cable provided by Intel.
  2. Will check with RGBD launch file.
  3. Can u please help me with commands on how uninstall realsense, realsense-ros wrapper completely and u can add a perfect tag and heading in bold so it would be very much helpful for lots people out there!!

So the uninstallation process is gonna help me too in order to reinstall under your guidance.

And will help with setting up IMU on realsense, as most of the resources out there suggests inferring imu data for ros application from other sources but none of the guides help out in setting up Realsense camera with imu from camera.

@MartyG-RealSense
Copy link
Collaborator

If installation was done from packages then all packages with 'realsense' in their name can be removed with a single command:

dpkg -l | grep "realsense" | cut -d " " -f 3 | xargs sudo dpkg --purge

If the ROS wrapper was built from source code then it can be removed simply by deleting the entire catkin workspace folder. In the ROS1 wrapper this folder is called catkin_ws/src

If librealsense was built from a source code folder with CMake then it can be uninstalled by going to the 'Build' directory of that folder and running the CMake build command below:

sudo make uninstall && make clean

In regard to accessing the RealSense IMU from ROS1, the guide at the link below is worth reading, although it is very old now.

https://github.com/IntelRealSense/realsense-ros/wiki/SLAM-with-D435i

@ShreyasK-alt
Copy link
Author

OK Sir will try out and will update you by tomorrow.
Thank you so much for your faster response and patience

@ShreyasK-alt
Copy link
Author

As discussed earlier needed help with regards to installing the correct version of realsense, realsense-ros. So that things gonna work fine!

@MartyG-RealSense
Copy link
Collaborator

Is your problem now solved, please? Thanks!

@ShreyasK-alt
Copy link
Author

I have completely removed realsense package and freshly installed it.
When tried this particular command: roslaunch realsense2_camera rs_rgbd.launch enable_infra1:=true enable_infra2:=true enable_accel:=true enable_gyro:=true unite_imu_method:=linear_interpolation

It give this output:

Checking log directory for disk usage. This may take a while.
Press Ctrl-C to interrupt
Done checking log file disk usage. Usage is <1GB.

started roslaunch server http://192.168.1.24:33433/

SUMMARY
========

PARAMETERS
 * /camera/color_rectify_color/queue_size: 5
 * /camera/realsense2_camera/accel_fps: -1
 * /camera/realsense2_camera/accel_frame_id: camera_accel_frame
 * /camera/realsense2_camera/accel_optical_frame_id: camera_accel_opti...
 * /camera/realsense2_camera/align_depth: True
 * /camera/realsense2_camera/aligned_depth_to_color_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/aligned_depth_to_fisheye1_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/aligned_depth_to_fisheye2_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/aligned_depth_to_fisheye_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/aligned_depth_to_infra1_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/aligned_depth_to_infra2_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/allow_no_texture_points: False
 * /camera/realsense2_camera/base_frame_id: camera_link
 * /camera/realsense2_camera/calib_odom_file: 
 * /camera/realsense2_camera/clip_distance: -1.0
 * /camera/realsense2_camera/color_fps: -1
 * /camera/realsense2_camera/color_frame_id: camera_color_frame
 * /camera/realsense2_camera/color_height: -1
 * /camera/realsense2_camera/color_optical_frame_id: camera_color_opti...
 * /camera/realsense2_camera/color_width: -1
 * /camera/realsense2_camera/confidence_fps: 30
 * /camera/realsense2_camera/confidence_height: 480
 * /camera/realsense2_camera/confidence_width: 640
 * /camera/realsense2_camera/depth_fps: -1
 * /camera/realsense2_camera/depth_frame_id: camera_depth_frame
 * /camera/realsense2_camera/depth_height: -1
 * /camera/realsense2_camera/depth_optical_frame_id: camera_depth_opti...
 * /camera/realsense2_camera/depth_width: -1
 * /camera/realsense2_camera/device_type: 
 * /camera/realsense2_camera/enable_accel: True
 * /camera/realsense2_camera/enable_color: True
 * /camera/realsense2_camera/enable_confidence: True
 * /camera/realsense2_camera/enable_depth: True
 * /camera/realsense2_camera/enable_fisheye1: False
 * /camera/realsense2_camera/enable_fisheye2: False
 * /camera/realsense2_camera/enable_fisheye: False
 * /camera/realsense2_camera/enable_gyro: True
 * /camera/realsense2_camera/enable_infra1: True
 * /camera/realsense2_camera/enable_infra2: True
 * /camera/realsense2_camera/enable_infra: False
 * /camera/realsense2_camera/enable_pointcloud: False
 * /camera/realsense2_camera/enable_pose: False
 * /camera/realsense2_camera/enable_sync: True
 * /camera/realsense2_camera/filters: 
 * /camera/realsense2_camera/fisheye1_frame_id: camera_fisheye1_f...
 * /camera/realsense2_camera/fisheye1_optical_frame_id: camera_fisheye1_o...
 * /camera/realsense2_camera/fisheye2_frame_id: camera_fisheye2_f...
 * /camera/realsense2_camera/fisheye2_optical_frame_id: camera_fisheye2_o...
 * /camera/realsense2_camera/fisheye_fps: -1
 * /camera/realsense2_camera/fisheye_frame_id: camera_fisheye_frame
 * /camera/realsense2_camera/fisheye_height: -1
 * /camera/realsense2_camera/fisheye_optical_frame_id: camera_fisheye_op...
 * /camera/realsense2_camera/fisheye_width: -1
 * /camera/realsense2_camera/gyro_fps: -1
 * /camera/realsense2_camera/gyro_frame_id: camera_gyro_frame
 * /camera/realsense2_camera/gyro_optical_frame_id: camera_gyro_optic...
 * /camera/realsense2_camera/imu_optical_frame_id: camera_imu_optica...
 * /camera/realsense2_camera/infra1_frame_id: camera_infra1_frame
 * /camera/realsense2_camera/infra1_optical_frame_id: camera_infra1_opt...
 * /camera/realsense2_camera/infra2_frame_id: camera_infra2_frame
 * /camera/realsense2_camera/infra2_optical_frame_id: camera_infra2_opt...
 * /camera/realsense2_camera/infra_fps: -1
 * /camera/realsense2_camera/infra_height: -1
 * /camera/realsense2_camera/infra_rgb: False
 * /camera/realsense2_camera/infra_width: -1
 * /camera/realsense2_camera/initial_reset: False
 * /camera/realsense2_camera/json_file_path: 
 * /camera/realsense2_camera/linear_accel_cov: 0.01
 * /camera/realsense2_camera/odom_frame_id: camera_odom_frame
 * /camera/realsense2_camera/ordered_pc: False
 * /camera/realsense2_camera/pointcloud_texture_index: 0
 * /camera/realsense2_camera/pointcloud_texture_stream: RS2_STREAM_COLOR
 * /camera/realsense2_camera/pose_frame_id: camera_pose_frame
 * /camera/realsense2_camera/pose_optical_frame_id: camera_pose_optic...
 * /camera/realsense2_camera/publish_odom_tf: True
 * /camera/realsense2_camera/publish_tf: True
 * /camera/realsense2_camera/reconnect_timeout: 6.0
 * /camera/realsense2_camera/rosbag_filename: 
 * /camera/realsense2_camera/serial_no: 
 * /camera/realsense2_camera/stereo_module/exposure/1: 7500
 * /camera/realsense2_camera/stereo_module/exposure/2: 1
 * /camera/realsense2_camera/stereo_module/gain/1: 16
 * /camera/realsense2_camera/stereo_module/gain/2: 16
 * /camera/realsense2_camera/tf_publish_rate: 0.0
 * /camera/realsense2_camera/topic_odom_in: camera/odom_in
 * /camera/realsense2_camera/unite_imu_method: none
 * /camera/realsense2_camera/usb_port_id: 
 * /camera/realsense2_camera/wait_for_device_timeout: -1.0
 * /rosdistro: noetic
 * /rosversion: 1.16.0

NODES
  /camera/
    color_rectify_color (nodelet/nodelet)
    points_xyzrgb_hw_registered (nodelet/nodelet)
    realsense2_camera (nodelet/nodelet)
    realsense2_camera_manager (nodelet/nodelet)

auto-starting new master
process[master]: started with pid [19684]
ROS_MASTER_URI=http://192.168.1.24:11311

setting /run_id to 9a8c8cbe-35e9-11ef-a8c1-21d4cf83e855
process[rosout-1]: started with pid [19694]
started core service [/rosout]
process[camera/realsense2_camera_manager-2]: started with pid [19701]
process[camera/realsense2_camera-3]: started with pid [19702]
process[camera/color_rectify_color-4]: started with pid [19703]
process[camera/points_xyzrgb_hw_registered-5]: started with pid [19704]
[ INFO] [1719646291.301209354]: Initializing nodelet with 16 worker threads.
[ INFO] [1719646291.379894773]: RealSense ROS v2.3.2
[ INFO] [1719646291.379911624]: Built with LibRealSense v2.50.0
[ INFO] [1719646291.379918491]: Running with LibRealSense v2.50.0
[ INFO] [1719646291.410387421]:  
[ INFO] [1719646291.701848538]: Device with serial number 243522070607 was found.

[ INFO] [1719646291.701916819]: Device with physical ID 4-8-4 was found.
[ INFO] [1719646291.701944503]: Device with name Intel RealSense D435I was found.
[ INFO] [1719646291.703680371]: Device with port number 4-8 was found.
[ INFO] [1719646291.703739139]: Device USB type: 3.2
[ INFO] [1719646291.704934572]: getParameters...
[ INFO] [1719646291.725777334]: setupDevice...
[ INFO] [1719646291.725801953]: JSON file is not provided
[ INFO] [1719646291.725816698]: ROS Node Namespace: camera
[ INFO] [1719646291.725841899]: Device Name: Intel RealSense D435I
[ INFO] [1719646291.725864055]: Device Serial No: 243522070607
[ INFO] [1719646291.725882743]: Device physical port: 4-8-4
[ INFO] [1719646291.725910547]: Device FW version: 05.16.00.01
[ INFO] [1719646291.725932279]: Device Product ID: 0x0B3A
[ INFO] [1719646291.725947390]: Enable PointCloud: Off
[ INFO] [1719646291.725964166]: Align Depth: On
[ INFO] [1719646291.725982645]: Sync Mode: On
[ INFO] [1719646291.726124074]: Device Sensors: 
[ INFO] [1719646291.819097009]: Stereo Module was found.
[ INFO] [1719646291.828303299]: RGB Camera was found.
[ INFO] [1719646291.828409052]: Motion Module was found.
[ INFO] [1719646291.828450787]: (Confidence, 0) sensor isn't supported by current device! -- Skipping...
[ INFO] [1719646291.828697377]: num_filters: 1
[ INFO] [1719646291.828717196]: Setting Dynamic reconfig parameters.
hwmon command 0x80( 5 0 0 0 ) failed (response -7= HW not ready)
hwmon command 0x80( 5 0 0 0 ) failed (response -7= HW not ready)
hwmon command 0x80( 5 0 0 0 ) failed (response -7= HW not ready)
hwmon command 0x80( 5 0 0 0 ) failed (response -7= HW not ready)
[ INFO] [1719646295.287764829]: Done Setting Dynamic reconfig parameters.
[ INFO] [1719646295.288223006]: depth stream is enabled - width: 848, height: 480, fps: 30, Format: Z16
[ INFO] [1719646295.289477033]: color stream is enabled - width: 1280, height: 720, fps: 30, Format: RGB8
[ INFO] [1719646295.290814116]: gyro stream is enabled - fps: 200
[ INFO] [1719646295.290847649]: accel stream is enabled - fps: 100
[ INFO] [1719646295.290879653]: setupPublishers...
[ INFO] [1719646295.292717253]: Expected frequency for depth = 30.00000
[ INFO] [1719646295.309672764]: Expected frequency for color = 30.00000
[ INFO] [1719646295.321090439]: Expected frequency for aligned_depth_to_color = 30.00000
[ INFO] [1719646295.333476708]: setupStreams...
 29/06 13:01:35,504 WARNING [139741146420992] (ds5-motion.cpp:473) IMU Calibration is not available, default intrinsic and extrinsic will be used.
 29/06 13:01:38,851 WARNING [139740913104640] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Success, number: 0
[ INFO] [1719646298.904110728]: SELECTED BASE:Depth, 0
[ INFO] [1719646298.938917219]: RealSense Node Is Up!
 29/06 13:01:39,048 WARNING [139740913104640] (messenger-libusb.cpp:42) control_transfer returned error, index: 300, error: Success, number: 0

and when checked with the rostopic list:

/camera/accel/imu_info
/camera/accel/metadata
/camera/accel/sample
/camera/align_to_color/parameter_descriptions
/camera/align_to_color/parameter_updates
/camera/aligned_depth_to_color/camera_info
/camera/aligned_depth_to_color/image_raw
/camera/aligned_depth_to_color/image_raw/compressed
/camera/aligned_depth_to_color/image_raw/compressed/parameter_descriptions
/camera/aligned_depth_to_color/image_raw/compressed/parameter_updates
/camera/aligned_depth_to_color/image_raw/compressedDepth
/camera/aligned_depth_to_color/image_raw/compressedDepth/parameter_descriptions
/camera/aligned_depth_to_color/image_raw/compressedDepth/parameter_updates
/camera/aligned_depth_to_color/image_raw/theora
/camera/aligned_depth_to_color/image_raw/theora/parameter_descriptions
/camera/aligned_depth_to_color/image_raw/theora/parameter_updates
/camera/color/camera_info
/camera/color/image_raw
/camera/color/image_raw/compressed
/camera/color/image_raw/compressed/parameter_descriptions
/camera/color/image_raw/compressed/parameter_updates
/camera/color/image_raw/compressedDepth
/camera/color/image_raw/compressedDepth/parameter_descriptions
/camera/color/image_raw/compressedDepth/parameter_updates
/camera/color/image_raw/theora
/camera/color/image_raw/theora/parameter_descriptions
/camera/color/image_raw/theora/parameter_updates
/camera/color/image_rect_color
/camera/color/image_rect_color/compressed
/camera/color/image_rect_color/compressed/parameter_descriptions
/camera/color/image_rect_color/compressed/parameter_updates
/camera/color/image_rect_color/compressedDepth
/camera/color/image_rect_color/compressedDepth/parameter_descriptions
/camera/color/image_rect_color/compressedDepth/parameter_updates
/camera/color/image_rect_color/theora
/camera/color/image_rect_color/theora/parameter_descriptions
/camera/color/image_rect_color/theora/parameter_updates
/camera/color/metadata
/camera/color_rectify_color/parameter_descriptions
/camera/color_rectify_color/parameter_updates
/camera/depth/camera_info
/camera/depth/image_rect_raw
/camera/depth/image_rect_raw/compressed
/camera/depth/image_rect_raw/compressed/parameter_descriptions
/camera/depth/image_rect_raw/compressed/parameter_updates
/camera/depth/image_rect_raw/compressedDepth
/camera/depth/image_rect_raw/compressedDepth/parameter_descriptions
/camera/depth/image_rect_raw/compressedDepth/parameter_updates
/camera/depth/image_rect_raw/theora
/camera/depth/image_rect_raw/theora/parameter_descriptions
/camera/depth/image_rect_raw/theora/parameter_updates
/camera/depth/metadata
/camera/depth_registered/points
/camera/extrinsics/depth_to_color
/camera/gyro/imu_info
/camera/gyro/metadata
/camera/gyro/sample
/camera/motion_module/parameter_descriptions
/camera/motion_module/parameter_updates
/camera/realsense2_camera_manager/bond
/camera/rgb_camera/auto_exposure_roi/parameter_descriptions
/camera/rgb_camera/auto_exposure_roi/parameter_updates
/camera/rgb_camera/parameter_descriptions
/camera/rgb_camera/parameter_updates
/camera/stereo_module/auto_exposure_roi/parameter_descriptions
/camera/stereo_module/auto_exposure_roi/parameter_updates
/camera/stereo_module/parameter_descriptions
/camera/stereo_module/parameter_updates
/diagnostics
/rosout
/rosout_agg
/tf
/tf_static

There is no imu topic now.

And when checked with rostopic echo /camera/accel/sample , rostopic echo /camera/accel/metadata, rostopic echo /camera/gyro/sample, rostopic echo /camera/gyro/metadata These give a blank output.

When these commands are executed : rostopic echo /camera/accel/imu_info, rostopic echo /camera/gyro/imu_info,
It gives out this output:

frame_id: "camera_gyro_optical_frame"
data: [1.0, 0.0, 0.0, 0.0, 0.0, 1.0, 0.0, 0.0, 0.0, 0.0, 1.0, 0.0]
noise_variances: [0.0, 0.0, 0.0]
bias_variances: [0.0, 0.0, 0.0]
---

Even Tried with copy method unite_imu_method:=copy, This too doesn't publish the imu topic, and neither of gyro and accel topic are published.

In order to verify if things are in place, Tried these commands: rostopic echo /camera/color/image_rect_color/compressed, rostopic echo /camera/color/image_raw Both gave out outputs showing that all other things are working but imu isn't.

So Can you please check this and help me on what to do?

@MartyG-RealSense
Copy link
Collaborator

A RealSense ROS user at #2892 (comment) also had problems with the IMU topics when using rs_rgbd.launch. They said that IMU worked if they set align_depth:=false or initial_reset:=true in their launch instruction.

@ShreyasK-alt
Copy link
Author

I tried the same but still its not working, no imu topic at all, neither accel and gyro topic is working.
One thing u obsereve here with infra enabled there isnt any infra topic listed in rostopic list.
So what can be done with regard to this?

@ShreyasK-alt
Copy link
Author

as soon as i close roslaunch and everything related to ros and if i open realsense-viewer and switch on motion module.
This is what is looks like:
image

These were some of the errors shown:
image
image

@ShreyasK-alt
Copy link
Author

Should I flash older version of firmware?

Should I download 5.13.0.50 (https://www.intelrealsense.com/download/19295/), and flash the same?
So if I downgrade the firmware, then there might be need for downgrading realsense-viewer version. How to downgrade, what package and version needs to be installed in order to make it work right?

@MartyG-RealSense
Copy link
Collaborator

I would recommend first checking whether your camera hardware has a corrupted calibration table inside it by creating a new table in the Viewer using the procedure at IntelRealSense/librealsense#10182 (comment)


You can downgrade the firmware in the Viewer using the following procedure.

  1. Download the firmware for 5.13.0.50 to your computer as a .bin file from the list of firmware files at the link below.

https://dev.intelrealsense.com/docs/firmware-releases-d400#d400-series-firmware-downloads

  1. Launch rhe Viewer and go to the 'More' option near the top of the Viewer's options side-panel and select 'Update Firmware from its drop-down menu.

  2. A file selection box will pop up. Navigate to the location on the computer that you downloaded the .bin file for 5.13.0.50 to and select the file to automatically start the downgrade.


On Linux you would have to install the entire 2.50.0 or 2.51.1 version of the librealsense SDK to obtain the 2.50.0 or 2.51.1 version of the Viewer.

@ShreyasK-alt
Copy link
Author

ShreyasK-alt commented Jun 29, 2024

I tried above steps for resetting calibration table.
By the way, what does "Enabling depth stream" mean?
Whereas, tried the other steps in the calibration reset process, but the write option doesn't glow up to be clicked.

image

@MartyG-RealSense
Copy link
Collaborator

Enabling the depth stream just means enabling the Stereo Module in the.Viewer's options side-panel to start the depth stream.

The Stereo Module should be enabled first before opening the camera calibration window. Then the Write Table button will be usable.

@ShreyasK-alt
Copy link
Author

ShreyasK-alt commented Jun 29, 2024

First flashed firmware version: Version-5_13_0_50
Then completely removed the realsense package using this command:
dpkg -l | grep "realsense" | cut -d " " -f 3 | xargs sudo dpkg --purge

Later started installing librealsense version of 2.50.0 by using these commands:

  1. sudo apt-get install librealsense2=2.50.0-0~realsense0.6128 (I installed this because when tried to install librealsense2-dev it ended with error that:
    The following packages have unmet dependencies:
    librealsense2-dev : Depends: librealsense2 (= 2.50.0-0realsense0.6128) but 2.55.1-0realsense.12473 is to be installed)

  2. sudo apt-get install librealsense2-dev=2.50.0-0~realsense0.6128

  3. sudo apt-get install librealsense2-gl=2.50.0-0~realsense0.6128 (This because of the error: The following packages have unmet dependencies: librealsense2-utils : Depends: librealsense2-gl (= 2.50.0-0~realsense0.6128) but it is not going to be installed Depends: librealsense2-net (= 2.50.0-0~realsense0.6128) but it is not going to be installed E: Unable to correct problems, you have held broken packages. )

  4. sudo apt-get install librealsense2-net=2.50.0-0~realsense0.6128

  5. sudo apt-get install librealsense2-utils=2.50.0-0~realsense0.6128

  6. sudo apt-get install librealsense2-dbg=2.50.0-0~realsense0.6128

  7. sudo apt-get install librealsense2-dkms=1.3.18-0ubuntu1( Please confirm me that its the right version)

  8. sudo apt-get install ros-noetic-imu-filter-madgwick ros-noetic-rtabmap-ros ros-noetic-robot-localization

  9. sudo apt-get install ros-noetic-realsense2*

  10. 'sudo apt-get install ros-noetic-rgbd-launch'

Please check this and confirm if I have installed the right versions.

This is what it looks like after doing all these:
image
image

@MartyG-RealSense
Copy link
Collaborator

MartyG-RealSense commented Jun 29, 2024

It is only necessary to install librealsense2-dkms first and librealsense2-utils second. The dev and dbg packages are optional. But it is very important that the dkms package is installed first as the other packages may have components that depend on it

I am not certain about librealsense2-dkms=1.3.18-0ubuntu1 but the version number looks correct for the librealsense versions that were being released around the time of 2.50.0. Usually though you do not have to install this package with an apt command, as simply installing the librealsense2-dkms and librealsense2-utils packages is all that is required. The -utils package should install the gl graphics.

@ShreyasK-alt
Copy link
Author

Thank you so much for your patience, Can you please help with some of these final issues. Hope things will on track soon.

  1. What are those red errors out there on realsense viewer.
  2. Even errors were evident on the terminal too.
  3. When I roslaunch(roslaunch realsense2_camera rs_rgbd.launch enable_infra1:=true enable_infra2:=true enable_accel:=true enable_gyro:=true unite_imu_method:=linear_interpolation align_depth:=false)
    I am able to get accel and gyro metadata but no single imu topic.
  4. My laptop screen orientations changes automatically according to realsense camera orientation.
  5. You see there in roslaunch outputs some error or warning saying some harware error, whats that and how to fix the same?
  6. How to get a single imu topic like /camera/imu. (Tried copy method too but no camera/imu topic being listed)

These are outputs:

  1. Roslaunch:
SUMMARY
========

PARAMETERS
 * /camera/color_rectify_color/queue_size: 5
 * /camera/realsense2_camera/accel_fps: -1
 * /camera/realsense2_camera/accel_frame_id: camera_accel_frame
 * /camera/realsense2_camera/accel_optical_frame_id: camera_accel_opti...
 * /camera/realsense2_camera/align_depth: False
 * /camera/realsense2_camera/aligned_depth_to_color_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/aligned_depth_to_fisheye1_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/aligned_depth_to_fisheye2_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/aligned_depth_to_fisheye_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/aligned_depth_to_infra1_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/aligned_depth_to_infra2_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/allow_no_texture_points: False
 * /camera/realsense2_camera/base_frame_id: camera_link
 * /camera/realsense2_camera/calib_odom_file: 
 * /camera/realsense2_camera/clip_distance: -1.0
 * /camera/realsense2_camera/color_fps: -1
 * /camera/realsense2_camera/color_frame_id: camera_color_frame
 * /camera/realsense2_camera/color_height: -1
 * /camera/realsense2_camera/color_optical_frame_id: camera_color_opti...
 * /camera/realsense2_camera/color_width: -1
 * /camera/realsense2_camera/confidence_fps: 30
 * /camera/realsense2_camera/confidence_height: 480
 * /camera/realsense2_camera/confidence_width: 640
 * /camera/realsense2_camera/depth_fps: -1
 * /camera/realsense2_camera/depth_frame_id: camera_depth_frame
 * /camera/realsense2_camera/depth_height: -1
 * /camera/realsense2_camera/depth_optical_frame_id: camera_depth_opti...
 * /camera/realsense2_camera/depth_width: -1
 * /camera/realsense2_camera/device_type: 
 * /camera/realsense2_camera/enable_accel: True
 * /camera/realsense2_camera/enable_color: True
 * /camera/realsense2_camera/enable_confidence: True
 * /camera/realsense2_camera/enable_depth: True
 * /camera/realsense2_camera/enable_fisheye1: False
 * /camera/realsense2_camera/enable_fisheye2: False
 * /camera/realsense2_camera/enable_fisheye: False
 * /camera/realsense2_camera/enable_gyro: True
 * /camera/realsense2_camera/enable_infra1: True
 * /camera/realsense2_camera/enable_infra2: True
 * /camera/realsense2_camera/enable_infra: False
 * /camera/realsense2_camera/enable_pointcloud: False
 * /camera/realsense2_camera/enable_pose: False
 * /camera/realsense2_camera/enable_sync: True
 * /camera/realsense2_camera/filters: 
 * /camera/realsense2_camera/fisheye1_frame_id: camera_fisheye1_f...
 * /camera/realsense2_camera/fisheye1_optical_frame_id: camera_fisheye1_o...
 * /camera/realsense2_camera/fisheye2_frame_id: camera_fisheye2_f...
 * /camera/realsense2_camera/fisheye2_optical_frame_id: camera_fisheye2_o...
 * /camera/realsense2_camera/fisheye_fps: -1
 * /camera/realsense2_camera/fisheye_frame_id: camera_fisheye_frame
 * /camera/realsense2_camera/fisheye_height: -1
 * /camera/realsense2_camera/fisheye_optical_frame_id: camera_fisheye_op...
 * /camera/realsense2_camera/fisheye_width: -1
 * /camera/realsense2_camera/gyro_fps: -1
 * /camera/realsense2_camera/gyro_frame_id: camera_gyro_frame
 * /camera/realsense2_camera/gyro_optical_frame_id: camera_gyro_optic...
 * /camera/realsense2_camera/imu_optical_frame_id: camera_imu_optica...
 * /camera/realsense2_camera/infra1_frame_id: camera_infra1_frame
 * /camera/realsense2_camera/infra1_optical_frame_id: camera_infra1_opt...
 * /camera/realsense2_camera/infra2_frame_id: camera_infra2_frame
 * /camera/realsense2_camera/infra2_optical_frame_id: camera_infra2_opt...
 * /camera/realsense2_camera/infra_fps: -1
 * /camera/realsense2_camera/infra_height: -1
 * /camera/realsense2_camera/infra_rgb: False
 * /camera/realsense2_camera/infra_width: -1
 * /camera/realsense2_camera/initial_reset: False
 * /camera/realsense2_camera/json_file_path: 
 * /camera/realsense2_camera/linear_accel_cov: 0.01
 * /camera/realsense2_camera/odom_frame_id: camera_odom_frame
 * /camera/realsense2_camera/ordered_pc: False
 * /camera/realsense2_camera/pointcloud_texture_index: 0
 * /camera/realsense2_camera/pointcloud_texture_stream: RS2_STREAM_COLOR
 * /camera/realsense2_camera/pose_frame_id: camera_pose_frame
 * /camera/realsense2_camera/pose_optical_frame_id: camera_pose_optic...
 * /camera/realsense2_camera/publish_odom_tf: True
 * /camera/realsense2_camera/publish_tf: True
 * /camera/realsense2_camera/reconnect_timeout: 6.0
 * /camera/realsense2_camera/rosbag_filename: 
 * /camera/realsense2_camera/serial_no: 
 * /camera/realsense2_camera/stereo_module/exposure/1: 7500
 * /camera/realsense2_camera/stereo_module/exposure/2: 1
 * /camera/realsense2_camera/stereo_module/gain/1: 16
 * /camera/realsense2_camera/stereo_module/gain/2: 16
 * /camera/realsense2_camera/tf_publish_rate: 0.0
 * /camera/realsense2_camera/topic_odom_in: camera/odom_in
 * /camera/realsense2_camera/unite_imu_method: none
 * /camera/realsense2_camera/usb_port_id: 
 * /camera/realsense2_camera/wait_for_device_timeout: -1.0
 * /rosdistro: noetic
 * /rosversion: 1.16.0

NODES
  /camera/
    color_rectify_color (nodelet/nodelet)
    points_xyzrgb_sw_registered (nodelet/nodelet)
    realsense2_camera (nodelet/nodelet)
    realsense2_camera_manager (nodelet/nodelet)
    register_depth (nodelet/nodelet)

ROS_MASTER_URI=http://localhost:11311

process[camera/realsense2_camera_manager-1]: started with pid [10233]
process[camera/realsense2_camera-2]: started with pid [10234]
process[camera/color_rectify_color-3]: started with pid [10235]
process[camera/register_depth-4]: started with pid [10236]
process[camera/points_xyzrgb_sw_registered-5]: started with pid [10237]
[ INFO] [1719682970.492727695]: Initializing nodelet with 16 worker threads.
[ INFO] [1719682970.551872689]: RealSense ROS v2.3.2
[ INFO] [1719682970.551892548]: Built with LibRealSense v2.50.0
[ INFO] [1719682970.551900165]: Running with LibRealSense v2.50.0
[ INFO] [1719682970.574257350]:  
[ INFO] [1719682970.860871023]: Device with serial number 243522070607 was found.

[ INFO] [1719682970.860912919]: Device with physical ID 4-8-2 was found.
[ INFO] [1719682970.860926305]: Device with name Intel RealSense D435I was found.
[ INFO] [1719682970.861317394]: Device with port number 4-8 was found.
[ INFO] [1719682970.861337238]: Device USB type: 3.2
[ INFO] [1719682970.864095818]: getParameters...
[ INFO] [1719682970.885764152]: setupDevice...
[ INFO] [1719682970.885790394]: JSON file is not provided
[ INFO] [1719682970.885806743]: ROS Node Namespace: camera
[ INFO] [1719682970.885833257]: Device Name: Intel RealSense D435I
[ INFO] [1719682970.885850265]: Device Serial No: 243522070607
[ INFO] [1719682970.885866218]: Device physical port: 4-8-2
[ INFO] [1719682970.885879734]: Device FW version: 05.13.00.50
[ INFO] [1719682970.885900819]: Device Product ID: 0x0B3A
[ INFO] [1719682970.885914531]: Enable PointCloud: Off
[ INFO] [1719682970.885928104]: Align Depth: Off
[ INFO] [1719682970.885942012]: Sync Mode: On
[ INFO] [1719682970.886000638]: Device Sensors: 
[ INFO] [1719682970.973854338]: Stereo Module was found.
[ INFO] [1719682970.983733594]: RGB Camera was found.
[ INFO] [1719682970.983825587]: Motion Module was found.
[ INFO] [1719682970.983846749]: (Confidence, 0) sensor isn't supported by current device! -- Skipping...
[ INFO] [1719682970.983864864]: num_filters: 0
[ INFO] [1719682970.983877015]: Setting Dynamic reconfig parameters.
[ INFO] [1719682974.275526791]: Done Setting Dynamic reconfig parameters.
[ INFO] [1719682974.275963831]: depth stream is enabled - width: 848, height: 480, fps: 30, Format: Z16
[ INFO] [1719682974.276879965]: color stream is enabled - width: 1280, height: 720, fps: 30, Format: RGB8
[ INFO] [1719682974.276916909]: gyro stream is enabled - fps: 200
[ INFO] [1719682974.276937618]: accel stream is enabled - fps: 100
[ INFO] [1719682974.276962971]: setupPublishers...
[ INFO] [1719682974.278645789]: Expected frequency for depth = 30.00000
[ INFO] [1719682974.294254445]: Expected frequency for color = 30.00000
[ INFO] [1719682974.310555625]: setupStreams...
 29/06 23:12:54,472 WARNING [140278758975232] (ds5-motion.cpp:473) IMU Calibration is not available, default intrinsic and extrinsic will be used.
[ WARN] [1719682974.740985024]: 
[ WARN] [1719682974.741026960]: frame's time domain is HARDWARE_CLOCK. Timestamps may reset periodically.
[ INFO] [1719682974.872266351]: SELECTED BASE:Depth, 0
[ INFO] [1719682974.881045735]: RealSense Node Is Up!
 29/06 23:12:55,029 WARNING [140278522439424] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Invalid argument, number: 22
 29/06 23:12:55,079 WARNING [140278522439424] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Invalid argument, number: 22
 29/06 23:12:55,130 WARNING [140278522439424] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Invalid argument, number: 22
 29/06 23:12:55,216 WARNING [140278522439424] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Invalid argument, number: 22
 29/06 23:12:55,267 WARNING [140278522439424] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Invalid argument, number: 22
[ WARN] [1719682975.276562422]: Hardware Notification:IR stream start failure,1.71968e+12,Error,Hardware Error
 29/06 23:12:55,419 WARNING [140278522439424] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Invalid argument, number: 22
 29/06 23:12:55,571 WARNING [140278522439424] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Invalid argument, number: 22
 29/06 23:12:55,723 WARNING [140278522439424] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Invalid argument, number: 22
 29/06 23:12:55,774 WARNING [140278522439424] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Invalid argument, number: 22
 29/06 23:12:57,533 WARNING [140278522439424] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Invalid argument, number: 22
 29/06 23:15:02,694 WARNING [140278522439424] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
 29/06 23:15:03,745 WARNING [140278522439424] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
 29/06 23:16:31,875 WARNING [140278522439424] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
  1. Rostopic:
/camera/accel/imu_info
/camera/accel/metadata
/camera/accel/sample
/camera/color/camera_info
/camera/color/image_raw
/camera/color/image_raw/compressed
/camera/color/image_raw/compressed/parameter_descriptions
/camera/color/image_raw/compressed/parameter_updates
/camera/color/image_raw/compressedDepth
/camera/color/image_raw/compressedDepth/parameter_descriptions
/camera/color/image_raw/compressedDepth/parameter_updates
/camera/color/image_raw/theora
/camera/color/image_raw/theora/parameter_descriptions
/camera/color/image_raw/theora/parameter_updates
/camera/color/image_rect_color
/camera/color/image_rect_color/compressed
/camera/color/image_rect_color/compressed/parameter_descriptions
/camera/color/image_rect_color/compressed/parameter_updates
/camera/color/image_rect_color/compressedDepth
/camera/color/image_rect_color/compressedDepth/parameter_descriptions
/camera/color/image_rect_color/compressedDepth/parameter_updates
/camera/color/image_rect_color/theora
/camera/color/image_rect_color/theora/parameter_descriptions
/camera/color/image_rect_color/theora/parameter_updates
/camera/color/metadata
/camera/color_rectify_color/parameter_descriptions
/camera/color_rectify_color/parameter_updates
/camera/depth/camera_info
/camera/depth/image_rect_raw
/camera/depth/image_rect_raw/compressed
/camera/depth/image_rect_raw/compressed/parameter_descriptions
/camera/depth/image_rect_raw/compressed/parameter_updates
/camera/depth/image_rect_raw/compressedDepth
/camera/depth/image_rect_raw/compressedDepth/parameter_descriptions
/camera/depth/image_rect_raw/compressedDepth/parameter_updates
/camera/depth/image_rect_raw/theora
/camera/depth/image_rect_raw/theora/parameter_descriptions
/camera/depth/image_rect_raw/theora/parameter_updates
/camera/depth/metadata
/camera/depth_registered/points
/camera/depth_registered/sw_registered/camera_info
/camera/depth_registered/sw_registered/image_rect_raw
/camera/depth_registered/sw_registered/image_rect_raw/compressed
/camera/depth_registered/sw_registered/image_rect_raw/compressed/parameter_descriptions
/camera/depth_registered/sw_registered/image_rect_raw/compressed/parameter_updates
/camera/depth_registered/sw_registered/image_rect_raw/compressedDepth
/camera/depth_registered/sw_registered/image_rect_raw/compressedDepth/parameter_descriptions
/camera/depth_registered/sw_registered/image_rect_raw/compressedDepth/parameter_updates
/camera/depth_registered/sw_registered/image_rect_raw/theora
/camera/depth_registered/sw_registered/image_rect_raw/theora/parameter_descriptions
/camera/depth_registered/sw_registered/image_rect_raw/theora/parameter_updates
/camera/extrinsics/depth_to_color
/camera/gyro/imu_info
/camera/gyro/metadata
/camera/gyro/sample
/camera/motion_module/parameter_descriptions
/camera/motion_module/parameter_updates
/camera/realsense2_camera_manager/bond
/camera/rgb_camera/auto_exposure_roi/parameter_descriptions
/camera/rgb_camera/auto_exposure_roi/parameter_updates
/camera/rgb_camera/parameter_descriptions
/camera/rgb_camera/parameter_updates
/camera/stereo_module/auto_exposure_roi/parameter_descriptions
/camera/stereo_module/auto_exposure_roi/parameter_updates
/camera/stereo_module/parameter_descriptions
/camera/stereo_module/parameter_updates
/diagnostics
/rosout
/rosout_agg
/tf
/tf_static
  1. rostopic echo /camera/gyro/metadata and rostopic echo /camera/accel/metadata:

Finally able to see some data for this command being publsihed but no single imu topic being listed.

header: 
  seq: 567
  stamp: 
    secs: 1719683353
    nsecs: 228336334
  frame_id: "camera_gyro_optical_frame"
json_data: "{\"frame_number\":75807,\"clock_domain\":\"global_time\",\"frame_timestamp\":1719683353228.336426,\"\
  time_of_arrival\":1719683353228,\"backend_timestamp\":0}"
---

Now it feels better that there is some progress. Can you please reply with issue number on what to do.

@ShreyasK-alt
Copy link
Author

It is only necessary to install librealsense2-dkms first and librealsense2-utils second. The dev and dbg packages are optional. But it is very important that the dkms package is installed first as the other packages may have components that depend on it

I am not certain about librealsense2-dkms=1.3.18-0ubuntu1 but the version number looks correct for the librealsense versions that were being released around the time of 2.50.0. Usually though you do not have to install this package with an apt command, as simply installing the librealsense2-dkms and librealsense2-utils packages is all that is required. The -utils package should install the gl graphics.

With regard to gl graphics, Should I do a rework or something or just leave as it is?

@MartyG-RealSense
Copy link
Collaborator

1 & 2. Failed to set power state means that the program is having difficulty accessing the camera. This could be because another program is already using the camera. For example, if you have an active ROS launch then I would recommend not opening the Viewer whilst the ROS session is active.

  1. If the unite_imu_method parameter works with the rs_camera.launch file but not rs_rgbd.launch then please try launching with the opensource_tracking.launch file instead.

roslaunch realsense2_camera opensource_tracking.launch enable_infra1:=true enable_infra2:=true align_depth:=true enable_accel:=true enable_gyro:=true unite_imu_method:=linear_interpolation

  1. Ubuntu's screen rotation feature can sometimes detect a RealSense camera's IMU and rotate the screen's orientation. The only solution is to lock screen rotation in Ubuntu.

https://askubuntu.com/questions/1035209/how-to-turn-off-screen-rotation-in-ubuntu-18-04-lts

  1. The hardware error is a difficult one to resolve. Using initial_reset:=true may help but there is not a clear reason for why the error occurs. You can also try reducing the FPS speed and resolution of depth and color by adding the commands below to your roslaunch instruction.

depth_width:=640 depth_height:=480 depth_fps:=15 color_width:=640 color_height:=480 color_fps:=15

  1. The unite_imu_method parameter is meant to publish the /imu topic. Does your project require the topics to be combined in /imu or could you use the individual accel and gyro topics?

Regarding a re-work, it depends if you have unresolvable errors. If you do then it is likely to be best to purge all the packages and install again. Otherwise, if it works okay then leave it as it is.

@dyb678
Copy link

dyb678 commented Oct 28, 2024

It seems I get the same problem as yours. Do you solve it ? Thanks!

@ShreyasK-alt
Copy link
Author

It seems I get the same problem as yours. Do you solve it ? Thanks!

Can you elaborate your issue?

@dyb678
Copy link

dyb678 commented Nov 2, 2024

It seems I get the same problem as yours. Do you solve it ? Thanks!

Can you elaborate your issue?

I can get the imu data flow now, but I can only use the "copy" method. I consider if it is still caused by th version. Can you use "Linear Interpolation“ to get the imu data now? And could you plz tell me your version about FW,sdk and ros wrapper ? Thanks a lot!

@ShreyasK-alt
Copy link
Author

Currently, I don't have the set-up ready but what i remember is for the ros1 wrapper we need 5.13 version firmware and 2.50 librealsense version.
So u can check everything on the version compatibility on realsense GitHub release page. And also on the documentation page : Documentation

@ShreyasK-alt
Copy link
Author

I can get the imu data flow now, but I can only use the "copy" method. I consider if it is still caused by th version.

Yes..As far as I know it's majorly causes due to verison mismatch.

Can you use "Linear Interpolation“ to get the imu data now?

Yes I was able to get the days is correct way.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants