Issues calibrating stereo camera to lidar when board is not on the x-axis of the lidar.

[bclaw524]

Hi, I'm trying to calibrate multiple cameras to a lidar in 4 directions like so:

I am calibrating each camera one at a time with the lidar, and the lidar pattern and stereo patten does detect the boards.

However, the output TF file generated for the left and right camera (both are on the y-axis of the lidar) are extremely off. The rotated frame coordinate in reference to the lidar has the x-coordinate translation at values up to 100+ m.

The front and back camera (both are on the x-axis of the lidar) calibrated properly, with values for xyz only being under 1m for adjustment.

What am I doing wrong?