- Home /
How to convert Open3d camera Pose to unity
Greetings! I've been running thru an issue where I do a camera extrinsic calibration in Open3D with global registration and ICP, the point clouds from each camera get aligned correctly but when I pass the camera pose to unity I get a really bad result. The Open3D Transform seems fine I already inverted the Y axis due to the difference in the coordinate system but I can't figure out where the variation error is coming from, is it just because of imprecision, or I'm missing something.
I invert the transform so I can extract the rotation matrix and the translation vector from the pose. My approach is to get the rotation and the translation and assign them to their correspondent kinect object in unity. The main Kinect stays in the origin of the coordinates and then I apply the transformations to each camera referencing the main one. I'll attach some data and captures of the setup. I get this transformations in open3d
transformation_1
array([[ 0.96518757, -0.24386752, -0.09455995, -0.30049289], [ 0.14996032, 0.21974007, 0.9639638 , -0.97258158], [-0.21430085, -0.94458612, 0.24866084, 0.60323834], [ 0. , 0. , 0. , 1. ]])
.
transformation_2
array([[ 0.9690198 , 0.23938183, -0.06080263, -0.36967974], [-0.15101459, 0.37945827, -0.91280119, 1.0112917 ], [-0.19543595, 0.89370452, 0.40385273, 0.61812839], [ 0. , 0. , 0. , 1. ]])
After following this write up ( https://plastic-fur-aec.notion.site/Transform-of-coordinate-systems-ef17d83ea3f743d09aff8d8b1e82884d ) I proceed to get the unity translation and rotation as seen in this screenshot
When I manually calibrate the cameras in unity I get these vectors, and I really can't figure out if there's any correlation with the ones that I mentioned previously.
Any help or tip about what's happening would be greatly appreciated since I've been stuck with this for a long time, Thanks in advance!
Your answer
Follow this Question
Related Questions
Set camera angle in a script using the same system as the properties page?? 0 Answers
Morphing geometrical shapes 2 Answers
Inspector window transform component showing ONLY local cordinates 1 Answer
Convert Canvas Space point to local space of a rotated rect? 2 Answers
Is there any way to set a Gameobject's transform matrix to be the World Space? 0 Answers