Hinge Joint strange behaviour

I am having some strange issues with my Hinge Joints. I'm trying to build a custom wheel collider by attaching hinge joints to each wheel and setting the "connected body" property to the car Rigidbody. The problem comes from the fact that each of the 4 hinge joints connects to the same rigidbody and as a result only one of them stays connected to the car while the rest of them are moving all over the map. I'd be very grateful if someone knows a solution to this issue as it has stopped my work for 2 days already