WheelCollider spontaneous jumping?

So I've never used Unity WheelColliders before, so this might be some really silly easily fixed thing that I just can't seem to figure out, but I'm trying to create a game with pilotable vehicles that can burst through destructible walls, but the problem is these vehicles would just spontaneously fly into the air on occasion and I'm trying to prevent that. I've disabled collisions with the wheels and the instantiated crumbling pieces (which are rigidbodies) and that fixed most of the spontaneous velocity spikes, but it still happens on occasion, it's really frustrating. I would have just made vehicles work without wheels, but they can't roll up steps, which is why I've tried to utilize Unity's Wheel Colliders.