How to make a cube move towards the direction its being pushed to in a straight line?

Hi

I have a cube that I want to push in 4 different directions (forward, backward, left, right) always in a straight line. I tried doing it with just rigid body but say you push from the back left the cube will start spinning and won't be going in a perfect straight line.

How would you implement it so it always goes in straight lines, only the direction changes depending on where its pushed from?