RigidBody Clings to Walls

I have a rigidbody player controller that does simple movements such as jumping and crouching. However, when I jump and move towards a wall the player will stick to the wall. Is there anyway simple way of fixing this? I am using a separate box mesh at the bottom of my character to detect collision with the ground, which works perfects. I do not want to just stop player movement in the air. I want to prevent the player from continually moving towards a wall. Thank you :D