How to prevent an object moving when there is a collision with the hand controlled by Leap Motion?

Hello, I just reach the Leap Motion Today and i started to use it in Unity. It work very well and interaction with object are good when you want to move the object. But now i want to make a fix object which never move and when the hand enter in collision can't move throught the object. I tried several solutions Full constrain the rigidBody : the hand pass throught the object. Apply a Fixed join : the object move and return back to position after. Is someone have a solution to this problem?