Different joystick buttons per joystick?

Hello guys,

Today I have been busy with figuring out what the joystick buttons are for my PS3 controller in the input manager. If I look for a list of button names, it seems that each controller (XBOX 360 controller, PS3 Controller, etc.) has it's own configuration.

Joystick button 1 for example, is the A,B,Y or X button for XBOX 360, while Joystick button 1 for my PS3 controller is R3 (A totally different button).

My question is: what will happen if somebody would play my project with a XBOX 360 controller. Would all his controls be messed up and weird or would that be fixed after building the game? Is there some Input button/key to prevent all these weird button controls?