raycast passing through joystick gui

Using the joystick prefab. I have a raycast script set up, however when I pass over an item that can be interacted with it does so. How do I stop raycasting through my joystick gui. I've done layermasking, however the joystick gui is unaffected by this.