Box collider keeps moving out of place

I've created my own custom buttons and add the box collider to detect when the user clicks the button. However at some point during my workflow these colliders move a considerable amount of pixels off to the right.

When I try to move them back in place UNITY puts it exactly where its supposed to be, over the button. However at game time the colliders move all the way to the right. I noticed that this seems to happen when I introduce the UI text components onto the canvas near my buttons.

Is there a way to fix this glitch or bug? Please see the attached picture.