[Unity 4.6 UI] Button moves with text object in animation

Recently I've downloaded the new Unity 4.6 beta and began working on a UI. So far most things have been working fine but I've run into a bit of an issue. I have created an animation for when a button is pressed to move the text object on the button off of the screen. For some reason though it seems to be moving the button's hitbox. This causes an odd loop from the normal animation and the pressed animation and it can be viewed here https://mediacru.sh/5p9WYqfh8SF3 . Is there any way I can prevent this from happening and simply have the button move off screen and stay there while it's activated?