Unpaused camera twitch

I am working on a basic pause menu for my game. Everything is working fine, except that the game seems to remember the mouse movement while paused and jerks once the game is unpaused. For example, if I pause the game and move the mouse cursor down towards a button and unpause the camera will shoot downwards to match the mouse movements made while the game was paused. I don't think it is something I have included in my code, I think it is something I am missing. Can anyone enlighten me?