2D Animation. Changing to sprites with different pivots.

I'm making a game where I want my character controller to be able to grab ledges. I have an animation where the sprite pivot can be placed at the tip of the ledge and the character will just climb up. When the animation ends I switch back to my default animation, but the sprites in that animation have a different pivot, so I have to move the character by some offset.

The problem is that the animation event and the animation frame happen at different times, so the sprite changes back to my walking animation THEN jumps to where it should be or vice versa.

Has anyone had this problem in games or have any ideas about how to fix it? I've tried IEnumerator -> WaitForEndOfFrame and adding filler images to the end of my animations, but nothing seems to solve the problem.