How to maintain velocity and spring force when scaling an object

I've been working on a project for a bit and something has changed so that when I'm scaling a sprite it loses its velocity. I've sort of fixed the issue by storing the velocity when it changes scale in FixedUpdate and then restoring the velocity in LateUpdate, but it's still not 100% right. The problem I'm having is that this body is attached to a spring joint and the added force from the spring joint is lost too. So how would you scale a sprite that is attached to a spring joint without losing its velocity? I swear it was behaving better before and I'm not sure what changed to make it stop working.

Thanks for the help!