Spring Joint acts in World Space

The slingshot in the image below works fine when aligned on the world Z-axis. I pull the slingshot back on it's local Z-axis, once it's released physics does the rest. The only problem is that it acts in world space rather than it's local space.

I cannot figure out why. Any pointers would be appreciated!