Joint setup for a swinging croquet mallet?

For some reason I can't get the hinge to work to swing this mallet. It's imported as a 2-piece mesh, so that pivot origin is at the end of the shaft as shown in the picture. I'm just using a stretched default cube as the connected body.