GPU Instancing changes color of sprites

For some reason GPU instancing changes the color of my sprites within my 2D game.

If its set to off looks like this:

If set to on:

This seems strange and can not work out why?

Note: My colors of the jewels are set within the render, the sprites are grey scale to allow me to change the colors within unity.