HDRP textures are gray when lights are turned off

I have a complicated model with a lot of sprite textures, when the light button on the top of the scenes menu is off the textures show up fine, but when I turn the light setting on it goes gray. I've tried adding lights to the scene but nothing changes it. All the materials are in HDRP/lit and all set up properly as far as my knowledge.