HDRP Real Time Light Leaks inside Container Objects

I have been studying the Unity lighting system and shadows in-depth for weeks now, doing online courses and what not, and still I haven't been able to figure out solutions to a persistent problem.

I have dynamic drawer objects in my scene that the player can open and close, unfortunately the shadows are really displaced on the inside which I figure is due to light leaks:

The light source is a realtime spotlight that's above and to the right, the material is painted metal with a bit of smoothness shine. The shadow just looks bad and unrealistic, but I can't find a solution. I have gone over all the light and shadow settings for the light source, every mesh import setting, the material settings, and have played with HDRP settings and nothing seems to fix it outright. Does anyone know how best to deal with this kind of issue and is there something I'm just outright missing? Does it have anything to do with the model itself or the texture scale?

Anyway, thanks in advance.