Weird glitch/artifacts with spotlight in FPS character,Weird spotlight glitch after extruding walls from ground (probuilder)

Hi!

For some reason as soon as I add a spotlight to my scene (placed and rotating with FPS camera), I seem to have these weird glitches in the light that makes the whole scene look very weird. I've tried to fiddle around with the settings to see if by chance I could fix it but nothing works so far!