Lights rendering Shadow Artifacts?

Alright so I've done a bit of research and what I am aiming to do is have a directional light rise and set. When it rises I want my camera to switch to "Forward" lighting and turn off all other lights. When it set's I want my camera to switch to "Deferred Lighting" and turn all other lights on. That's not a problem. But when my Directional (sun) light is rising, all the way up until it is 90 degrees, it has shadow artifacts. I changed my Quality settings half a dozen times and played around a while and got it better but it doesn't go away. My shadow draw distance is only set to 100 when, in previous projects I was able to set it to 500 with no problem. I didn't do anything different, It just seems to be a bug? Anyone find a fix or solution to this problem? or have any ideas? Thanks!