Strange Water Graphics Problem

I need help with a graphical issue I'm having. Whenever I turn on hard shadows on my direction light I'm using as the sun or put a light near water, it turns off all reflection and refraction in the water and the water gets a ugly glare on it. Anyone have any ideas as to what could be causing this? I'm using forward rendering and a have the quality settings to max with a pixel light count of 5.