Gravity increasing on hovering ledge.,Gravity increase while on ledge.

I'm making a first person controller and I've applied gravity to the player. If I step off a elevated platform I fall to the ground and all is good.

However, if I slowly walk on the edge of the platform, unity begins increasing the gravity falling speed and when I do step off, it throws me to the ground at a much higher speed.

I'm assuming this is happening because the empty object I'm using to tell unity "the player is on the ground" is now floating in mid air since my character is half hovering over a ledge.

So my question is, how do I fix this? I can't figure out away to increase the empty objects detection size.

Any help would be appreciated :)