Lightmaps not loading/working?

My scene had good lightmaps baked on it, everything was working fine. I try to add one more light and everything got super dark. Even deleting the light does not work, I have no idea how to change it back except for rebaking it (it takes too long) what happened?