Organize around inactive GameObjects not being findable

So if you set a GameObject to inactive GameObject.Find can't find it anymore. This is weird and unexpected behaviour.

Seeing as setting objects to inactive is the default and easiest way to not have them be visible or effect the world anymore it is something I need to use. What is a way to work with this without having to create local variables for every GameObject that you want to set inactive but in the future want to set active again (since you can't find it otherwise)?

Being able to Find GameObjects is a great way of loose coupling. Having to set and store references to them in your objects is too tight for my taste. So I'm looking for examples of loose organization.