Collider Mask Bug

Hey, so I just found a really annoing bug having to do with "Collider Masks". I have a Point Effector 2D that applies a force upon impact, but I have to disable collision with a few layers, so the way I do that is by using the "Collider Mask" built in to the Point Effector 2D. It used to be working for me until I had to re-scale some objects, and now its not registering any collisions unless I turn off the Collider Mask entirely. Even if I have every single layer enabled in the Collider Mask when its turned on, it will not work. Again, the only way to get it to work is by disabling the Collider Mask. Thanks for any help