Changing wall box colliders based on the players color

Hello everyone, I am new to unity. I am making a 3D puzzle, of where you control a ball that has to go through a linear stage without falling off. Sounds simple, but I want a puzzle element to it, where if the player is red he can go through red walls, blue, blue walls, green, green walls etc. This will be a puzzle as I will have some as the ground as well. All I need help with, is how to turn off a box collider in c# depending on the players color. Please help asap.