How to get raycast to ignore objects behind a panel

Hi there, super new to Unity.

Right now, I have a sprite that you can interact with using a raycast. However, I also have a panel that can open up over the sprite, but when I click on the panel the sprite still reacts to the raycast. Is there a way to block a raycast from interacting with layers beneath a top layer that I can open and close? Thank you!