Draggable children blocking mousewheel scrolling

Hi,

I have what I believe is a pretty standard inventory setup. A parent panel that holds the item icons and has a scroll rect to scroll through the inventory.

The item icons are draggable, in order to pull them out of the inventory and into a character slot.

However, if the mouse is over the inventory items when you try to scroll with the mouse wheel, it's ignored.

How can I have the mousewheel scroll act on the parent panel and ignore the inventory items when scrolling with the mouse?