Prevent Drag button inside scroll rect

Hello Everyone,

I have a scroll rect in my scene that contains buttons. The buttons inside the scroll rect can be dragged on Y axis (each buttons contains a script with OnDrag). The problem is:

Whenever I try to scroll the ScrollRect, the drag of the buttons blocks the scrollrect.

Is there anyway to Drag the button ONLY if I am not scrolling? A sort of "OnDrag" priority.

thanks.