Scroll Rect only scrolling while mouse is inside rect

Trying to make a scroll rect only scroll while the mouse is down inside the scroll area. Once the mouse leaves the area, the scroll rect acts as if the mouse was released, so if the scroll rect was set to elastic, it would still lerp back to the end points.