inputfield and scroll rect, how to switch with one touch?

I have an input field with a dropdown for searching. The Dropdown is a scroll rect.
When I type some search the possible results are displayed in this dropdown.
If the thing i am searching is already in this dropdown and I want to scroll to it, the swiping gesture only deactivates my InputField, but doesn't affect the Scrollbar.

How can I make it possible to scroll AND deactivate the InputField with only ONE touch gesture?