Swipe controller can't detect short swipes

So I have a game where my player moves along Z axis and has a trigger box in front of him. When other object enters the trigger box zone the swipe input is turned on and player can swipe in certain direction to move that object in that direction and when that object leaves the trigger box or was moved the input turns off.

The problem is that the program works fine, but if I make a short swipe, like barely move my mouse the swipe is not registered. How can I fix this ?

 private Vector2 startTouch, endTouch, swipeDelta;

 void Update()
 {
   swipeLeft = swipeRight = swipeUp = swipeDown = false;
 
         if (InputOn)
         {
             #region Mouse Inputs 
             if (Input.GetMouseButtonDown(0))
             {
                 isDragging = true;
                 startTouch = Input.mousePosition;
             }
             else if (Input.GetMouseButtonUp(0))
             {
                 endTouch = Input.mousePosition;
                 
                 if (startTouch != endTouch)
                 {
                     isDragging = false;
                     InputOnRight = false;
                     Reset();
                 }
                 
             }
             #endregion
         }
 }
 private void Reset()
     {
         startTouch = swipeDelta = Vector2.zero;
         isDragging = false;
     }