How to distinguish between fast moving finger touches?

I have a single finger pan gesture in my game. When I alternate two touches far away from each other, they occasionally are detected as the same tap count, and finger id.

I have read in the docs and other answers that the tap count doesn't work on Android, but it seems to work fine for me... except in this one case.

It only rarely happens, about 1 out of 10 times that I actually try to make it happen. When it does, it can cause some of my other gestures to screw up.

I think this may be caused by a slower FPS due to using Unity Remote 4 to test; thus, a slower poll of the touch data.

If it is the FPS that is causing this, I should be able to manually update the tap count if the finger moves beyond a certain speed in inches/second.

What other factors may be causing this behaviour? Is this just a Unity or OS bug, and I'm just over complicating this. What other possible solutions are there to distinguish between these touches?