Player resets to previous position or 0,0,0 only sometimes

Making a climbing mechanic using Vive controllers, narrowed it down, I feel like it's a simple transform script. However, occasionally the player will reset back to a previous spot/hold, or at runtime it will sometimes reset the player to 0, 0, 0 on first grip (and occasionally when playing as well). 70-80% of the time it works fine. Seems exacerbated by high speeds but happens without.

Here is the relevant code. Omitted all rigidbody and collider stuff. I really feel like it's gotta be something obvious I'm overlooking but I can't find anything about this online.

Each controller has this same script on it, except the other is startPlayerLeft and startPosLeft.

  public void OnTriggerStay(Collider other)
     {
 if (triggerButtonDown)
                 {
                     startPosRight = trackedObj.transform.localPosition;
                     startPlayerRight = PlayerBody.transform.localPosition;
 }
 if (triggerButtonPressed)
                 {
                 PlayerBody.transform.localPosition = startPlayerRight + (startPosRight + -trackedObj.transform.localPosition);
 }
 }