Animation + triggers + colliders doesn't work together

Hello everyone. I have built a piano level where the player is jumping on the keys. At the moment the player has jumped on a single key, it triggers a key pressed animation. The problem is, when the key goes down (and the player is on top of that key), they get separated from each other just enough that an on trigger exit is being called (which activates a key released animation). so the key goes up again pushing the player upwards, and the whole thing goes over and over again. I tried incrementing the gravity which technically keeps the player always on the key, but yeah, the player cant jump.

Any suggestions? Thanks.