Physics2D.IgnoreLayerCollision not working?

Hi guys. So I already did a pretty intensive google search and I couldn't really find anything of good help, so here I am asking you guys if you could help me out a little. I'm also pretty new to this, so if it's a really simple solution, please forgive my lack of knowledge.

So what I have is a game made using Unity's 2D feature. My game is isometric, and due to it, I have to use polygon colliders as my go-to choice of collider. Now, my main character has a dodge roll feature, where if I press a button, he rolls in a direction. What I want, is for him to ignore collisions with enemies in order to roll past them if he needs to. So I set my player to a "Player" layer, and my enemies to an "Enemy" layer, and I use Physics2D.IgnoreLayerCollision(8, 9, true) when the button is pressed to roll. And I then set it to false when he stops rolling.

Now so far, it works fine if my player is already rolling before he touches the enemy, but if he's near the enemy, or already touching him, and then begins a roll, then IgnoreLayerCollision seems to run, but my player still pushes the enemy as if he isn't ignoring it. Anyone know why this happens?