Odd character controller behavior when a shield object parented to child

I have a ship object that is moved with character controller's simplemove system. The movement works fine when no shield is added. Then I add a shield object it doesnt seem to want to move, but still rotates like it wants to move towards my target. Here are the steps I do for my shield: 1. I instantiate and parent the shield to a child gameobject of the base object with the character controller 2. I use physics ignore collision to let my shield ignore collisions between the character controller, and the game ground 3. My shield grows from small to big (to simulate a shield raising effect) and during this the collider is disabled 4. When the shield i fully scaled, the collider is reenabled

Why would the character controller work without the shield, and then not with it?

If i pause my game, and then move the shield object up about 2 units, the gameobject moves, and then stops a little bit later. If I move it up 2 more units, it moves just fine.