Adding force with a trigger depends on location

I am using a trigger in front of the player to detect for another player. Using the rigidbody I add force if the player punches while another player is in the trigger. When the player is on the edge of the trigger more force is applied than when they are closer to the player. Is there anyway around this?