RigidBody Controller Forces

I am trying to create a first person physics-based game. I am trying to create a movement systems that will allow me to apply forces on the player. For example, the player could enter a windy area and there's a force being applied in the opposite direction of his movement. The problem is that if you were to use a velocity based input movement system using rigidbody.velocity, if any forces are applied to the player, the player's input movement will override these forces causing the player to walk how he would normally walk. Does anyone know a way around this?