Tree branches as mesh collider

I am creating a outdoor terrain, and followed along with the tree tutorial, however i ran into a problem. I want to turn the trees into mesh collider, however when i select the tree and add a collider, the player collides with the leaves as well as the branches. Is there any way to make it so the player only collides with the branches?