Ambient Occlusion on soft occlusion leaves shader makes leaves white?

I am having an issue with one of my tree prefabs. When I use the default soft occlusion leaves shader and turn the ambient occlusion slider up half of my leaves will turn white? I have no idea what is causing this and it isn't affecting any of my other trees. I more information is needed please let me know. Thanks.