Load scene with navmesh from asset bundle

So what I'm trying to do is load a scene from an asset bundle with a navmesh. Right now I have a scene that gets bundled up using "BuildPipeline.BuildStreamedSceneAssetBundle" . The asset bundle builds well with no errors, and if the scene has no navmesh then it loads just as one would expect as well. If the scene does rely on a navmesh then the navmesh is reported as missing and the whole scene breaks. If i use the scene without putting it in an asset bundle then it works just fine but I do need it to be bundled up.

The exact error is : ""SetDestination" can only be called on an active agent that has been placed on a NavMesh. UnityEngine.NavMeshAgent:SetDestination(Vector3)"

has anyone run into this before? I could definitely use a pointer in the right direction - it seems odd that one cant bundle a scene with a navmesh so im probably doing something wrong.