Splotchy lightmap results after bake

Hi, I'm pretty new to baking and am having some minor issues. The bakes are pretty good for the most part, I'm just running into some splotchiness that I don't really know how to take care of. The splotchiness occurs on the whole mesh, and is mostly visible in areas that are farther away from any of the baked lights.

Here's an example photo I edited to make the splotches more visible:

Like I said, the light baking itself looks fine, but I really would like to be able to get rid of these splotches and make the mesh look smooth in areas that are unlit. There's probably some setting I'm missing or something, I'm not sure.

Here are my light baking settings: Does anyone have any idea how to fix this? Thanks