Random lightmap switching

Everytime I bake lightmaps for my environment, some objects in the scene will do something with their lightmaps based on the position of the camera. I'm not sure if they switch to a difefrent lightmap or their light uv's get changed.

in this case you can see 2 trees randomly switching when I hover around them.

has anyone experienced and fixed this issue before? I cannot find any threads about this issue.