Frame Drops and Profiler Low FPS?

Hi, I'm working on infinite, procedural voxel terrain and so far it works nicely, but there's a frame drop problem. When walking around the world, framerates are around 240, and when a new chunk is generated the framerate drops to about 200, which is very little and shouldn't be noticeable, but it feels and looks like the frames are dropping from 240 to 60 for a split second which makes no sense.

I tried using the profiler, but I can't play the game with it on as it brings down my framerate to 8 and my specs are more than enough to run the latest AAA titles, let alone Unity.

Any ideas on why the profiler brings down my FPS so much and why the frame drops are so noticeable even though they're small?