Unity stutters when training with Machine Learning Agents.

At first everything worked silky smooth, but after a few sessions of training ( I'm talking about starting training and ending, not episodes.) Unity started to hang every few seconds for a few seconds (stutter). Using GPU instead of CPU does not help.

I was able to fix it temprarily by reinstalling everything needed for mlagents be it the unity package or python.

I'm using mlagents 1.8.0 and python 3.7.0, all of my packages are up to date and everything is runing in a virtual environment.