Build errors on Win Server but not Win 10

Hi I have a project that I can successfully build on my Windows 10 development machine. However, when I try the exact same build on Windows Server 2019 I get out of memory errors. I'm running the server on a VM in AWS EC2 and it is provisioned with similar specs to my development laptop (albeit a slower CPU clock speed). I'm trying to set up automated builds for my team, but I'm unable do to this issue. I find it odd that I can do the exact same build locally while running other applications like my browser, etc. and I can't do that build on my server. Any thoughts? BTW, I have the exact same version of Unity installed on both machine.