HDRP High Quality Shadow Filtering really noisy for some reason

When I had set my HDRP quality setting to High the entire scene became super noisy, so I did a little digging and the culprit seems to be the High Quality Filter under Shadows, but has anyone seen this before? This object is completely untextured and best shows what I mean, but this weird noise pattern is on the entire scene and only disappears when I toggle the Shadow Filter down to Medium or below. Is this my GPU being not up to the task or is this something I can fix in engine?