Music Crash and slow down when I unplugged headphone in IOS after I changed System Sample Rate to 44.1kHz / 48kHz

Music Crash and slow down when I unplugged headphone in IOS after I changed System Sample Rate to 44.1kHz / 48kHz.
I am developing my own rhythm game, and changed to 44.1kHz / 48kHz to get more quality audio in iPad/iPhone.
And music will slow down if I playing music from AudioSource and suddenly unplug my headphone , how should I solve this problem?
Its totally work in 22kHz.

Unity Version : 2019.4.24f1. CPU usage is around 50%.
Memory around 19-21%.
. . .
Audio Setting:
Global Volume : 0.4.
Doppler Factor : 0.
Speaker Mode : Stereo.
System Sample Rate : 44100 / 48000.
DSP Buffer Size : Best latency.
Max Virtual Voices : 512.
Max Real Voices : 32.