Google Cardboard Frame Rate Issue

I am using the official Google Cardboard SDK and using the demo scene. When I run it on my phone I start out with around 30fps. Everything runs fine at the beginning. However if I tap the screen several times, the frame rate with continue to go down until I stop tapping then The frame rate will never return to 30fps. I am running on a Galaxy S4 if that helps any. This issue makes it impossible to develop unless I use no touch input at all(which I would prefer not to do).