Unity UI - Button Slow On Some Devices?

So, It's basically a level button. When you click on that button, it sets everything up for the level and starts the level. It works fast and perfectly on my cheap $100 android phone, but when I run it on a Samsung galaxy s6, I have to tap it multiple times until it starts. The other buttons there work faster however. Anyone know how I can fix this? Thanks is advance!!