Google Play Services Offline Use

I've implemented Google Play Services using the offline plugin and, when online, everything works as expected. I have a button to access the leaderboards and I upload scores to there without any issue.

The problem is when I open the app while offline. When that happens Google services tries to login and fails, giving an error message. After that when I tap the button that is supposed to show the leaderboards nothing happens.

I understand that the game is offline and it can't connect to Google's servers but, for example. on the game Swing Copters when offline the game still signs you in (no error message) and it still displays leaderboards (the latest you've seen when online).

How can I implement these offline features aka what am I doing wrong?