Apple Mach-O Linker error in Xcode due to Game Center stuff I haven't even added.

I use Unity 4.2.0f4 and Xcode 5. When I run the app in Xcode and look under "Capabilities", Game center is turned On but with errors. I don't need and haven't added anything for Game Center for the app. If I click on "fix issues" it links my Provisioning Profile to Game center and Game center looks happy. I can then build the app to iPhone or iPad without issues, but since I don't need or want Game Center to be On, I turn it off. When i turn it off I get Apple Mach-O linker erros, 10 of them.

"OBJC_CLASS$_GKLeaderboardViewController", referenced from:

"OBJC_CLASS$_GKScore", referenced from:

"OBJC_CLASS$_GKAchievement", referenced from:

"OBJC_CLASS$_GKAchievementDescription", referenced from:

"OBJC_CLASS$_GKLeaderboard", referenced from:

"OBJC_CLASS$_GKPlayer", referenced from:

"_GKErrorDomain", referenced from:

"OBJC_CLASS$_GKAchievementViewController", referenced from:

"OBJC_CLASS$_GKLocalPlayer", referenced from:

clang: error: linker command failed with exit code 1 (use -v to see invocation)

What is going on here and how do I get rid of this junk so that I can turn it off?