Unity Multiplayer - Controlling Wrong Characters

I'm only about 4 months into unity so there are tons of things I do not know, Although I looked around and I can't seem to figure this out, any help is appreciated!

Basically I started working on a simple multiplayer project, at first I made my own player movement scripts and used one main camera that looked over everything. This worked fine when 2 people connected, everyone controlled their own cube and there were no problems with 1 camera.

Next I tried using the First Person controller, character motor script, and mouse look script, along with attaching a Camera to the character Prefab (along with a model I downloaded - not important.) I attached the Network view to the camera, and to the character prefab. I also set getcompnent.enabled(all the player scripts) = false if netWorkView.isMine == false. I also deleted all cameras but "main camera" if networkWorkView wasn't equal to true.

Everything seems to work, except when 2 people are in the game, they control the other persons character! They control everything, the mouse look and movement, everything. I'm assuming this has to do with what the netWorkView is observing?! I'm not really sure how to fix this. Any help would be great, I'm a noob!