Deleteing Objects created by Clients

I am making a game where the player shoots a Bullet that's an object. It all works fine until a new player joins and sees a massive swarm of bullets. I figured out the problem is that you must remove the instantiate RPC for the buffer. However I cant seem to get it working.

The objects are made client side.

Currently I've tried to delete the object and rpc by this code.

 @RPC //allclients
 function killBullet()
 {
     Network.RemoveRPCs(gameObject.networkView.viewID);
     if(networkView.isMine)
         Network.Destroy(gameObject);
     
 }

This however Does not work and the instantiate RPC is still in buffer..

How do you remove the client-side instantiate RPC from the buffer?