issue with reticle pointer when changing gvr camera

Hi community, I have the following setup:

In my GVR scene for cardboard there is a Main Player where my Main Camera is attached to. It works fine, including interaction with Objects via Reticle Pointer. When a specific 3D object is pointed at and clicked, the Player Game Object gets deactivated and another Object with a second camera attached to it gets activated. The purpose is that when you click the specific object (which is moving) you change to the view of the new camera and move with the object through the scene. It works quite whell instead of the Reticle Pointer. As soon as I change to the other Player-Object with the other cam attached to it the Pointer isnt "interactive" anymore, meaning I cannot click any button anymore ore use other functions (also the point does not transform to a circle anymore). It is the same but the other way around when I first have the second (moving) cam activated and then change to the Main Player Cam.

Both cams have a GvrReticlePointer as a child and each includes the GvrPointerPhysicsRaycaster. There is also the GvrEventSystem in the Project.

I hope you can understand my question. I'm browsing the forums for days now and could not find any simmilar issue.

(unity 2017.3.1f1 Personal 64 bit)

Thanks for your help.