Canvas interaction on render texture to message PhysicsRaycaster

Here's what I want.

On a Canvas, I am displaying a RenderTexture on a RawImage from one of the cameras in the scene which will also have a PhysicsRaycaster or PhysicsRaycaster2D on it. I want to be able to be able to do pointer interactions (clicking/dragging etc) on the rawImage which will then send input messages to the corresponding Raycaster.

Basically if there's any game objects which implement IPointerDownHandler, IDragHandler etc in the view of the RenderTexture camera that the corresponding input event functions are called.

Is there a straight forward way to set up this functionality?