How do I get Object-following Virtual Buttons maintain structure?

As shown in the picture, I want to be able to maintain this placement of virtual buttons wherever the ball moves.

This is what I've tried:

1.

The cue ball is a Rigidbody with Bounce Material, so it can bounce off the cushions. So in this case, I tried making the Virtual Buttons RigidBody Components and adding the same force to the buttons, but this didn't work because it wasn't able to detect the cushions and kept moving forward.

2.

I gave it a collider, it would bounce off the cushion before the ball and that would disrupt the formation around the ball.

I tried to parent the Virtual Buttons under the Cue Ball and the Cue Ball under the Image Target, but this didn't help since it all centered within the ball and overlapped. I couldn't move it at all (I don't know why)

Link to the picture: http://stackoverflow.com/questions/29113872/object-following-virtual-buttons