¿How to make a ball react properly against two different physic's materials?

Hello guys/gals, I am trying to make a simple mini golf game in Unity, I made the golf club to be a box (temporary to test) with a rigidbody attached, after, I created an empty GameObject and added an spring joint to it and set the objetive to be the box's rigidbody so I can control the movement through transformations without affecting the physics directly. Now, here comes the problem, the ball, the box and the ground have different physic materials (bounciness to be more specific), ball bounciness = 0.9, ground's b. = 0.2 and box's b. = 1, after the ball collides with the ground and I hit it with the box, looks like everything is ok, it goes to the other side wall and returns to the box in a linear movement, when it hit back the box (bounciness = 1) it doesn´t bounce at all, it suddenly stops and lose all its speed! (for me the ball should bounce and go again to the wall, it has enough speed to do so before it suddenly stops).

So, why is this happening?, is there any turn around to solve this or make it work properly? :(

many thanks in advance for any light you can give to this.