How can I pre-load all the possible components to avoid stuttering with GetComponent?

So, for example. I'm making game for Android and it's going to use multi-touch a lot, and there's lots of GameObjects with same script components on them. I need to interact with them without having device stutter on touch with them.

I've tried putting components into array, but couldn't figure out how to determine which one to use out of array from the hitray.

Weird thing is, on mobile it stutters only on 1st touch. Rest are fine, even though there's GetComponent in the loop.