Does you controller have any stick drift? If so, that's the most likely cause of your issues. The stick movement interrupts whatever you're trying to do when you press/hold the button. If you have another controller, try it and see if it works better. If not, try this when the problem happens - rotate both thumb sticks in a circle a couple times, then try to activate the mod/shader/whatever.