Likely your controller. People often use waaaaay too much pressure on the control sticks. Look at yours and see if you see wear marks from pressing the plastic too hard against the edges, if so, you have likely also done damage to the sensors inside.
People get so bad I've seen them create stress fractures and even snap the thumb tab off the top.