If I'm playing Zelda or something, it's bearable because it's not too time sensitive and no one else is depending on me. If I'm playing Smash Bros then I just can't hit any combos and if I'm playing Overcooked then we are all letting each other down because we're running past and into each other.

ok so it's a latency issue? Your original statement indicated physical longevity issues with the controller.

No it's not latency, the controllers just don't work. The sticks drift and the buttons sometimes take multiple presses.