Had the same problem on three different Xbox Series S / X controllers and have sent them all back. Eventually became a PlayStation controller instead. More cumbersome solution but it works anyway.
The problems have varied between the different hand controls. The best one only had bad X and HOME. Know that it is usually someone / some of ABXY who is having trouble, have not read anything about HOME, I think. The worst had bad ABX.
Quite dissatisfied with how this is handled from MS. I want another Xbox controller for the computer when my old one is starting to get worn out, but if the buttons are swaying, I will give up until it is fixed. Extremely disturbing when keystrokes do not always register – unusable.
Surprised that there is no more talk about this. Seems like there are quite a few in a reddit thread that are bitter. It’s been like this for a couple of years now.
Wrote this on the mobile with a baby in my arms so do not know how coherent it became
–