Xbox keeps randomly disconnecting controllers

I have a wireless and a wired controller I use for my Xbox but both randomly disconnect when playing games. The light stays on but in game it says I need to reconnect a controller. It happens constantly and it does it for like 20 seconds before it starts working again. I power cycled, checked firmware and reset the console but nothings working. Theres nothing wrong with the controllers either as it doesn’t happen when either are connected to my friends Xbox. It’s getting really annoying to the point I can’t play games at all because of how frequent it happens.