The most used "USB charger" I use at home is the front USB 2 port I have in the front of my AV receiver, I charge almost everything on it. My AirPods, AA batteries, my phone, my Steam Deck even (but it will take overnight).
You could invest in a faster charger mate. It would make a difference to your charging times. I've checked what all my devices make use of as follows...
Apple Watch Ultra 3 doesn't need anything more than 20W
iPad Mini 7th Generation doesn't need anything more than 20W
iPad Pro 2022 will use up to 35W in a compatible charger
iPhone 14 Pro Max will use up to 30W in a compatible charger
Samsung Galaxy S25 will use up to 25W in a compatible charger
Samsung Galaxy Buds 3 Pro doesn't need anything more than 5W
Samsung Galaxy Watch Ultra 3 doesn't need anything more than 15W
So I've got three devices which can use more than the 20W the standard Apple USB-C charger is capable of. The iPad Pro, iPhone 14 Pro Max and Samsung Galaxy S25. All the rest can run off the Apple 20W charger.
That said I've got my iPhone 14 Pro Max charging cable plugged into the third USB-C port of my new charger, and two USB-C to USB-C cables plugged into the other two ports for the iPad Pro and Samsung Galaxy S25, and I'll charge my iPad Mini off it as well.
I've got my Apple Watch Ultra 3 charging cable plugged into the Apple 20W USB-C adapter and will swap this with the Samsung Galaxy Watch Ultra 3 charging cable as and when needed.