oh, so you've got the elite strap with battery ?
its only a power bank, you'll need to unplug it, try it and see
Meta support didn't make much comment but they've apparently dispached a replacement Elite Battery Strap for my Meta Quest 3 so hopefully it won't exhibit the same issues with draining the battery whilst it's connected to my Quest 3 when the device is turned off.