Of course they sell batteries for them. Any standby use sealed lead acid (SLA) maintenance-free battery of the correct specification (size, position of terminals, voltage and amp-hour rating) will do.
It is my understanding that sealed lead acid batteries built for so called "standby" use (such as in UPS's) don't really like being discharged, particularly not very much, and certainly not at a high discharge rate (such as when running your PC during a power cut). They are perfectly happy to sit there being constantly trickle charged at moderate voltage (13.7V for a 12V battery if I remember correctly) and being used only occasionally for not very long periods (10% discharge or so). These batteries last years (3-5 at least) just on standby with no real use or discharge, but will still be prepared for use after this period if needed.
There are also SLA batteries built for "cyclic" use (such as in electric wheelchairs) that are built to withstand being deep discharged more often at high load. However, their life is probably measured in months, not years.
As far as I know, SLA batteries do not like deep discharges, so if you do test the UPS, don't take it too low, just a couple of minutes to check it is still working.
Martin