As someone has already mentioned Draytek is the way to go on this.
Basically on the Draytek you set up the 4G WAN, then select it as fail over only if the primary WAN fails.
You would be looking at one of the 2862 series modem/routers. Some such as the 2862Ln have the 4G interface built in, the basic 2962n or ac you would have to add a 4g dongle. I might be tempted by the n or ac and add a dongle due to price difference.
I don't have 4G fail over, but do own an older 2860n that I've had 6 years, and it's an incredibly solid piece of hardware.