Removing the gateway IP address deals with the issue at the source whilst using the firewall is a block.
There is nothing wrong with doing both, in fact learning to use your firewall is a good thing but changing to a static IP minus gateway is the first starting point. If at some point you replace your router, you wont accidentally allow it back on the internet.