Yes it's possible but you'll run into the same problems MS have with Windows. It's a house of cards so if you remove anything there's a chance that something else, seemingly unrelated, will break.
Personally i wouldn't touch a 3rd party trimmed down version of windows such as Tiny10/Tiny11 because you have to trust they've not done anything nefarious.
If you really want to go down the install a modified version route rather than simply modifying an already installed version and creating a backup image then I'd suggest using an ISO you've downloaded from MS and using a third-party program/script like
MSMG toolkit or similar to modify the install.wim