It's a choice you make, do you want to listen to the music the way you are happy with or do you want to listen to it the way the artist/sound engineer mastered it? Problem is, due to room acoustics, speaker choice and even the amplifier you can't listen to it exactly as it sounded when mastered as it isn't possible. (studio headphones are the closest you'd get)
Having built enough kit over the years, the problems you run into now are that speakers are deigned primarily for their looks over their sound which is wrong. When a 40 year old pair of speakers can give brand new mid-high end kit a spanking you know something must be wrong with the way they design things these days. (15" tannoy dual concentrics, celestion Ditton 66's to name just 2) The main reason you need subwoofers these days is because people don't want large speakers clogging up their living rooms, so manufacturers make the cabinets tall and thin meaning that the usual driver sizes range from 4-6.5". A pair of 6.5" speakers do not even equal one 8" driver let alone a 12". (same story for an 8" driver, a pair is less than a single 12") The high end vintage speakers used to come with drivers from 8-15" and could do everything from sub frequencies up to 20K+. (must have heard the term "no replacement for displacement") Horn loading will certainly improve things for smaller speakers as do reflex/transmission line designs but none will make up for the minuscule displacement of miniature woofers. (plus horn loading for LF needs quite a large area due to the wavelengths involved. Porting and transmission line both have their own separate problems too, and ABR's have become quite uncommon now.
Theoretically all amplifiers "should" sound the same, biggest reason that they don't, particularly integrated amps, is that the manufacturers introduce their own signature sound via particular component choice etc. (even by introducing even harmonic distortions) The articles to look at for this was
The carver challenge and an old electronics weekly article
capacitor sound.
Just do as you are though, listen to what you like the way you like it, only if it dissatisfies you or you hear something you like more should you change it. I like my vintage equipment and i'll stick with it, regardless of what people say, it was made in a different age where things were engineered to last and a dynamic sound was the goal. I will never go tubes as i think they are an outdated technology that is a waste of money. (a tube amp is one big tone control that imparts a big effect on the sound, you either love it or hate it) I'd never knock anyone who likes them though.