Coming from a Pixel 3, I don't think the Note is any better or worse in terms of speed/smoothness. Android in general has never been quite as smooth overall compared to iOS, although I wouldn't say it's slower it's just the animations and scrolling always seem a little smoother. Maybe best trying one out in store to give you an idea of how it'll feel.
Playing around in a store isn't much fun, since demo phones always seem to have a big security thing attached to the back and a wire that sets off the alarm if you lift the device more than a few inches off its stand. The experience of other users is a good way to get answers and you've given your impression by comparing it to the Pixel 3 - cheers