I've got a virtually identical Nokia smartphone and I haven't noticed any real speed issues (compared to my older 6680 and 7610 smartphones). If you're coming from a non-smartphone, you will probably notice a slight lag but nothing that doesn't affect any smartphone.
We're still waiting for Tom Tom to support the N80. It's only a matter of time though.