Doesn't sound right, they're renowned for being very efficient and very quiet.
I use a Zalman CNPS9500-AT on a Core2 Duo E6600 running stock 2.4Ghz. With the fan turned to minimum using the included Fanmate it's very quiet and more than adequate whatever I throw at the CPU. If it wasn't for the graphics card it'd be barely audible at 1m.
Personally i'm replacing my system with a Media Center so i'm looking for absolute silence rather than very quiet, and to this end I'm also switching my HD4850 to a passive version.