I don't think there is a lot left to get out of the Titans either.
Having said that the number SMX modules available do scale very well.
If you compare a Titan to a GTX 690 for SMX modules it comes down to 14 vs 16 (2 x 8 on the GTX 690).
An air cooled Titan overclocked has the same performance as an air cooled GTX 690 @stock in Heaven 4 (they both score just over 1600)
I have done these two pics to show the clock speeds in GPUz
GTX 690s @stock in Heaven 4
Single Titan overclocked in Heaven 4
As you can see the Titan is running about 100mhz higher than the GTX 690s.
My point is 14 SMX modules running an extra 100mhz higher give the same score in Heaven 4 as 16 SMX modules at the lower speed. When it comes to SMX modules and MHz they scale pretty good.
I know in the GTX 690 pic I am running 2 of them but it was not about getting a score, it was about showing the clock speeds they run @stock.