Hey geekman. I'd disagree about the start of your statement/question. Most large capacity bikes that are built to go to high speeds are designed to be stable at those speeds. (Geometry, steering dampers and the like).
My bike can get to 175mph. I've yet to go that high, but it feels very stable and much nicer at 130mph (autobahn) than my Octavia MkI VRS, which is probably near it's operating ceiling at that speed. Whereas an M3 feels fine at 130mph. Stopping, turning etc. from these speeds, all fine. Wind? Remember most cars are a big sail for a cross-wind. Bikes are a much smaller one, often with multiple holes going through them.
My old SV650 (apparently it'd do 120ish, I forget) felt a little less confidence-inspiring at 100mph, but much happier than doing 100mph in a little Corsa or Saxo.
Re your last part about doing high speeds because you can, I disagree again. There's something about knowing you have that power, and not having to use it all the time. It's like the cars you see flying along in the outside lane of the M40, I see diesel commuters, miniature city cars going all out. I look to the inside lane and see the 360s, R8s etc.
As I think has been said, going fast isn't all that exciting, getting there is, going round corners etc. is far more fun.
For sure I can understand the people who give lack of self-restraint as a reason, but maybe that's something to work on to help avoid killing yourself in some awesome double-flip rolling fireball crash off the side of the M4 elevated section

.