"To the topic of site speed, is it really an issue to non-web-geeks? Do normal users of the web really know what a slow website is?"

My lord, yes. Here's a really interesting post/study with Bing and Google testing the user/business impact of speed.

http://radar.oreilly.com/2009/06/bing-and-google-agree-slow-...