Memory has improved with DDR technology. (What are we up to now... DDR4?) Disk is improving with SSDs, which offer a huge speed improvement. If you've never used a box with a SSD in it, it must be seen to be believed.
But the real bottleneck I think is the Internet. Imagine what we could do with gigabit peer-to-peer IPv6 networks in areas like games, collaborative development tools, teleconferencing, etc. Things like virtual reality "metaverses" could really arrive, etc. These in turn would require more CPU power and parallelism. Super-fast gigabit+ WANs would deliver the killer apps that we need to keep pushing the speed barrier.
Once again, it is the Internet carriers that are the barrier to all progress. Breaking the telco oligopolies is the thing that must happen to unlock the future. Everything-- maybe even the continuation of Moore's Law-- depends on that. The telcos, cable companies, and wireless carriers are the trolls guarding the bridge to the future.