Today we'd include the GPU. If we include supercomputers, we really have to compare total global capacity, which is on the order of 1 million times that of 1997 [0]. That basically fits his trend line.
[0]: https://ourworldindata.org/grapher/supercomputer-power-flops