You can say the same thing about RNNs. Technically nothing is turing complete without infinite scratch space.