At the time there was the argument that larger blocks were bad because they would increase the size of the chain and prevent casual users from storing the whole chain and verifying it themselves.

I think the chain was already too big for casual users at that point!