This is a good overview:

https://en.bitcoin.it/wiki/Block_size_limit_controversy#Argu...

There's a bunch of political reasons on both sizes as well.