If you were to transfer the posts to the hep-th mailing list or something, it'd be very bad content, and vice-versa. As it stands, I imagine when people go to 4chan they tend to get exactly what they want.
I would also guess that the average 'smartness' level is a lot higher than you might think.