Quoting with a greater than sign, which is what I infer you are talking about, pre-dates 4chan by years. It was used on Usenet long before 4chan even existed.
Eric S. Raymond blamed it on an attempt to simulate having tabstops in every column, i.e. 1 character wide tabs.