Modern linguistic formalism is not derived from written language at all. I studied at MIT and UConn in the mid '90's and the separation between prescriptive grammar and linguistics is pretty clear.
That's not to say that current approaches to linguistics are correct; I don't know enough to make that judgement. But I think the problem lies more in the complexity of the domain - not because modern linguists are so foolish as to base theory on written language.