I'm surprised to hear a native Californian would say "back east." I thought only people from the East Coast (or I guessed who lived there at one point) would go "back."
The underlying source is the idea everyone is somehow "from" the east, and they (or their ancestors) at one point moved "out west", but if they were to return, it would be to go "back east."