You do know the referer header is optional don't you, I mean, you'd look pretty dumb relying on it for any web service because, you know, some crazy people turn them off altogether, perhaps with the Firefox add-on RefControl.
You will always be able to export the CSV version of your Gmail address book yourself and feed it wherever you like. It's just slightly less convenient and the experience is not so smooth anymore.