Hacker News Reader

I would have thought "first off" came from "first of all". I.e. of all the points I'm about to make, this is the first.

There is a saying “first cab off the rank” or “first off the mark” (as in running races) so it may be a shorter version of something like that.