Coffee is practically free. Staff is somewhat expensive. Rent is extremely expensive. The rental rate for fully furnished ~25 square feet (table, chair, some personal space) is higher that two lattes per day.
I ran a cafe for three years (the slashRoot tech collective in New Paltz - maybe some NYC folk here came there?), and the cost of coffee (and milk) for us was non-negligible.
We were paying $8/pound for one locally roasted variety; $9 for another.
We also served entirely local or organic milk.
Our rent was $1950 plus utilities.
High-end coffee joints pay a fair bit for ingredients.
We were open from 2010-2012.