You can, but then you're limited to a single font format and you would not gain any benefits from the browsers' ability to download in parallel.
A lot of this will improve when HTTP/2 becomes more common (you can push resource to the browser and parallel downloads will become more efficient).