Noticed the part where all it requires is to actually have the headers in the right location?
From https://news.ycombinator.com/item?id=46920922 discussion.
Yes, that is the case for pretty much every compiler. I suppose you could build the headers into the binary, but nobody does that.
If you copy the clang binary to a random place in your filesystem, it will fail to compile programs that include standard headers.