wget does this automatically, in case grandparent doesn't know. I'm not going to try it (because I'm not going to analyze the results myself, so it would be wasteful), but I think "wget -r news.ycombinator.com" would take care of this... It will not visit external links without the --span-hosts parameter (I believe).
How come that comes up with a Content-Type: text/html header?