Ask HN: What are the implications of taking my current job abroad?

I've been thinking of packing up the whole family for the summer and working from somewhere else. It would be 100% vacation for them, and would be vacation for me after work hours and weekends.

What are some of the implications of doing this? Is it strictly legal? Is there anything specifically which needs to be reported? Time limits? Specific regions which are more open to it? Taxes, etc...

I'm in the US, but I'm sure others might be interested in the flip side.