> Is it ethical to scrape things, trying to bypass prevention methods, against the expressed wishes of a site?

No, but many sites only allow Google to index them now.

I don't think that was the original plan for the web.