It can be. If internet history is subpoenaed during the discovery process of a patent case it could be used against you.
I also am slightly annoyed that it was a direct link to a patent since there's really nothing good that can come from browsing patent applications on the legal side.
Infinging because you could be proven to have seen something (even by acceident!) feels like thoughtcrime.