In light of PRISM I would argue that the opposite is true: "the ability / freedom to not be connected is a human right".
(see what I just did there?)
https://news.ycombinator.com/item?id=6248089
Given what you know, you may recuse yourself. Others are not afforded that decision. Even at a cost.