HN doesn't seem a significant threat:
As an anecdote, I was using Digg substantially up until the 2008 elections. I haven't used the service since then. Instead, I'm spending time on Hacker News (+ Techmeme, Twitter, Facebook).
HN is a niche social website and I don't think that it eats from Digg or any other social website.