I usually recommend people make it through season 2 before deciding they're in it for the long haul (bearing in mind that 2 seasons is already quite a haul, especially for such a dense show). It's my experience that people get turned off by the jump from the expected gangsters-and-cops to the more "boring" Longshore men storyline (though like many, I appreciated season 2 a lot more in retrospect).