Were you staying in Shinjuku or Shibuya? Those areas can get particularly dirty in recent years. I think overall Tokyo is still pretty clean in comparison from other places I've lived or traveled though.