The yakuza are more active in southern Japan, particularly Kobe and Kyushu, than in Tokyo, although they can certainly still be found in the nightlife districts.
In general, they're also far less powerful than breathless Western reporting (including Gibson's portrayal) tends to make them out to be, in part thanks to a persistent multi-decade police crackdown.