Disable remote maintenace / web access. Many router web UIs have exploitable flaws that can be used to bypass password authentication.
Ensure that you are always running the latest firmware version. If there are no up-to-date versions / the router is too old, you might complain to the ISP. However, they might try to sell / rent you the latest and greatest router model then.