the biggest downside is probably that if you tend to forget passwords, then if you do forget that one, you will not be able to recover your data.