It retains past passwords. Open the entry in the Passwords app and then scroll down to "View History" button.