The Saved Address is what you let Chrome store to automatically fill forms. It's not your addresses in your Google Account. These are different things.