The home icon only appears next to the refresh button when you have a "home page" configured. It is separate from the New Tab page.

It's a setting. You can enable the home button and then set it to be a custom address.