I doubt it would affect your speed much. How often are you able to utilise 1Gbps anyway?

Sure in theory you'd see a slow down, but given that most of the sites and service you use aren't able to deliver 1Gbps to you directly, the decrease in speed is most likely lower than you'd think.