That is incorrect. From the man page:
If enabled, history expansion will be performed
unless an ! appearing in double quotes is escaped
using a backslash.