How can a chip support or not support IPv6 in this case? Isn't it a layer below anything which would require direct hardware support? In other words, wouldn't it be implemented in software. I should point out that I know nothing about the ESP chips.

Or do you mean that the ESP8266 has hardware acceleration for IPv4 but not IPv6?