From the docs (but not actually messing with any actual parts), it looks like the 8266 has an IPv4 stack in ROM.