This particular buoy is in shallow water in waters with seagrass and run off from the land.

In general though, the ocean is _vast_ and stores a lot of heat, and changes temperature slower than the air does. When it's cold outside, the ocean radiates heat to warm the air and vice versa.