I think it needs to be the 1st of April for it to be an April fools joke, right?
For most of us, yes. If Google wants to do an April fools joke on April 4th, all they need to do is edit the index so that the top result returned for "April fools date" claims that April fools' day is April 4th.
That would actually be a great April Fools' Day joke for Google, to change a few obscure indexes, especially one related to April Fools'.
I think initial reactions are rarely subject to sound logic.
They do have a tradition of making hard-to-believe announcements on April 1. Like the ridiculous announcement that they were starting a free email service that would give everybody a 1 GB storage quota.