I mean that's a bit over-simplistic... It's not that a nonchicken lays a chicken egg, that implies an either/orness of chickenhood that would be radically unique. What actually happened was that at around 10,000 years ago a group of birds similar to modern red junglefowl either migrated or was forcibly taken from northern Thailand to the Indian subcontinent, where they started mating with the local birds similar to grey junglefowl with whom they were still able to interbreed. If you call those each 99%-chickens each then you had a steady meeting of two 99%-chicken lines interbreeding until they formed something steadily closer to our 100%-chicken lines, but presumably also creating 98%-chickens etc. in their breeding population. The variation inside the breeding population is larger than the distance of the progenitor populations to the final result.
Viewed this way, what actually caused chickens to happen was the migration, not the genetics. It was the part where the two red junglefowl groups came out of genetic contact and started to diverge. On the assumption that these red junglefowl were adults (which is obvious if it was a migration, but merely likely if it was forced by humans), this means that a population of non-chickens was divided into two subpopulations, one of which was chickens, one of which wasn't.
So even agreeing that we should categorize the egg by the creature it produced immediately after hatching, you still get by this argument that a nonchicken egg hatched into a nonchicken which by circumstance became a chicken... Chickens came first, and then their chicken eggs.