Oh yeah, no doubt. That 500 sq ft would be for 1 under normal circumstances, and would need to be heavily optimised for supporting 4 people.
As it stands US Department of Agriculture says that 120 sq m is enough for a family of 3 - thats using conventional gardening techniques.