Except substitute “down the street” with “30 km away on the other side of a river”, and notice that everybody who got sick initially was next to the market, none of them anywhere near the lab.

So the lab-leak hypothesis is: this virus created at the lab accidentally escaped to someone who subsequently only infected people on the other side of town.

It’s certainly a possibility (viral transmission is irregular with high variance, and people can easily travel that distance), and the lack of transparency by the government is alarming (though not particularly surprising to folks studying China), but most of the experts who have studied it still think it’s relatively unlikely.