Is that how is's supposed to work? Because any time this happened in the past to a site where it is overcrowded and the Cloudflare banner is showing, the 502 page is showing as well, so I thought it's part of the Cloudflare error page?

No, it's not a snapshot of the 502 page, because I see my own IP there.