https://tweakers.net/pricewatch/ is also a great example of this. No idea how they do it.
But they all come at some cost - my employer decided to cheap out slash invest in a highly custom in-house solution instead that relied on lots and lots and lots of data entry.