You need to build a crawler: https://en.wikipedia.org/wiki/Web_crawler