So when there are tens of thousands of these plugins how are folks expected to easily find/install them? Seems like same discoverability issue as the app stores.
As the answer would seem to be 'no' (crawlers can ignore robots.txt rules), I'm wondering if GPT is going to usher in an era where new content is simply not made available to view/crawl on the web. E.g. Want to know all the cool events happening this weekend in NYC? Ask our vertical gpt-chat site to find out.
Still playing with it but if it allows chat against a specific website/dataset that would be cool. I could see it replacing a mediocre site search on my hobby website for that purpose.