701 karma · joined March 26, 2015
There is definitely a place for LLMs in solving this problem: in taking over for the human in interpreting the business goals/data to gather along with the available data on the web, but my experiments have shown that this is a significant problem due to limited LLM context length and difficulty distilling messy data. But, very excited to keep pushing, and seeing where things go :)
Note: I build https://www.thoughtvector.io/pointscrape/ to solve very-large-scale web-data gathering problems like these.
https://www.thoughtvector.io/vertext/
There's all kinds of fun stuff you can learn, like apparently Instagram just ratcheted up the number of ads shown and people don't like it. You can see different text topics people mention, and select time ranges in the volume and rating over time charts to filter.
You can look at other iOS apps too, just by adding the app ID in the search params. This page shows DoorDash's reviews:
https://www.thoughtvector.io/vertext/?app_id=719972451
It's still very much beta-level in terms of all the things I want in there, but it's been a fun distraction so far!
The world has been sleeping on leveraging NLP, given the incredible amount corporations spend paying people to read and summarize text (answering questions like "How many people are having a bad search experience?", etc). The recent leaps in NLP make for many opportunities, and many products are coming to market that allow even non-technical folks to train and utilize text classifiers. If you're thinking about getting into NLP, now is definitely the time to do it.
Source: founded taggit.io
Traditionally, this interpretation has been done wholly by humans, and was a long and laborious task. However, we can now do much of the manual work with NLP [1] - discovering topics of concern and measuring the prevalence and sentiment. This lets us ask the dataset useful questions, like "What issue is angering customers most?", and "What features should we be talking more about?"
It's a move towards a much, much wider sampling of customer experiences (compared to focus groups), and I think it should be celebrated for empowering companies to make products/services that consumers really, really like.
for idx, genre in enumerate (list_of_genres)