518 karma · joined November 18, 2022
A version of that argument applies to most things you would buy at a grocery store, e.g. modern apples are a lot sweeter than what our ancestors would've been accustomed to.
Fiction is not meant to perfectly replicate the entire complexity of the real world - rather it takes a very particular subset of reality and distills into a story you can consume at your leisure. This is true for both fictional and non-fictional settings - no movie set during e.g. WW2 or the French Revolution actually conveys the whole complexity of the real world at the time. Can you imagine a version of LOTR that also had to convey the all the socio-economic intricacies of trade routes between Gondor and Brie? Do you think that movie would be more enjoyable, or better at telling the story it wanted to tell?
The best worldbuilding is that which doesn't get into the way of telling a good story. This is why "remixing" is actually a storytelling virtue - GRR can point at Dorne and vaguely motion "bizarro Moorish Spain" and the reader will instantly get a better idea of what he's dealing with without having to read a 800-pager on Dornish culture and history.
This just sound like you need to follow better social media circles. There's a bourgeoning scene around people such as Gwern, Nick Cammarata, Aella with a lot of high-quality discourse on the topics you mention.
I highly recommend people saying stuff like this to actually try out the said lifestyle for an extended period of time.
* 2019 - GPT2 is presented to the public and demonstrates transformer-based LLMs and their emergent capabilities
* 2020 - GPT3 is released and shows that throwing more compute at LLMs yields significantly better LLMs
* 2022 - ChatGPT is openly released to the public, showcasing the versatility of an LLM-based chatbot
In my experience transformers have been all the rage in the researcher/enthusiast scene since 2019. The technology has just gradually matured enough to become viable for consumer use, which is why you see the industry rushing to adopt it. ChatGPT was the watershed moment for the tech because suddenly anyone in the world could sign up for free, open a chat dialogue and start getting legible LLM output without needing to understand the tech or prompt engineering.