1,366 karma · joined August 5, 2020
1.66 billion monthly users
430 million monthly users
50 million monthly users
330 million monthly users
Who the hell knows.
I've heard this, and was just reading a thread on Reddit where many users told of their mistreatment and unjustified banning. But anecdotally I've never actually noticed mod misbehavior, and I've been a Reddit user for like 17 years. Could be the subs I read ... most of which aren't extremely huge, I guess. Still, I feel like I should have been banned from somewhere at some point if capricious, power-hungry mods really were as rampant as they're made out to be.
It could all go super well and everyone forgets about this shakeup, or it could engender further animosity and chase people (particularly trend-setting power users) to some other platform. It could also ruin some communities if the wrong new mods are chosen.
I’m not sure how likely this is but it is plausible.
If it could fit within the context length then you wouldn’t need to search it to find relevant portions at all. I’m talking about situations where you want to ask questions about a very long document, using the search approach, and one of those questions might be “please summarize chapters 2 through 8”.
The search method will never accommodate that, but a model fine tuned on your data might plausibly.
I’ve also found that GPT-4 tends to hallucinate when I ask a question but the search process doesn’t result in a good match. Like making up an author or title for a document I’m asking about.
I’m not saying this needs to be a clone of Reddit; I don’t think I implied that, or intended to at least.
> This means you’ll no longer have to add “Reddit” to your searches when you’re looking for thoughts from actual humans, not empty answers from websites just trying to get clicks.
https://www.theverge.com/2022/4/20/23034024/brave-search-fea...
> It turns out that almost 70% of polled readers add 'Reddit' to their search results at least sometimes.
https://www.androidauthority.com/reddit-web-search-queries-p...
I can’t say that it’s a substantial portion of Reddit’s traffic, of course. But clearly it’s not just a mrtranscendence idiosyncrasy.
I don't even know how to respond to this. Think about the implications of what you're saying: you can claim anything, and when you're challenged on it, you can say "just because I have no proof doesn't mean it's not happening". If you have no proof that bioinformatics professionals are being laid off due to AI, then why did you bring them up as an example?
> I'm pointing at a crack, and you are saying show me proof this crack will cause everyone in the valley below to die.
No, you're pointing at what you believe is a crack, and I'm saying "show me proof that what you're pointing at is actually a crack and not a trick of the shadows".
> Its a flawed way of thinking in many ways especially with fundamental things that we base our lives and welfare on (as a society)
I don't know. I'd like to think that with fundamental things we base our lives on, we should try to be as certain as possible that we're responding to the right threats. We don't typically base our response to threats solely on how severe the damage would be if the threat came to pass -- we also run analyses to determine how likely the threat is to happen in the first place. There's a reason we don't throw trillions at the problem of preventing an asteroid impact or the eruption of Yellowstone.
> the rate of change has been exponential even if you refuse to believe it
I mean, people say that. What I've seen is:
* the transformer architecture is invented in 2017
* it takes years to make a broadly useful text completer with that architecture
* over the most recent span of a year (gpt-3.5 to gpt-4) we've seen relatively minor improvements in capability
* gpt-5 isn't even being trained yet (at least as of April)
I see some advancements, but they're all about making smaller, less useful models run on commodity hardware. The hard work of making an AGI doesn't seem like it's going anywhere right now. The current approaches require too much data and too much compute to see large improvements, and new approaches -- which don't yet exist -- need to be developed.
My point is that I don't understand what using an LLM changes here. You'll still have to generate multiple candidate slogans, you'll still have to bring 10 of them to the account manager, you'll still have to discuss the possibilities with the customer and tailor the results to their needs. You'll still have to iterate. All an LLM can do is write the candidate slogans, and -- as of now -- it doesn't do a spectacularly great job at it. Very little actual labor is being saved here.
> currently the rate of change exceeds the rate at which we can evaluate the changes and thus take action
I dispute this. I believe we're seeing a plateau in capabilities, due to limitations of the transformer architecture and the massive, expensive amounts of compute it takes to create marginally better models. I don't believe we'll see anything like exponential growth in what LLMs can do.
But they don't do that in general. So where's ChatGPT going to save time? You'll still have to iterate, iterate, iterate, go back to stakeholders, discuss in progress work with clients, etc etc etc. I just don't see any reason to worry much in the short term, as long as you're working for a reputable company.
This may change eventually, but I foresee it taking several years at least. Progress isn't anywhere near as "exponential" as some camps claim.
Yeah, on synthetic benchmarks a higher-end MacBook Pro GPU compares favorably with recent Nvidia laptop cards (say, 4070 or so). But in games that drops off dramatically ... more like a 3050 or 3060 at best.
Mobile AAA games in the iOS App Store, or desktop AAA games in the Mac App Store? There are some AAAs that work on a desktop Mac (e.g. Resident Evil Village), but it's not the norm at all. As for mobile ... modern mobile games can die in a fire for all I care (as they're 95% gacha nonsense).