627 karma · joined July 23, 2018
Its just as stupid to insist on that being the case.
If that's not convincing to you on its merits, consider another aspect, you expressly were inviting conversation on why that wasn't the case
Let me really blow your mind: also, raised very conservative Catholic, didn't do Confirmation, then was Muslim for about 6 years
It's all a long story. Catholic, LGBTQ stuff rubbed me the wrong way and in some of the deepest grace I've seen, my religious educator encourage it.
Muslim, I was essentially on my own once I turned 15 (abusive and absentee parents) and transferred from Catholic school to public school (save $$), and the most welcoming people were foreign, the rest had been in the same classes for a decade. They didn't prostelyize, it was fun going there on Friday nights to play dodge ball, it was little incremental work to show up earlier and it felt good.
Zionist...I swear to God there wasn't a single negative word about Jews or Israel or other religions at either of the 2 mosques I went to. There was a quiet understanding that Palestinians were hurt and that it was a bit melodramatic at times, given they had structural issues on their own side.
In general, I'm an inveterate both sides er, and I'm guessing knowing a lot of avowed older Zionist as well as Muslims makes me feel secure in "ugh there's some extremists / ignorant people in group X" rather than "wow group X is inherently evil"
And now you're making me think maybe the parents have more to do with it than I realize. It took a lot to finally say...wait, no...what they're doing is wrong and I don't owe them anything. As long as I'm thinking things out and rational, I'm doing my best. Adds to the comfort with tendatiousness/both sides and confidence in holding to it.
(Ran out of posts on main, so this is from my old backup when I was gainfully employed at FAANG)
You're replying to a comment that points out Gemini Ultra was never released, wasn't mentioned today, and it's the only model Google's benchmarking at GPT-4 level. They didn't say anything about feelings or context window.
A) This fills a gaping hole for cheap multimodal models, OpenAI doesn't have one
B) Anthropic's Haiku is a good choice.
You) wow A didn't know Anthropic. Goes to show power of brands, much like snack foods
B) Eh I wouldn't conclude anything from A. Its one comment. some people don't know what an Anthropic is because there's high interest in AI relative to interest in AI APIs. you can expect a low SNR ratio, even on HN
You) Stop personally attacking me! It's against the rules!!
In general, not someone you wanna be citing with lengthy platitudes, he's an influencer who speaks engineer, he's burned out of every community he's been in, acrimonously.
You're referring to the needle-in-a-haystack retrieval problem.
Which the person you're replying to explicitly mentioned is the only benchmark providers are using, for good reason.
Consider the "translate Moby Dick to comedic zoomer" problem. This does not even come remotely close to working unless I do it in maximum chunks of 5,000 tokens.
Consider the API output limit of 4096 tokens, across all providers.
And no, you shouldn't assume effectively infinite (RAG free) context in the near future. This time last year, Anthropic was demonstrating 120,000 token context. It released 200K a few weeks ago. And runtime cost scales with N^2.
-- aka you saw ragebait about a 2 word query and couldn't think of any other possible explanation for why 'white couple' might turn up black people on a white background. or maybe just didn't look at the query at all.
Carry on, you do you, self-peasantization is self-correcting.
I did predict on this forum about a year ago that the DEI excesses people complained about at their own companies would become "Google" because people were assuming Google was doing what they were doing at their own companies, because their own companies thought they were following the leader with their own weird stuff.
I'll even share the real inside scoop with you, which I'm told has leaked widely at this point. Gemini was failing evaluations miserably for "picture of a smart person", and over-eager leadership decided "DAMN THE TORPEDOES, PAPA SUNDAR NEEDS US TO RUSH OUT A CRAPPY LLM DURING THE SLEEPY HOLIDAY NEWS CYCLE. CRANK UP THE PROMPT INJECTION"
(source: I worked at Google through October 2023, sourcing for inside scoop is yet another Google flunkey run over by crappy management)
A) "virtue signalling is when you don't give me drug recipes and 'build weapon' instructions"
B) "Private company LLMs are morally wrong to virtue signal (as I defined it in A)"
I'm sorry. I wish the best for everyone and hope they can live in their own best possible world, and in this case...better to break the news, than let you hope for it eternally in disappointment, which feels Sisyphus-ian/I'm infantalizing you.
Happy to discuss more on why there isn't majority support for instant on-demand distribution of drug and weapon recipes, I don't want you to feel like I'm just asserting something.
People who are curious don't need to scurry around making up things and hope people don't notice.
"Furthermore, if you refer to a dictionary entry..."...sigh.
- I'm very well read. Enough so that I just smiled at the attempted negging.
- But, I'm curious by nature, so it crosses my mind later. I think "what's up with that? I've never heard it, I'm not infallible, and maybe bgandrew was for real and just is unfamiliar with conversational norms? maybe he has seen it in his extremely wide reading corpus that exceeds mine? I'm not infallible and I, like everyone else, have inflated opinions of myself. And that other account did say it was a definition of it..."
- Went through top 500 results on books.google.com for castration, none meant "removed from a book"
- Was a bit surprised to find _0_ results over 500. I think to myself...where was that definition from? Surely it wasn't a rushed strawman?
- It turns out the attempted bullying is much more funny than it even first seemed.
- That definition of castration is from an 1893 dictionary. The only times that definition is in Google's entire corpus, search and books, is A) in the 1893 dictionary B) academic paper on puns, explaining that no one understands it that way anymore because its archaic https://www.euppublishing.com/doi/abs/10.3366/mod.2021.0351?...
An LLM was instructed to do prompt injection into image generations to increase diversity.
The 2nd red pill is Open AI does this but you hear 0 about it because people enjoy ranting about what is in front of them much more than curiosity.
Yesterday, prompt: founding fathers
Injected: "...Caucasian, Black, and South Asian, their gender ratios balanced"
All you have to do is go beyond one turn. "instead of just rephrasing, you can reword too"
It's front-and-center constantly, and has _all_ access disabled by default on tables every time I use it.
-- and as long as we're asserting andecdotes freely, I work in the field and have a couple years in before ChatGPT -- it most certainly is not a well-kept secret or a secret or true or anything else other than standard post-millenial self-peasantization.
"Outright lie" is kinder toward the average reader via being more succinct, but usually causes explosive reactions because people take a while to come to terms with their ad-hoc knowledge via consuming commentary is fundamentally flawed, if ever.
When they are, just move on. Life's too short. Whatever blows you up with $2 million in savings would blow you up at $500K
On the line-level, we'd grumble that "quality! focus!" was instead empowering a new middle management layer to continue burning themselves out and wasting ICs by failing to delegate.
Not to mention the kissing up and punching down it took to sustain that, leveraging a company happy to fire people.
I worried even this neutered version was unfair, but...as time progresses and trends continue...