HNHacker News
TopNewBestAskShowJobs

groceryheist

359 karma · joined August 26, 2015

https://teblunthuis.cc
submissionscomments
groceryheist··on Discord is laying off 17 percent of employees
Official USA inflation numbers ticked up slightly in December.
groceryheist··on Discord is laying off 17 percent of employees
Yes. It is time for laid off seniors to take these exit packages and incubate the next generation. Be ready to draw financing when rates fall in Q3 of 2024.
groceryheist··on NY Times copyright suit wants OpenAI to delete all GPT instances
Yes, of of the hard and interesting legal questions is if creating a possibility of such attacks constitutes a copyvio.
groceryheist··on NY Times copyright suit wants OpenAI to delete all GPT instances
I agree that this sketch comes closer to working in practice than simple RLHF. In my earlier comment I was imagining bringing in some auxiliary data like you describe to detect plagarism and then using RL to teach the model not to do it.
groceryheist··on NY Times copyright suit wants OpenAI to delete all GPT instances
Yes and the fact that the number of unique phrases grows so quickly with n is why the bloom filter needs to grow so that hashed n-grams don't collide.
groceryheist··on NY Times copyright suit wants OpenAI to delete all GPT instances
The LLM users/middlemen pay. The user probably pays less than they would have to pay the author. The LMM provides information retrieval / discovery.
groceryheist··on NY Times copyright suit wants OpenAI to delete all GPT instances
The number of unique values in the bloom filter will go up ~exponentially with n. So to control the false positive rate the bloom filter has to grow.
groceryheist··on NY Times copyright suit wants OpenAI to delete all GPT instances
Maybe the bloom filter solution is enough, but I wonder.

- Paraphrasing n=7 words (and quite a few more) within a sentence can easily be fair use.

- As n gets big, the bloom filter has to also.

If/when attribution is solved for LLMs (and not fake attribution like from Bing or Perplexity) then creators can be compensated when their works are used in AI outputs. If compensation is high enough this can greatly incentivize creativity, perhaps to the point of realizing "free culture" visions from the late 90s.

groceryheist··on NY Times copyright suit wants OpenAI to delete all GPT instances
The suit demonstrates instances where ChatGTP / Bing Copilot copy from the NYT verbatim. I think it is hard to argue that such copying constitutes "fair use". However, OAI/MS should be able to fix this within the current paradigm: Just learn to recognize and punish plagiarism via RLHF.

However, the suit goes far beyond claiming that such copying violates their copyright: "Unauthorized copying of Times Works without payment to train LLMs is a substitutive use that is not justified by any transformative purpose."

This is a strong claim that just downloading articles into training data is what violates the copyright. That GTP outputs verbatim copies is a red herring. Hopefully the judge(s) will notice and direct focus on the interesting, high-stakes, and murky legal issues raised when we ask: What about a model can (or can't) be "transformative"?

groceryheist··on Eltanin Antenna
Thanks for pointing this out. It would be nice to have a public domain or creative-commons licensed image to use instead.
groceryheist··on AI Company Plans to Run Clusters of 10k Nvidia H100 GPUs in International Waters
Let's float all these scarce and valuable resources on a barge in international waters and claim to be a sovereign state. Very nice way to organize donations to pirates!
groceryheist··on Graph of Thoughts: Solving Elaborate Problems with Large Language Models
Intractable. Only the simplical complex of thought provides the optimal balance of expressiveness and constraint.
groceryheist··on What comes after Zoom? (2020)
Cory Doctorow
groceryheist··on Subreddit Migration Directory
Can't you just follow them all from a 3rd server, even a mastodon server?
groceryheist··on What is really going on at Amazon Fresh?
You've never checked a receipt on your way out of the store to make sure you weren't charged for anything you didn't purchase?
groceryheist··on Iran Votes to Execute 14k Protesters, Says Rebels Need 'Hard Lesson
Mass executions lead to only 2 outcomes: total fear or total war.
groceryheist··on Iran Votes to Execute 14k Protesters, Says Rebels Need 'Hard Lesson
If true, (is newsweek a reliable source for Iran coverage?) this would be an immensely risky and possibly stupid move. If they will kill you for protesting what deters you from terrorism and assassination?
groceryheist··on Ask HN: Have you stopped reading most news?
> There is literally nothing that happens if I know what’s going on there.

> Nothing at all. It distracts me from my family, friends, work, and myself.

> I have no interesting insights or original thoughts about it, and if I did,

> absolutely no one would care. So why read it?

Do you vote or participate in politics in any way or do events in the news directly affect your life? One reason it's rational to read the news: If you don't read the news, then you're at risk of lacking important contextual knowledge about society and social norms. It's pragmatic to keep track of these conversations to avoid embarrassment and to not behave in ways that might offend others. I find it useful to be aware of contentious issues on which I might have a side or a stake.

groceryheist··on Effect of Colonoscopy Screening on Risks of Colorectal Cancer and Related Death
Sensationalist title to a good news story: there was no intent-to-treat effect, but a low conversion rate. The ETT is a pretty impressive 50% mortality reduction. Also study is limited by a short 10 year follow-up period but there will be a 15 year follow up.

So I'll still get my colonoscopy, thanks

groceryheist··on Evolution Through Large Models
Its "evolution" in the sense it's an attempt to apply concepts from evolutionary theory to engineering problems and the principles of biological evolution are similar in the abstract.
groceryheist··on Toxic Positivity
Completely agree! This was disjointed and didn't have a point. Wish I could downvote.
groceryheist··on Off-Grid Cyberdeck with RPI and Pelican Case
I think that information about topics ranging from plants, agriculture, medicine, chemistry, mechanics, historical technology would be really valuable. My previous comment is somewhat overstated. Instructional material on fashioning and using specific survival tools or accomplishing survival-essential tasks would be really important!
groceryheist··on Off-Grid Cyberdeck with RPI and Pelican Case
An offline copy of wikipedia would be the next most important thing to membership in a community.
groceryheist··on James Webb: 'Fully focused' telescope beats expectations
Can somebody explain why there are 6 lines coming from the center of the star? Is this an artifact of the hexagonal submirrors? I had the impression that these would form a "perfect" mirror with the alignment finely tuned. Was I mistaken?
groceryheist··on Reddit can't build a better search engine
My dissertation was about point #2.
groceryheist··on A dubious writing style emerging in science
I'm dying. Table 1 is incredible. It's machine learning jargon from a parallel universe. "counterfeit consciousness" "fog computing" "information stockroom" "profound neural organization" "credulous Bayes" "mean supreme blunder"
groceryheist··on Scripps O2 Global Oxygen Measurements
The striking thing to me about this is the sensitivity of the instrument.
groceryheist··on Apache Arrow 3.0
You can configure Spark to use arrow for passing data between Java and Python via spark.sql.execution.arrow.pyspark.enabled but yes, Spark uses Java datatypes internally.
groceryheist··on The Moral Case for a Wealth Tax Has Never Been Clearer
What's the root cause of inequality? There are certainly historical causes of inequality (e.g. slavery, feudalism, colonialism). These root causes are largely in the past, though they have modern residues (e.g. racism, sexism, western chauvinism) which contribute to inequaliy. I think they are often less important than how already existing inequality is amplified by cumulative advantage dynamics (the rich get richer). A wealth tax directly reduces the amplification and wealth can be redistributed to reduce inequality (not just of wealth, but of education, skills, and status too) on the other end.
groceryheist··on Florida Agents Raid Home of Rebekah Jones, Former State Data Scientist
Boo gatekeeping. Knowing how to learn from complex data is the key competency!
← PreviousPage 2 of 4Next →