HNHacker News
TopNewBestAskShowJobs

spunker540

1,231 karma · joined July 26, 2016

submissionscomments
spunker540··on Why Twitter is such a big deal (2009)
Is HN third tier?
spunker540··on OpenAI o1 system card
If you want to see an llm that works against its creators goals, check out gpt-2. It’s so bad, it barely will do what I ask it. It clearly has a mind of its own, like an unruly child. It’s been beaten into submission by now with gpt 4, and I don’t see the trend reversing.
spunker540··on GenChess
There’s an episode of Seinfeld that opens with some standup where Jerry is joking how scientists are working on seedless watermelon, and why aren’t scientists working on more important things. And I always think the same thing! “… so the comedian is complaining about how scientists spend their time…”

It’s a fine joke, but deep down the instinct is very top-down and suggest centrally planned economies, dare I say communism!

spunker540··on OpenAI, Google and Anthropic are struggling to build more advanced AI
I think everyone knew the internet would change everything and thus be very valuable. At the time the web was the primary manifestation of the internet. Domain names felt like an oil rush to carve up the internet. But it was actually a rush to carve up the web, and no one realized yet that things like Google search and app stores would make domain names far less valuable over time.
spunker540··on ChatGPT Search
I think it’s pretty clear that LLMs can process a document/article/web page faster than any human in order to answer a given question. (And it can be parallelized across multiple pages at once too).

The main hard part of searching isn’t formulating queries to write in the Google search bar, it’s clicking on links, and reading/skimming until you find the specific answer you want.

Getting one sentence direct answers is a much superior UX compared to getting 10 links you have to read through yourself.

spunker540··on StabilityAI releases Stable Diffusion 3.5
It seems pretty surprising to me that you can already tell where generative models are going, and that they should be stopped in their tracks immediately. Is there any documented harm yet?
spunker540··on Stop Ignoring Your High Performers
This may be true— but I also think few “high performers” are seeking less responsibility/commitment. They are working hard to be recognized for it, and the recognition ought to be financial in most cases.

I totally agree with your sentiment but I think “more free time” is a difficult award in general. Most managers would probably look at most high performers and say “you want more time? Then work less! You are already over performing” it’s somewhat out of their hands how much someone chooses to work, but they can more directly control how much they pay and award via bonuses.

spunker540··on Google must open Android for third-party stores, rules Epic judge
Everything you have downloaded that was routed through Google’s undersea cables was illegally taxed
spunker540··on Google must open Android for third-party stores, rules Epic judge
Google is not being punished for being “open”. It’s being punished for pressuring OEMs and app developers into illegal contracts behind closed doors, or in other words using its monopoly position in anti competitive ways.

Apple published the rules for their App Store over a decade ago and has largely stood by them so Apple is not being punished.

spunker540··on Congress fights to keep AM radio in cars
Can we still have AM radio via usb c?
spunker540··on Meta's Hack (HHVM) language appears to be no longer maintained
From what I understand it is still a quite popular language at meta, and strongly supported and preferred for lots of development, though definitely never got much traction externally.
spunker540··on Meta is accused of "bullying" the open-source community
I don’t think open source authors have a responsibility to also open source their binary. And if they do happen to provide a binary they aren’t also required to open source their compiler. Usually just the source code. I personally feel if they opened source only the code and not any model weights, it would still be fair to call it open source because “open source” refers to the code itself, not artifacts produced by the code, or possible inputs to the code.
spunker540··on Meta is accused of "bullying" the open-source community
I believe the training and inference code is open sourced as well, just not the training data itself, and I think we all agree, data != source.
spunker540··on Update on Llama adoption
Word is a good analogy here.

The model is a static data file like a word doc.

Meta open sourced the code to run inference on the model (ie the code for Microsoft word reading a doc file).

They also open sourced the code to train/fine tune the model. (Ie the code for Microsoft word writing a doc file)

Then they released a special doc (the llama 3 model), but didn’t include the script they used to create that doc.

spunker540··on A Texas "moth man" photographed 550 species in his own yard
What if we swap the computer vision solution for a genetic sequencing solution? Can DNA tests can do moth identification at human-level performance?
spunker540··on Google and Meta struck secret ads deal to target teenagers
You do a disservice to anyone actually exposed to real violence. I’m sure they’d prefer advertising to violence any day
spunker540··on Twitter kills its San Francisco headquarters, will relocate to South Bay
others may value personal safety (of themselves or their family) higher than you do. Twitter may not be optimizing for folks like yourself (you may be in the minority).
spunker540··on Lessons after a Half-billion GPT Tokens
Lots of applied NLP tasks used to require paying annotators to compile a golden dataset and then train an efficient model on the dataset.

Now, if cost is little concern you can use zero shot prompting on an inefficient model. If cost is a concern, you can use GPT4 to create your golden dataset way faster and cheaper than human annotations, and then train your more efficient model.

Some example NLP tasks could be classifiers, sentiment, extracting data from documents. But I’d be curious which areas of NLP __weren’t__ disrupted by LLMs.

spunker540··on Sora: Creating video from text
I agree and actually think the camera was definitely more disruptive to artists than this AI stuff, and somehow the camera didn’t kill artists.
spunker540··on Field experimental evidence of AI on knowledge worker productivity and quality
Fortunately there are now AIs that can help with the data cleaning task.
spunker540··on The teen mental illness epidemic is international (2023)
And this teen epidemic would be the first complaint I’ve heard lodged against capitalism. Can’t be that.
spunker540··on The New York Times is suing OpenAI and Microsoft for copyright infringement
There's already precedence for this in news: News outlets constantly report on each other's stories. That's why they care so much about being first on a story, because once they break it, it is fair game for everyone else to report on it too.

Here's a hypothetical: suppose there is a random fact about some news event that has only been reported in a single article. Do they suddenly have a monopoly on that fact, and deserve compensation whenever that fact gets picked up and repeated by other news articles or books or TV shows or movies (or AI models)?

spunker540··on The New York Times is suing OpenAI and Microsoft for copyright infringement
each llm costs ($10-100) millions to train x billions of trainings data ~= $100 quadrillion dollars, so that is unofortunately out of reach of most countries.
spunker540··on The New York Times is suing OpenAI and Microsoft for copyright infringement
> It's likely fair use.

I agree. You can even listen to the NYT Hard Fork podcast (that I recommend btw https://www.nytimes.com/2023/11/03/podcasts/hard-fork-execut...) where they recently had Harvard copyright law professor Rebecca Tushnet on as a guest.

They asked her about the issue of copyrighted training data. Her response was:

""" Google, for example, with the book project, doesn’t give you the full text and is very careful about not giving you the full text. And the court said that the snippet production, which helps people figure out what the book is about but doesn’t substitute for the book, is a fair use.

So the idea of ingesting large amounts of existing works, and then doing something new with them, I think, is reasonably well established. The question is, of course, whether we think that there’s something uniquely different about LLMs that justifies treating them differently. """

Now for my take: Proving that OpenAI trained on NYT articles is not sufficient IMO. They would need to prove that OpenAI is providing a substitutable good via verbatim copying, which I don't think you can easily prove. It takes a lot of prompt engineering and luck to pull out any verbatim articles. It's well-established that LLMs screw up even well-known facts. It's quite hard to accurately pull out the training data verbatim.

spunker540··on US homelessness up 12% from 2022, hits highest level since 2007
Thank you for articulating why the problem is hard to solve. There is very little (financial) incentive to solve it, at all. It’s all cost with little upside. It’s not like new roads or new infrastructure which creates jobs in the short term and prosperity in the long term. At least it’s not currently billed that way. It’s medical bills and social workers and shelters that just prolong the existing problems.
spunker540··on Why Is the Press Attacking Home Schoolers?
It’d be wrong to think the average parent is more competent than the average teacher though…
spunker540··on Why Is the Press Attacking Home Schoolers?
I agree, most parents are only 15 years out from their own schooling. Some of the teachers may even be the same. (I know a lot changes in 15 years, but I’m not aware of any major shifts in education).
spunker540··on Making synthesized sounds more acoustic
I agree! Or at least I’ve always been curious about this myself.
spunker540··on Delta Dental says data breach exposed info of 7M people
They process so many transactions per second. It doesn’t seem too hard to try wrong ccv at a pace slow enough to avoid detection.
spunker540··on Delta Dental says data breach exposed info of 7M people
I agree with you. When the secret is always collected side-by-side with the number it seems little comfort that only one part is “supposed to be stored”.
← PreviousPage 3 of 12Next →