HNHacker News
TopNewBestAskShowJobs

pr337h4m

4,486 karma · joined August 20, 2022

preetham<zero><four><zero><eight> @ the largest mail provider
submissionscomments
pr337h4m··on Should we tell people it's too late to save civilization?
>So obviously, infinite growth on a finite planet is impossible, yet most people deny this basic fact. The idea of modern civilization coming to an end is so unthinkable that they simply refuse to believe it.

Not gonna read the whole thing, but why would you think 'modern civilization' would be limited to one planet?

pr337h4m··on Meta's new AI image generator was trained on 1.1B Instagram and FB photos
> Creating a work using Harry Potter or Darth Vader or Tarzan is a copyright infringement

Transformative works are a thing:

https://www.transformativeworks.org/faq/#:~:text=investments...

https://www.transformativeworks.org/faq/#:~:text=Open%20Door...

pr337h4m··on The Bond villain compliance strategy
The Bank Secrecy Act, under which he was charged, is of extremely dubious constitutionality (https://www.coincenter.org/broad-ambiguous-or-delegated-cons...), and it certainly violates the spirit of the Bill of Rights.
pr337h4m··on Exponentially faster language modelling
This from DeepMind:

DiLoCo: Distributed Low-Communication Training of Language Models - https://arxiv.org/pdf/2311.08105.pdf

From the first author on Twitter: "It could quite a big deal for people who don't have access to a colocated cluster of GPUs:

e.g. with DiLoCo you could train your model, with data-parallelism, across all GPU providers, looking in real-time for the cheapest price, even if pre-emptable, even across continents"

https://twitter.com/Ar_Douillard/status/1724839420820361687

pr337h4m··on RedPajama v2 Open Dataset with 30T Tokens for Training LLMs
And moreover, what makes people even think that a desire to commit mass murder is an innate characteristic of an 'intelligent' being, that increases the more 'intelligent' it becomes? (If they believe themselves to be 'intelligent', do they believe they have a greater desire to commit mass murder?)
pr337h4m··on Executive Order on Safe, Secure, and Trustworthy Artificial Intelligence
First Amendment hasn't been fully destroyed yet, and we're talking about large 'language' models here, so most mandates might not even be enforceable (except for requirements on selling to the government, which can be bypassed by simply not selling to the government).

Edited to add:

https://www.whitehouse.gov/briefing-room/statements-releases...

Except for the first bullet point (and arguably the second), everything else is a directive to another federal agency - they have NO POWER over general-purpose AI developers (as long as they're not government contractors)

The first point: "Require that developers of the most powerful AI systems share their safety test results and other critical information with the U.S. government. In accordance with the Defense Production Act, the Order will require that companies developing any foundation model that poses a serious risk to national security, national economic security, or national public health and safety must notify the federal government when training the model, and must share the results of all red-team safety tests. These measures will ensure AI systems are safe, secure, and trustworthy before companies make them public."

The second point: "Develop standards, tools, and tests to help ensure that AI systems are safe, secure, and trustworthy. The National Institute of Standards and Technology will set the rigorous standards for extensive red-team testing to ensure safety before public release. The Department of Homeland Security will apply those standards to critical infrastructure sectors and establish the AI Safety and Security Board. The Departments of Energy and Homeland Security will also address AI systems’ threats to critical infrastructure, as well as chemical, biological, radiological, nuclear, and cybersecurity risks. Together, these are the most significant actions ever taken by any government to advance the field of AI safety."

Since the actual text of the executive order has not been released yet, I have no idea what even is meant by "safety tests" or "extensive red-team testing". But using them as a condition to prevent release of your AI model to the public would be blatantly unconstitutional as prior restraint is prohibited under the First Amendment. Prior restraint was confirmed by the Supreme Court to apply even when "national security" is involved in New York Times Co. v. United States (1971) - the Pentagon Papers case. The Pentagon Papers were actually relevant to "national security", unlike LLMs or diffusion models. More on prior restraint here: https://firstamendment.mtsu.edu/article/prior-restraint/

Basically, this EO is toothless - have a spine and everything will be all right :)

pr337h4m··on π in Other Universes
This is the sort of thing that makes me want to learn VR development.
pr337h4m··on How to Think Computationally about AI, the Universe and Everything
Computational irreducibility is a very useful concept; among other things, it is an elegant way to have free will in a deterministic universe.
pr337h4m··on Google paid $26.3B in 2021 to be the default search engine
>More people are going to notice they’re using a different browser vs. using a different search engine.

Chromium Edge and Chrome have pretty much identical UI/UX. If you switch between Google and Bing, you will immediately notice the difference.

>most people that have phones and not computers probably don’t realize or know how they can change the default.

"80.12% of iOS users, used Safari as their default browser as of 2020." Source: https://zipdo.co/statistics/apple-safari/

About 20% of users changing the default browser is a big deal, especially when all browsers are identical (WebKit) under the hood.

pr337h4m··on Google paid $26.3B in 2021 to be the default search engine
>The power of the defaults benefits google.com much better than it benefits Microsoft with browsers.

And that's simply because the delta between Google and the competition in search is greater than the delta between Microsoft and its competition in browsers

pr337h4m··on Google paid $26.3B in 2021 to be the default search engine
The power of defaults is heavily overrated: https://www.theverge.com/23935029/microsoft-edge-forced-wind...
pr337h4m··on 13 Other Explanations for Adolescent Mental Health Crisis. None Them Work
>In Gallup’s data, the average teen spends about 5 hours a day on social media

"Social media" is a super vague and amorphous term. Does it include platforms like TikTok and YouTube, which are closer to the "Television/movies" category? Even Instagram has largely pivoted to Reels and influencer content over pictures of your friends. The usage of "pictures/texts from your friends"-type social media is likely to have declined over the last five years.

>American teens are also less likely to say that there is a lot of competition for grades at their school, suggesting academic pressure has not ramped up in recent years

College admissions, which conventional wisdom advertises as the next step after high school and the only path to a successful career/life, has become vastly more unpredictable over the last ten years. The amount of work (extracurriculars, "volunteering", clubs) you're expected to do for your app to look good has also significantly increased, while the expected payoff remains the same or has decreased. (Even excluding this, zero-sum games over prestige are probably depressing on their own.)

pr337h4m··on Meta is banning people from advertising after running ads for Python and Pandas
>That’s right: I teach courses in Python and Pandas. Never mind that the first is a programming language and the second is a library for data analysis in Python. Meta’s AI system noticed that I was talking about Python and Pandas, assumed that I was talking about the animals (not the technology), and banned me.

If this is true, that is insanely embarrassing for a company that purports to be a sophisticated programmatic advertising platform.

pr337h4m··on DALL·E 3
Stable Diffusion is extensible - for example, ControlNet images have gone super viral on Twitter in the last few days. https://twitter.com/0xgaut/status/1702394230478360637 https://twitter.com/deepfates/status/1701055664603426970

Also, it's basically free if you own a Mac or an iPhone.

pr337h4m··on Nvidia on the Mountaintop
>The question, though, is what will be the analogy to mobile (and the cloud), which exploded demand and led to one of the most profitable decades tech has ever seen? The answer may be an already discarded fad: the metaverse.

People haven't really noticed that building a general-purpose (humanoid) robot has become 1000x more feasible now even compared to 1.5 years ago.

Check out https://www.lerf.io/ for a taste of the future

pr337h4m··on SpaceX working with Cloudflare to speed up Starlink service
>Starlink is one of a growing number of makers of small satellites that are focused on providing satellite-based internet, including Amazon.com's (AMZN.O) Kuiper, Britain's OneWeb and venture capital-backed Planet.

Planet is in the earth observation business, not satellite internet

pr337h4m··on The Pattern Language of Project Xanadu
"If we wanted to dial up the Xanadu-esque visibility, we could work on showing previews of the whole page and directing people to specific pieces of text within it."

It has been possible to link to specific pieces of text for a while now. For example: https://maggieappleton.com/xanadu-patterns#:~:text=If%20we%2....

pr337h4m··on The inability to simultaneously verify sentience, location, and identity
Counterpoint: https://www.schneier.com/essays/archives/2008/03/the_myth_of...
pr337h4m··on The lefty Europeans who want to deliberately shrink the economy
"At a three-day “Beyond Growth” conference held at the European Parliament in Brussels this week (and organised by 20 mainly left-leaning MEPs), an audience of youngsters whooped and cheered as speakers proclaimed that, this time, the limits of growth really have been reached. Driven by ecological concerns and riled by social injustice, to them the question is no longer how to mitigate the effects of human activity, for example by investing in green technologies."

Not just regular MPs, it gets much, much worse:

Von der Leyen: https://twitter.com/vonderleyen/status/1658022320827518977

The president of the European Parliament: https://twitter.com/timparrique/status/1658009279754915840

Palling around with Hickel and Vandana Shiva:

https://twitter.com/ERC_Research/status/1657835551901270023 https://twitter.com/ICTA_UAB/status/1655860218868252672 https://twitter.com/AndreasShrugged/status/16583961046254632...

pr337h4m··on We will be shutting down neeva.com
You'd like search.marginalia.nu. 100 million page index, on a single machine in the creator's living room, very interesting results that are super hard to find on Google/Bing (like https://hobbyspace.com/AAdmin/archive/Interviews/Systems/Elo...)
pr337h4m··on Sam Altman goes before US Congress to propose licenses for building AI
>If OpenAI just wants to prevent another OpenAI eating its lunch, the barrier there is raw compute.

Stable Diffusion pretty much killed DALL-E, cost only $600k to train, and can be run on iPhones.

pr337h4m··on Anthropic's 100k context is now available in the web UI
Also available on poe.com
pr337h4m··on Helping a kid who made a math mistake
Looks like a good use case for LLMs, especially when integrated with a math backend like Wolfram or Desmos
pr337h4m··on Protocol Wars
Related: https://gwern.net/holy-war
pr337h4m··on The Imgur Apocalypse Is Going to Break Large Parts of the Internet
What's stopping Reddit from making a copy of every Imgur-hosted image linked to on Reddit, hosting it themselves, and thus ensuring that nothing is broken for Reddit users? Or just buying Imgur, for that matter?
pr337h4m··on Training open-source LLMs on ChatGPT output is a really bad idea.
Doesn't matter. We want high-quality text - it's not necessary for it to be human-written. Social signals like upvotes or PageRank will still remain useful even if most text is AI generated.
pr337h4m··on ChatGPT could cost over $700k per day to operate
This was very promising: https://machinelearning.apple.com/research/stable-diffusion-...
pr337h4m··on Only one pair of distinct positive integers satisfy the equation m^n = n^m
To bypass the Medium loginwall: https://scribe.rip/only-one-pair-of-distinct-integers-satisf...
pr337h4m··on Software firms across US facing tax bills that threaten survival
Not very familiar with the US tax system, but is there no option to treat "R&D spending" as a normal business expense, forgoing all R&D incentives or tax credits?
pr337h4m··on Montana Just Passed the First State TikTok Ban
Any competent judge will recognize it as a bill of attainder.
← PreviousPage 5 of 8Next →