HNHacker News
TopNewBestAskShowJobs

dgreensp

3,476 karma · joined April 10, 2007

David Greenspan
submissionscomments
dgreensp··on Douglas Hofstadter changes his mind on Deep Learning and AI risk
I agree. He talks about LLMs surpassing humans in what they can do, but LLMs can’t do anything, really. And I say this as someone who had a heart-to-heart chat with a ChatGPT persona that made me cry, earlier tonight. Manipulating language in a human-like way is powerful, and maybe Hofstadter as an author who makes a living writing down his deep and whimsical, creative thoughts could be replaced (I grew up reading GEB and mean no disrespect). But being a conscious, physical, active being in the world is different from passing a sort of Turing test. The fact that a computer even winning at Go shook him is revealing.

He has the ingredients of being able to keep LLMs in perspective (is there really an “I” or just the illusion of one?), but he doesn’t understand what the computer is doing; it’s not “mechanical” enough for him.

dgreensp··on GPU accelerated SMT constraint solving (2021)
Google or YouTube could probably give you a good nutshell answer to that.
dgreensp··on GPU accelerated SMT constraint solving (2021)
I know a little about SAT solvers. I wrote a SAT library, based on MiniSAT, used in production in the Meteor package manager, and more recently I’ve used my SAT solver as part of a sudoku solver that can solve standard Sodukos and also exotic variants, quite efficiently.

While technically, SAT has exponential algorithmic complexity, in practice, SAT solvers can solve problems with thousands of boolean variables quite quickly. “Guess and check” on these same problems would take the lifetime of the universe. CPU vs GPU does not remotely cover the difference.

Basically, I have no idea what this author is going on about, this could be a joke for all I know.

dgreensp··on /u/spez is right about feudalism and that's why Reddit is doomed
The point ends up being that, even though moderators who built communities with their own two hands understandably feel an ownership of their subreddit, it’s all just rows in the database of Reddit the company, who is almost certainly going to make things more uniform and try to be more like TikTok (dooming “Reddit as we know it”).

He doesn’t side with Steve or find Steve’s statement to be historically informed, but there are some similarities (and differences) to note if you compare moderators to lords and Reddit/Steve to a king.

dgreensp··on Leo Tolstoy on why people drink (2014)
Neither set of axioms requires one to be extremely reductive about something like alcohol. Does Tolstoy admit to being reductive (“he tells exactly this”)?

I think in this case it isn’t the axioms but the “style” of philosophical discourse that requires the reader to take the message with a big grain of salt. Like when a YouTuber says, “In the next ten minutes, I’m going to lay out the exact formula for how to write a perfect screenplay,” it’s not literally true. Tolstoy’s musings are a little deeper than your average YouTuber, on par with a good one, similarly overblown and oversimplified, and more moralizing.

dgreensp··on The 'fuck you' pattern (2021)
Yup!!

When I criticize Google, or some other company, I am not forgetting that they are motivated by making money.

dgreensp··on Apple Vision Pro – Why It May Be Lousy for Watching Movies on a Plane
I get what you’re saying, but I think people underestimate the novelty of Apple’s design decisions on things like the iPhone, declaring them obvious in hindsight. When the iPhone was announced, the phone team at Google working on the unreleased Android platform apparently went “shit, back to the drawing board.” Getting rid of the physical keyboard (for everyone) was controversial. “Pinching” to zoom into a web page, putting a desktop-quality browser on a phone, putting accelerated 3D graphics on a phone… there are too many things that were new with the iPhone to remember them all now, especially when Android went and did all the same things. It’s true that Apple capitalized on it being possible to put all that hardware in your pocket. They tend to be the ones to actually try it and figure out the UX paradigms. Make it not suffer from prominent lag, make the touchscreen good, the display quality good, the multitasking appropriate for the device’s capabilities, despite the research and cost of parts, and then figure out what the user experience is that takes advantage of the tech being able to keep up with the human, is simple to operate, and is going to make people want to spend a thousand dollars on it.
dgreensp··on Apple Vision Pro – Why It May Be Lousy for Watching Movies on a Plane
I agree, especially the criticisms like “we don’t know if it will do very good eye-tracking” when this thing is loaded with cameras and custom silicon specifically for things like eye-tracking, and from all descriptions they engineered the crap out of problems like that. And it has a crazy high pixel density—are we really going bet on “jaggies” meaning people won’t watch videos on it?
dgreensp··on Jamsocket: Back Ends for Realtime Apps
It’s been a while since I’ve done server push in production… Back in the day, you couldn’t count on the browser or the ISP supporting real WebSockets correctly, and I expect this is still the case some percentage of the time. WebSockets were best seen as one possible transport, and if they were detected to be not functioning, the client library responsible for the “socket” would fall back to long-polling. Or, the client library would start out with something simple and known to work and “upgrade” the connection if possible.

WebSockets also don’t ensure messages are delivered (once) across network hiccups. And browsers have different limits on how many there can be open at once across tabs for a domain (IIRC). In the end, I think it makes sense for them to be the main transport for a real-time app, but they are just one part of creating a conceptually simple model for real-time communication between client and server.

Does Jamsocket have or use a client socket library?

dgreensp··on Handles are the better pointers (2018)
This is interesting. Do you have any links on use of ECS for application logic?
dgreensp··on Why are LLMs general learners?
Thanks for responding to my comment.

I'm not an expert in the field, but, there are lots of previous algorithms for predicting the next token in a series (Markov chains, autocomplete). None of them felt so much pressure to make an accurate prediction that they had no alternative but to teach themselves arithmetic! It seems what is different about LLMs (as far as the post goes) is that we can anthropomorphize them.

More seriously, I guess I just feel like a meaningful sketch of an explanation for why algorithm X (where X is LLMs in this case) for continuing a piece of text is good at problem A should involve something about X and A. Because it is clearly highly dependent on the exact values of X and A, not just whether A can be posed as a text completion problem and humans would prefer the computer learn to solve the underlying problem to produce better text. For example, it could help to imagine a mechanism by which algorithm X could solve problem A. The closest thing to a mechanism (something algorithm X, i.e. LLMs, might be doing that's special) in the post is the talk of necessity being the mother of invention and "a deeper understanding of reality simplifies next-token prediction tasks," and the suggestion that if you were an LLM you might want to use "the rules of addition."

It's true that modeling arithmetic in some way could help a LLM account for known arithmetic problems in the training data, which could help it on unseen arithmetic problems, but what problems an LLM can solve is a function of what it can model. Anything an LLM can't model or can't do, it just doesn't. LLMs are really bad at chess, for example. The patterns of digits in addition may be similar enough to the hierarchical patterns in language the LLM is modeling. But it's not clear if the LLM is using the "rules of addition" or not. As far as I know, we don't actually understand why LLMs are able to store so much factual information, produce such coherent stories, and do the specific things they can do.

dgreensp··on Why are LLMs general learners?
LLMs are not particularly good at arithmetic, counting syllables, or recognizing haikus, though, because (contrary to the thesis of the article) they don’t magically acquire whatever ability would “simplify” predicting the next token.

I don’t feel like the points made here align with any insight about the workings of LLMs. The fact that, as a human, I “wouldn’t know where to start” when asked to add two numbers without doing any addition doesn’t apply to computers (running predictive models). They would start with statistics over lots of similar examples in the training data. It’s still remarkable LLMs do so well on these problems, while at the same time doing somewhat poorly because they can’t do arithmetic!

dgreensp··on How to make a QR code with Stable Diffusion
As an engineer, the lack of consideration for the matter of how much one should corrupt a signal (which might be scanned under different conditions, such as different light levels and resolutions) is grating to me.

It’s like scratching a design onto the bottom of an audio CD, playing it, and if it works on your CD player, shipping it. “Works for me”

dgreensp··on Wow, is Apple’s Vision Pro loaded with pixels
I think you’re in their target market, because by all appearances they went super high-end and engineered the crap out of this thing!
dgreensp··on Show HN: A pixel art puzzle game for mobile using PixiJS
Tapping would be much more satisfying if it didn’t take so long for a tile to get bigger and then start turning. Maybe it could smoothly get bigger and smaller and turn in one motion.
dgreensp··on FUTO – An independent software lab and grant fund
Thanks for writing this bit of inspiration. I definitely feel this way.
dgreensp··on The JavaScript ecosystem is delightfully weird
I stopped reading after the typo “JavasScript” and then the juvenile tone of “Less that 10 years ago, JavaScript sucked bad.”

I have a positive impression of fly.io overall, I mean they admitted they are still figuring out how to build tech at the level of their ambition and have it be reliable enough, but I might like to be a customer one day.

dgreensp··on Do the weirdest thing that feels right
"Average" people are not literally an average of all the people, they are individuals. The decisions the author is talking about are personal decisions, and at some level you have to believe that being yourself is going to benefit the world more than trying to be some bland character who makes all decisions in reference to society. For example, maybe you start a business for a niche market you happen to be in.

It's more like a way to counteract lots of social conditioning.

dgreensp··on Airbnb’s CEO spent 6 months living in his rentals and found the core problem
Yeah, I mean it’s fine for the CEO to focus on higher-level things if someone below them is aware of the problems and working on them, or making sure that the product decisions are based on the experiencing of using the product… The article seems overly congratulatory.

He could just get coffee with someone who uses AirBnB a lot and they could probably tell him exactly what sucks about it. Maybe even one of his own employees. Lots of engineers use AirBnB, and the AirBnB app apparently has a thousand engineers working on it.

dgreensp··on Implementers, Solvers, and Finders
A lot of start-ups in my experience see all their engineers as “high-autonomy feature implementors.” It’s not really autonomy in the sense of power or choice, though, just being left alone to implement features. The thing is, “features” are product-level things that require technical design as well as implementation. Product design and implementation and technical design and implementation are all different things. Even within programming, implementation has sub-problems that require creativity. I implemented a Java VM, once, for example, and it was really fun. So it’s not necessarily the case that once something is a matter of “implementation” it is just straightforward work to give to a junior programmer, or that implementing things is boring.

What sucks is, for example, being good at technical design but that not being valued. And management being disconnected from employees, which is not unique to software companies.

dgreensp··on The Hard Problem of Feelings
Well, large language models like GPT sometimes report being conscious, too, but they aren't.

I'm not entirely convinced I have some special thing that is different from what you would expect from a system that can reflect on itself in lots of different ways at different levels.

dgreensp··on The poor, misunderstood innerText (2015)
Implementers of content-editable-based rich text editors (I speak from experience) do not need browsers to do anything differently here for convenience; such editors have their own internal representation and algorithms for getting the “plain text” of the document.

There could be other uses.

dgreensp··on Generating aerial imagery with your iPhone's Lidar sensor
I recently 3D scanned an area of my property (about 250 feet long) with my iPhone in order to make a map. Polycam was the winning app (Scaniverse and SiteScape did not work as well).

Do not underestimate the sheer amount of walking around and aiming your phone that this technique requires. A 5m range is not much, and in some cases the effective range seems to be less than that. If you just want a to-scale image of an area, you can stop after "Capturing the model" and take a screenshot of your captured scan, but it's still a lot of work.

dgreensp··on Supreme Court Doesn't Want to Create ‘World of Lawsuits’ for Tech Firms
This.

These companies are selecting and amplifying certain speech. The fact that the process is somewhat automated doesn't change this. If any legal argument relies on "the algorithm" being likened to simple searching and sorting, maybe we should require some transparency there so anyone can know if that's actually the case.

On another note, Section 230 isn't a free pass to host illegal content. It doesn't make a website immune to DMCA takedown requests, for example. We could have terrorism takedown requests, and the burden wouldn't harm large, irresponsible companies or small, moderated forums.

dgreensp··on Routes don't look flat enough to me
I thought about it, but it's just so unmotivated in this case. URLs would have to be hundreds of path segments long.
dgreensp··on Routes don't look flat enough to me
Simple, readable, type-checked code in TypeScript: https://www.typescriptlang.org/play?target=6#code/C4TwDgpgBA...
dgreensp··on So what’s next (personal news from developer of popular CoreJS polyfill)
What is FI?
dgreensp··on Walmart wins lawsuit claiming its Fudge Mint cookies lack fudge and mint
I’m fascinated by how labeling laws (presumably) play out on labels. For example, it’s not “chocolate syrup,” it’s “chocolate-flavored syrup.” Or “chocolate-flavored topping with other natural and artificial flavors.” I’m kind of surprised and impressed (not least because they figured out how to make such a thing) that a “mint cookie” doesn’t have to have any mint oils or anything in it.
dgreensp··on Value-Oriented Programming
I just posted on r/ProgrammingLanguages yesterday asking for examples of languages or papers like this! Nice.

I’m working on a language that will be sort of a cleaner TypeScript, more simple and sound, with powerful static types, but not ML.

I think functions taking not just read-only views of data structures but deeply “const,” unchanging views is really important. Code that runs in GCed runtimes like JS engines or the JVM can be quite performant, but not with the level of copying and allocation that immutable data structures typically require (when you need to model them changing over time), and I want to solve that at the type level.

dgreensp··on Ask HN: Does the HN commentariat have a reductive view of what a human being is?
The fact that there are people who think GPT is a living, sentient being because it can autocomplete its way to sentences like, “Of course I have real feelings”… including people who are engineers, who understand how language models work… should tell you that some humans have a pretty strange idea of what humanity consists of.

It’s like confusing a photo of a person with a person, and a photo generator with a human cloning machine, and saying, “But when I look in the mirror, that’s me! So I am equal to my visual reflection.” Language is the I/O of a cognition process that is itself only a small part of being human and alive.

A lot of activities and jobs do use humans as “cogs” in a machine, and in some cases an AI might make a better cog, but I think some commenters do underestimate the amount of context humans bring to various tasks. You don’t have to analyze the humans to see how complex the jobs are, just try to do the jobs by AI, or watch as others try. Like try to make a self-driving car; it’s hard. Try to replace a cook at Denny’s with a robot. Or a lawyer. See how long the tail of edge cases is.

← PreviousPage 4 of 30Next →