HNHacker News
TopNewBestAskShowJobs

edfletcher_t137

615 karma · joined April 18, 2020

submissionscomments
edfletcher_t137··on Why host your own LLM?
I built a simple, asynchronous, serialized API on top of llama.cpp for exactly this reason. https://github.com/edfletcher/llama.http/tree/master/example... It can run on low-resource VPSes even, if you have the patience for CPU inference (which will take awhile)!
edfletcher_t137··on My frugal indie dev startup stack (2022)
Given that a large portion of this spend is currently covered by expiring (in less-than-a-year) one-time credits, it's really not representative of what it claims to be and is therefore quite disingenuous & misleading.
edfletcher_t137··on Llama.http: A Dockerized, simple HTTP API for llama.cpp
Simple & straightforward, it's a quick spare-time project designed to enable automation and not as a standalone way to publicly host the models (no rate limiting, persistence or auth). The project README is here: https://github.com/edfletcher/llama.http/tree/master/example...

With the Docker image, it's just a matter of grabbing the model binaries you want, adding a small sidecar JSON [1] describing them and you're up and running.

Really just a porting/re-targeting onto the parent llama.cpp project of the HTTP I'd built on the alpaca.cpp fork awhile back [2] in order to take advantage of all the great new GGMLv3-encoded models, mmap'ed loading, etc.

All I'd ask if you build anything neat on top of it, please share it so I can use it too! Thanks & enjoy

[1] https://github.com/edfletcher/llama.http/tree/master/example...

[2] https://news.ycombinator.com/item?id=35417730

edfletcher_t137··on WW2 Meteorology
Came here to say this: it's extremely distracting, I struggle to reason why they would do this.
edfletcher_t137··on I stopped buying new laptops (2020)
There is one, galaxy-sized, deal-breaking issue with any used laptop: you can never clean them thoroughly enough. I'll leave it at that.
edfletcher_t137··on GGML – AI at the Edge
This is a bang-up idea, you absolutely love to see capital investment on this type of open, commodity-hardware-focused foundational technology. Rock on GGMLers & thank you!
edfletcher_t137··on OpenAI's plans according to Sam Altman removed at OpenAI's request
"Open"AI
edfletcher_t137··on The Biofire Smart Gun
Yes, the solution to the gun problem is MORE GUNS.

"Americans die from gunfire in proportions unparalleled in the civilized world because Americans own guns in proportions unparalleled in the civilized world. More guns mean more lethal accidents, more suicides, more everyday arguments escalated into murderous fusillades." - https://www.theatlantic.com/politics/archive/2017/10/the-rea...

"We guarantee that crazed man after crazed man will have a flood of killing power readily supplied him. We have to make that offering, out of devotion to our Moloch, our god. The gun is our Moloch. We sacrifice children to him daily." - https://www.nybooks.com/online/2012/12/15/our-moloch

edfletcher_t137··on Capturing the Flag with GPT-4
> And this time, I did it with the help of GTP-4

Should've had *GPT*-4 proofread this.

edfletcher_t137··on The Coming Technological Singularity (1993)
This whole series is one of the best of that era, I don't understand why it is lauded more often. Vinge clearly has a mind for the future like none other. His "computer programmer-archeologist" idea has lived rent-free in my head since I first read A Fire Upon the Deep decades ago. And the zones of thought? Literally mind-bending. "Came here to say this". :)
edfletcher_t137··on Observation: I asked ChatGPT to notify me when our chat exceeds 200 words
It doesn't "know" what words are, only tokens. Use this tool (https://platform.openai.com/tokenizer) to see how it tokenizes and note clearly that it does not always do so on word boundaries. "Including" is two tokens: "In" and "cluding". In fact it's context-dependent: "Gravitas" is three on its own ("G", "rav" and "itas") or sometimes two ("grav" and "itas"). As they note on that page: "A helpful rule of thumb is that one token generally corresponds to ~4 characters of text for common English text." It "knows" nothing about words and we already know it's very bad at math so this result is entirely unsurprising.
edfletcher_t137··on An HTTP Interface for alpaca.cpp
Very simple, designed to enable automation and not as a standalone way to publicly host the models (no rate limiting, persistence or auth). Hope it's useful to folks nonetheless!
edfletcher_t137··on And yet It Understands
The entire argument here rests on a supposition in the middle: "because if GPT is just a Chinese room it shouldn’t be able to do this."

"Shouldn't". According to whom? Where is the source? I would posit it should and clearly can do that while still being a "Chinese room", and this entire post's premise is obliterated. Oof.

edfletcher_t137··on Ask HN: How do you know if leaving your 1st software job will make you happier?
You can never know for sure. I only regretted quitting my first major job many years later after life had illustrated why it would've been better to stay. You just have to trust your instincts or take a leap of faith. Good luck.
edfletcher_t137··on How to protect your career from a ChatGPT Future
"ChatGPT will change everything!"

Everything?!

This kind of hyperbole is rampant in writing on these technologies and seeing it should instantly clue you into the fact that the rest of the writing is not objective. And sure enough, such is the case here.

edfletcher_t137··on A Heisenbug lurking in async Python
This is a great blog post. Concise, lacking fluff or extraneous prose, it gets right to the point, presents the primary-source reference and then gets right to the solution. A bit of editorializing in the middle but that's completely allowed when writing this tightly. Well damn done, OP.

And also it's great information that I - like I'm sure many of you - also never noticed. THANK YOU!

edfletcher_t137··on Ask HN: I just want to have fun programming again
Write something for yourself. When you're the user, the motivation to continue working on it is much stronger.
edfletcher_t137··on Ask HN: Are you tired of reading ChatGPT headlines?
> What you're seeing is just a manifestation of a rather major (sociological) event, and while I understand that the amount of hype is a bit over the top, to a large extent it makes sense.

This hyperbole is exactly why people like OP are getting sick of the headlines. It may be a major event sure, but only hindsight will be able to say that for certain. It may be another novel gimmick though, and this pronunciation will seem ridiculous in a year or two if that's the case. It's just too early to tell.

edfletcher_t137··on I’m now a full-time professional open source maintainer
> which proves the thesis that it’s possible to be a professional maintainer earning rates competitive with the adjacent market for senior software engineers

Yeah, if you're Filippo Valsorda. Not sure that "proves the thesis" broadly whatsoever, though.

edfletcher_t137··on Seven years on, what do we know about the disappearance of flight MH370? (2021)
This is the crux/TL;DR:

"Perhaps the most compelling reason to believe that Zaharie hijacked his own plane is its simplicity. It’s the only explanation that doesn’t rely on a series of independently improbable events: given a desire to do it, everything else falls into place as a reasonable part of the plan. In fact, from the timing of the transponder failure to the specific locations of the turns to the flight path into the Southern Indian Ocean, it would be harder to come up with a better way to make an airliner disappear. Why believe that this is a coincidence when it could well have been the goal from the very beginning? Furthermore, whoever was flying the plane had extensive systems knowledge and excellent hand-flying ability. Who else on board had those skills but Zaharie? Indeed, it’s by far the easiest answer."

edfletcher_t137··on Tweetbot. April 2011 – January 2023
So long, and thanks for all the tweets.
edfletcher_t137··on Ask HN: Has anyone worked at the US National Labs before?
I worked at LANL for awhile. Los Alamos is beautiful, northern New Mexico is lovely, but lab work is 99% bureaucracy. This was years ago but I needed 8 separate signatures to bring an iPod classic into a non-classified building. Insanity.
edfletcher_t137··on 'Oumuamua: An analysis of the debate regarding the first interstellar visitor
Apparently (TIL!) it's three now, with a meteor that burned up in 2014 having been confirmed in just April 2022 as interstellar! https://en.wikipedia.org/wiki/CNEOS_2014-01-08

And who was part of the team that first reported its existence? "CNEOS 2014-01-08 is an interstellar object reported in June 2019 by astronomers Amir Siraj and Abraham Loeb"

edfletcher_t137··on Ask HN: Are you a “lifer”? If so why?
+1, was going to say this myself if you hadn't beaten me to it.

I'd LOVE to be a lifer! Turns out not all of us are so lucky.

edfletcher_t137··on Ask HN: Erlang and the telecom market
Quite curious indeed that both OP and _all_ the commenters who agree with "screw Elixir" are green users...
edfletcher_t137··on Ask HN: Erlang and the telecom market
Having strong opinions is a great thing, expressing them in such a way is not. Especially if you expect to be taken seriously.
edfletcher_t137··on My dad's resume and skills from 1980
This is lovely and extremely interesting, thank you for sharing. Thinking of your father and your family.
edfletcher_t137··on Ask HN: Is the world going to shit?
Wouldn't you know, the very next time I check HN there's another post starkly backing up the thesis: https://news.ycombinator.com/item?id=33313253
edfletcher_t137··on Ask HN: Is the world going to shit?
Yes
edfletcher_t137··on Your website should work without JavaScript (2021)
"Everything in moderation"

Spot on

← PreviousPage 3 of 5Next →