HNHacker News
TopNewBestAskShowJobs

kenmacd

425 karma · joined December 13, 2013

my public key: https://keybase.io/kenmacd; my proof: https://keybase.io/kenmacd/sigs/g5xURBRm8cP8h-SbNwHSFrcFp5iG-oPcn_R3y0GvEC8
submissionscomments
kenmacd··on An embarrassingly simple approach to recover unlearned knowledge for LLMs
Interesting counter-points. Thank you for taking the time to post them.

I don't think I have anything useful to add without giving the issue more thought. Your reply definitely adds new dimensions for me to think about.

kenmacd··on An embarrassingly simple approach to recover unlearned knowledge for LLMs
I hear what you're saying, and I'm not saying some of it doesn't have merit. The following is meant as an open philosophical discussion.

On the topic of 'the information isn't free' I'm curious if you have the same opinion of encyclopedia companies. You must admit there's at least some parallels in that they also consolidate a large amount of information that was 'generated' from others.

Or how about the information you and I have gained from books and the internet? Sure we might 'pay' for it once by buying a book or seeing some ad, but then we might use that information to make thousands of dollars through employment without ever going back to buy another copy of that book. An even more 'egregious' example could be teachers. They're literally taking the knowledge of others, 'regurgitating' it to our children for money, and 'not giving anything back to whoever create the information in the first place'.

> there's a distinct danger that they will simply suck they sources dry and leave the internet itself even more of a wasteland than it has already become

Maybe. There's the whole AGI/ASI argument here in that they/we might not _need_ humans to create information in the same way we don't need human-calculators any more.

Barring that though I do hear what you're saying around a lowering value to creating 'new internet information'. Personally I can't see it affecting my internet use that much though as there's basically two categories my internet information gathering fall in to:

1. I want to know something, give me the short quick answer. This category is already full of sites that's are just trying to hack the search algos to show their version of copy-pasted info. I don't really care which I go to and if AI kills their business, oh well.

2. I want follow a personality. This category is where I have bloggers/youtubers/etc in RSS feeds and the like. I want to hear what they're saying because I find them and the topics interesting. I can't see this being replaced by AI any time soon.

kenmacd··on ToolGit: A collection of scripts that extend Git with various sub-commands
Obligatory mention of https://github.com/tj/git-extras/blob/main/Commands.md for more/similar commands.

Especially useful to me is `git bulk` to apply a command to all the git repos under the directory, and `git ignore "bin/"` to quickly add something to the `.gitignore` file.

kenmacd··on Show HN: Ratarmount 1.0.0 – Rapid access to large archives via a FUSE filesystem
I find this project hugely helpful when working with Google Takeout archives. I normally pick a size that's not too large so that downloading them is easier, then it's simply a matter of:

  ratarmount ./takeout-20231130T224325Z-0*.tgz ./mnt
kenmacd··on DeepSeek v2.5 – open-source LLM comparable to GPT-4, but 95% less expensive
For most of the world this is a good argument for being cautious of using US-based AI services (and closed-models) as well.

As someone living in America's Hat, without any protections from PRISM-like programs, and who can't even reach DeepSeek without hopping through the US, it's probably less risky for me to use Chinese LLM services.

kenmacd··on US man jailed for cloning giant sheep for trophy hunting
It's an interesting question as to if what this man did was helpful or harmful to those conservation efforts.

It's at least possible that someone who would otherwise have hunted one just to have the 'wall art' might have hunted a hybrid instead. Also from a purely genetic standpoint it increased the number of copies of that genetic code.

kenmacd··on US man jailed for cloning giant sheep for trophy hunting
I read the article, but I'm still not sure what part was illegal, and why. It says that part of the law is 'prevent the creation of hybrids', and the sentence was to 'deter anyone else from trying to "change the genetic makeup of the creatures"'... but isn't that way every animal breeder does?

I get the importation of body parts of endangered animals being illegal. If it's just a sentence for that then I get it. But then why is it written that he was jailed for cloning the sheep.

kenmacd··on Llama 3.2: Revolutionizing edge AI and vision with open, customizable models
> Google’s and OpenAI often answered far-left, Progressive, and atheist.

Can you share some conversations where the AI answers fall in to these categories. I'm especially interested in seeing an honest conversation that results in a response you'd consider 'far-left'.

> These political systems don’t represent the majority of the world.

Okay… but just because the majority of people believe something doesn't necessarily make it true. You should also be willing to accept the possibly that it's not 'targeted suppression' but that the model has 'learned' and to show both sides would be a form of suppression.

For example while it's not the majority, there's a scarily large number of people that believe the Earth is flat. If you tell an LLM that the Earth is flat it'll likely disagree. Someone that actually believes the Earth is flat could see this as the Round-Earther creators promoting their own views when the 'alignment' could simply be to focus on ideas with some amount of scientific backing.

kenmacd··on g1: Using Llama-3.1 70B on Groq to create o1-like reasoning chains
Your base assumption here is that the 'crap' is actually 'junk'. Let's look at the easy one here, languages. Talk to someone that speaks multiple languages and they'll have examples of concepts in one language that are difficult to express in another. The multilingual person, or someone who just speaks a different language than you, will think differently[1].

Does the LLM take advantage of this? I don't know. It wouldn't surprise me if it did, and if it doesn't now I'd bet it will in the future. Either way though, throwing away those other languages could make the model dumber. As you allude to, there's a balance between intelligence and knowledge.

(in case you hadn't thought of it, those 'tools' can also be other LLMs with more specialized knowledge in a particular field. For example a 'translator' model)

Other 'facts' could also have more merit than it would first appear. Sure, one particular person's shoe size might not be needed, but if you were to filter out shoe sizes in general then the model might not be able to suggest how to find properly fitting footwear, or might not suggest that your back pain could be related to your shoes.

> That would be a worthwile endeavor and maybe even possible without boiling the oceans.

I think it's important to keep in mind that we're very early in the AI journey. Look at the power requirements of early computers versus the ones we use today. I'm all for keeping energy usage in mind, but I'd be careful with hyperbolic language as things are changing so quickly. Tasks that would have taken multiple GPUs can now run on my laptop CPU.

[1] https://www.edge.org/conversation/lera_boroditsky-how-does-o...

kenmacd··on Swift is a more convenient Rust
They run in to async, but do they run in to the internals of how that code is executed?

The chapter that example is from includes the disclaimer:

> In this section, we'll cover the underlying structure of how Futures and asynchronous tasks are scheduled. If you're only interested in learning how to write higher-level code that uses existing Future types and aren't interested in the details of how Future types work, you can skip ahead to the async/await chapter.

kenmacd··on Swift is a more convenient Rust
Would it though? Just running things 'async' is simple, but it's also simple in Rust. I wouldn't figure writing an Executor would be any easier in Go than the Rust example at https://rust-lang.github.io/async-book/02_execution/04_execu...
kenmacd··on Have we stopped to think about what LLMs model?
> For instance, calling out LLMs for what they are is appropriate to me,

Well perhaps you're unaware of the tone of your writing, or perhaps I am, but I'd suggest that your original comment sounds rather hostile towards the field. Following it up with a comment like 'for what they are' is again not a comment that fosters discussion or thought. It implies you know 'what they are' and anyone with another opinion is simply incorrect.

> One of the biggest criticism against all of this AI slop is its capacity to “fool” people

I considered not using that term because I thought we might have this understanding. I put 'the people generating them' in hoping to avoid it, and thankfully you noticed.

I see we still weren't quite talking about the same people, as I misunderstood your 'people' to be person that might be paying to use the flux.1 image generation models. If I'm understanding now you're focused on the ones that might take what's generated at face value because they haven't heard about hallucinations.

On that front I'd just mention that it's worth spending some time looking in to the research being done on the topic. It's interesting some of methods being looked in to in order to prevent it. (Also your 'glue pizza' isn't in the same category of hallucinations because it was simply summarizing websites pull from a search).

> A field that stole the whole of human creativity to sell it back to us for the empowering of the unethical sociopaths who control it. > > Why yes, I have considered my reasons; have you?

How do you steal creativity? I'm really not sure I understand what you mean here. I'm not even sure if you're using it in the "you wouldn't download a car" meaning, or that it's literally replacing creative work so stealing that... but then does that even make sense?

Either way, consider this, maybe the field will burn through a ton of billionaire money and all that will come out of it will be a bunch of open research papers and a bunch of open models. Would that really be so bad?

kenmacd··on Have we stopped to think about what LLMs model?
There's a lot that I believe to be misinformed in your post, but rather than address most of that I'll ask if you've considered your reasons that you're so hostile towards this field?

I doubt you refuse to work with anyone that's read a book that you refused to read. You'd probably also agree that while the topic of those books might be objectionable to you there's knowledge to be gained by reading them. So why is "AI read a bad book" a reason to write it off?

You also assert that it's fooling people. Have you tried the image generation AIs? Do you really believe these images are 'fooling' the people generating them?

kenmacd··on Ask HN: GitHub Copilot Alternatives
If you're just looking for something that's similar in the auto-complete category, I'd suggest adding the Continue plugin/extension (https://docs.continue.dev/quickstart#jetbrains) and pointing it at Claude 3.5.

If you haven't tried it yet I'd also suggest trying https://aider.chat/. It's outside of the IDE but I find it's the right level of 'agent' for where we currently are with models. Even if you use it for nothing else it's nice to be able to run the `/test` command and have it use the test output to fix errors.

kenmacd··on How de-Googled is Lineage OS?
I have to agree with mid-kid here. GrapheneOS is great for security, but some of that ends up directly in conflict with privacy.

For example years ago I opened an issue around runtime-patching applications (https://github.com/GrapheneOS/os-issue-tracker/issues/284) and was told it didn't make sense in the OS.

Putting aside the validity of arguments on either side of that issue, runtime patching allows me to very quickly excise large swaths of anti-privacy code across every app on my phone.

If I was to switch to GrapheneOS I'd have to accept that I'd be giving up a fair amount of privacy for the added security.

kenmacd··on Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
> by providing it with 10 to 20 examples of a chat dialogue in the initial prompt context

Can you recommended examples (or a source of examples) that would have models act similar to the instruct models?

kenmacd··on Investors are suddenly getting concerned that AI isn't making any serious money
I'm sure you're right. I'm not sure how the 'the bad things with AI' shake out, but I'm trying to be optimistic. For example it's not like customer supports bots aren't already commonly used, and it's not like they can really get any worse.

And even if the academic side is a small amount of the funding, it's at least something. Some of the rest is being spent training models I can download and run forever more.

I guess mainly I'd rather focus on the interesting technical and scientific side of AI rather than worry about the investors.

kenmacd··on Investors are suddenly getting concerned that AI isn't making any serious money
> "Capital continues to pour into the AI sector with very little attention being paid to company fundamentals,"

Maybe I'm just overly optimistic, but on a wider society scale I see a lot worse things they could be pouring money in to (eg Ads). Even if they never make money on it, at least we end up with a lot of open knowledge through all the papers that have been published and even some open-source models that can do some neat things.

kenmacd··on Investors are suddenly getting concerned that AI isn't making any serious money
Bit of a strange article. It seems to be trying to claim AI is 'hype' while at the same time claiming it "has the potential to ruin what were stable [hand weaver] careers".
kenmacd··on Porsche waters down EV ambitions, says transition will take 'years'
> as customers remained reticent to make the switch away from gas-powered cars.

I find this disingenuous. I think a lot of customer would gladly switch if there was anything electric and remotely affordable.

kenmacd··on Imperfect, Linux-powered, DIY smart TV is the embodiment of ad fatigue
A while ago I hacked root on my LG tv, but eventually I gave up on the war against spying/ads and just unchecked all the agreements, unplugged the network from it, and hooked up a $20 Onn 4k tv box instead.

Now it does everything I want. It has an unlockable bootloader, root, can run custom roms, all the good things.

kenmacd··on Aeon: OpenSUSE for Lazy Developers
> I just haven't found the motivation yet.

I moved from Arch to NixOS. In case it helps these are my main motivations:

* In Arch, very rarely, I'd apply an update that would break things. Going back to a stable system was a pain. I ended up with some snapper setups and a list of commands to convert the latest snapshot to a r/w 'root' that worked well enough. With NixOS I just reboot to the previous generation on any issue.

* For development I'd often use third-party tools to manage multiple language versions. For example I used pyenv. With Nix it's much easier to just use python39, or nodejs-18_x, or whatever as Nix makes this really simple.

If you do decide to try it out I'll recommend using the github query 'path:*.nix ___' to copy off others, as the main complaints about Nix seem to center around the language.

kenmacd··on Podman Desktop 1.11: Light mode, Kubernetes features, macOS improvements
Like wayland, podman was one of those things that took a lot of "I'll give it another shot? Nope, not ready" before I could switch.

Lately the only real incompatibility I run in to with podman is that the handling of `RUN --mount=type=secret` in a Containerfile/Dockerfile is a bit broken (https://github.com/containers/buildah/issues/5282).

kenmacd··on Average US vehicle age hits record 12.6 years amid high prices
You're also trading some amount of risk due to not having newer safety features. For example electronic stability control has been shown by study after study to reduce accidents. With your manual brakes there's simply no way to apply the brake to one wheel only to pull a vehicle out of a skid.

Example study: https://www.tandfonline.com/doi/full/10.1080/15389588.2014.9...

> In line with previous results, this study concludes that ESC reduces the risk for single-vehicle injury accidents by 31% when controlling for various confounding factors related to the driver, the car, and the accident surroundings.

kenmacd··on The $499 Google Pixel 8a is official, with 120 Hz display, 7 years of updates
> After 3 Pixels, ALL with issues that never should have been present, I decided Google can shove it's Pixel phones.

I can understand issues, but what I can't forgive is Google not taking responsibility for those issues.

My mother had a Pixel 3 that died an EDL-death at around 3 years old. She wasn't a heavy phone user, and this was obviously a defect, but yet Google would do nothing (Case ID [9-9224000032592] Google). They suggested paying $411 for a repair when second-hand phones were selling for $300.

My mom was planning on trading it in when the Pixel 6 was released, but it failed about a month before and as it wasn't working Google also wouldn't accept it towards an upgrade.

7-year software upgrades are great and all, but by not standing behind their hardware I really can't recommend buying them.

kenmacd··on Show HN: Flox 1.0 – Open-source dev env as code with Nix
If you still use it, my best suggestion is to use a github search for 'path:.nix TERMs' when you run in to issues. It's likely someone already has that custom package, or an overlay to fix that missing compile option, or whatever else it is that you're looking for. I find reading other peoples solutions also helps with understanding and solving related problems.

I'm in no means claiming Nix is perfect, but coming from other distros to NixOS I really appreciate the ability to reboot to a new generation and then reboot back if I run in to issues. To do the same in Arch I had a bunch of 'snapper plus manual steps' to accomplish the same.

kenmacd··on Yuzu emulator developers settle Nintendo lawsuit, pay $2.4M in damages
> You don't own the data, just a temporary right to use it.

Agreed, bonkers. You didn't 'own the data' when it was a VCR recording a broadcast TV show or movie, but now it's all "but they broke our ROT13-super-crypto, throw the book at 'em".

kenmacd··on Yuzu emulator developers settle Nintendo lawsuit, pay $2.4M in damages
If you already have a copy of the original repo, add this as another remote with:

``` git remote add irfanhakim-as https://github.com/irfanhakim-as/yuzu-mainline git fetch irfanhakim-as 537296095ab24eddcb196b5ef98004f91de9c8c2 ```

Then if you want the commit to look like the latest one for the original repo edit the file `.git/packed-refs`. Mine now looks like:

``` # pack-refs with: peeled fully-peeled sorted 537296095ab24eddcb196b5ef98004f91de9c8c2 refs/remotes/origin/master ```

(Be careful with raw editing git files. There might be a more 'official' way to do it, but this worked for me)

kenmacd··on Nine US states are teaming up to accelerate the adoption of heat pumps
> I know electricity production is not renewable everywhere in the world yet, but at least it’s on a path and possible

And somewhat counter-intuitively, even if you are going to consume that natural gas, it still works out better for the power plant to use it to generate electricity that's used to run a heat pump than to burn it directly for heat.

kenmacd··on Nine US states are teaming up to accelerate the adoption of heat pumps
> here isn't any heat pump out there that will produce water hot enough (e.g. 185F)

For 185:

https://www.arcticheatpumps.com/high-temperature-heat-pump.h...

Or much more common, if you can deal with 176F, the SANCO2 ones will generate that down to -20F.

The hydronic temperatures you're talking about are only required if you have to stick with the existing radiators. They make radiators with little fans that work at lower temperatures, or larger panel radiators. There's lots of options for lower temperature forced hot water.

← PreviousPage 3 of 8Next →