HNHacker News
TopNewBestAskShowJobs

7speter

851 karma · joined March 24, 2022

submissionscomments
7speter··on Apple is fighting for TSMC capacity as Nvidia takes center stage
I would imagine they could split their orders between different fabricators; they can put in orders for the most cutting edge chips for the latest Macs and iPhones at TSMC and go elsewhere for less cutting edge chips?
7speter··on Why are 38 percent of Stanford students saying they're disabled?
You can use baking soda and hydrogen peroxide for a whole range of cleaning applications, as well as clearing a stopped up toilet.
7speter··on Giving people money helped less than I thought it would
1000 dollars for a vacation?
7speter··on How Baltimore's violent crime rate hit an all-time low: 'It's hard work'
It was based on a true story, but whatever I guess
7speter··on How Baltimore's violent crime rate hit an all-time low: 'It's hard work'
Well, The Wire shows how Baltimore’s police department attempted to underreport crimes as well.
7speter··on A message from Intel CEO Lip-Bu Tan to all company employees
How effective would Gelsinger be at returning after the then previous CEO took the company in a totally different path and practically trashed Gelsinger’s original plan?
7speter··on Ask HN: How can ChatGPT serve 700M users when I can't run one GPT-4 locally?
Elsewhere in the thread, someone talked about how h100’s each have 80GB of vram and cost 20000 dollars.

The largest chatgpt models are maybe 1-1.5tb in size and all of that needs to load into pooled vram. That sounds daunting, but a company like open ai has countless machines that have enough of these datacenter grade gpus with gobs of vram pooled together to run their big models.

Inference is also pretty cheap, especially when a model can comfortably fit in a pool of vram. Its not that the pool of gpus spool up each time someone sends a request, but whats more likely is that there’s a queue to f requests from someone like chatgpts 700 million users, and the multiple (I have no idea how many) pools of vram keep the models in their memory to chew through that nearly perpetual queue of requests.

7speter··on The Prime Reasons to Avoid Amazon
Your local postage carrier doesn’t build massive warehouses filled with items that people who have to pee in bottle grab off of shelves.
7speter··on The Prime Reasons to Avoid Amazon
Vitacost.com has worked well for me.
7speter··on Apple Research unearthed forgotten AI technique and using it to generate images
Maybe for a big llm, but if they add some gpu cores and added a magnitude or 2 more unified memory to their i devices, or shoehorned m socs into high tier iDevices (especially as their lithography process advances), image generation becomes more viable, no? Also, I thought I read somewhere that apple wanted to infer simpler queries locally and switch to datacenter inference when the request was more complicated.

If they approach things this way, and transistor progress continues linearly (relative to the last few years) maybe they can make their first devices that can meet these goals in… 2-3 years?

7speter··on Judge rejects Meta's claim that torrenting is “irrelevant” in AI copyright case
The judge is claiming that because the use is of the books are “so transformative,” the usage of these books to train an llm is fair use.

I’m not familiar with the facts of the case and IANAL, and its late, but how did the plaintiffs determine their books were being used for training of the llm? Was the model spitting out language that was similar or verbatim to their works?

7speter··on OpenAI charges by the minute, so speed up your audio
So wait… is whisper transcription really all that slow locally on a M3 Macbook? It’s been a while since I used whispercpp, but I seem to remember it taking maybe 20 minutes on a comparatively slowpoke (and powerhungry) i5 12600k for maybe 40 minutes of audio; it might take less time on a faster m chip (maybe I’m imagining mobile apple silicon to be more performant than even desktop intel cpus), even less if there support built in for the built in gpu cores and other ai optimized silicon?

Did I miss that the task was time sensitive?

7speter··on Microsoft confirms Windows 11 automatic deletions of System Restore points
The funniest part is if you search for Linux on tiktok you get inundated with Microsoft ads
7speter··on FICO to incorporate buy-now-pay-later loans into credit scores
Its kind of funny how the people who don’t want to work with “lazy,” mangly, poor people with bad teeth are the first ones to tell poor people how they could’ve made interest on 6300 dollars over 30 years.
7speter··on Tiny Undervalued Hardware Companions (2024)
Lightning to usb-c seems interesting… it can turn somewhat late model i devices into full fledge computers on the go, at least iirc, or you can use a nvme in an enclosure as extra storage easily.

This is assuming you don’t have one of the newer i devices that has a usb c connector, then…

7speter··on Axolotls May Hold the Key to Regrowing Limbs
Isn’t the whole body growing from the same point at the same pace in a lot of instances when someone is in the womb (except when something like thalidomide is introduced)? It would seem a big challenge would be to have a part of a human body, at any number of stages after birth, maybe especially after full development, regrow from nothing, and excluding, at the very least, the areas of the body in proximity to it.

I’m obviously not an expert.

7speter··on My iPhone 8 Refuses to Die: Now It's a Solar-Powered Vision OCR Server
Whats seemingly more absurd is you already paid for the phone AND the Mac you have to develop for iOS devices for
7speter··on Why JPEGs still rule the web (2024)
I think the only cpus with av1 support right now, whether encode, decode or both, are tile era Meteor/Lunar/Arrowlake cpus from Intel.
7speter··on AMD's AI Future Is Rack Scale 'Helios'
As a beginner, you can get a lot done on a 4060ti/5060ti 16gb, much less a 4090/5090.

Heck I’ve been able to work through the early chapters of the FastAI book using a lowly Quadro p1000

7speter··on AMD's AI Future Is Rack Scale 'Helios'
AMD isn’t doing what you’re proposing, but it seems intel is a few months out from this.
7speter··on AMD's AI Future Is Rack Scale 'Helios'
Well, AMD is supposed to be releasing UDNA next year, which will presumably ‘unite’ capabilities like raster and inference within one architecture.
7speter··on I Read All of Cloudflare's Claude-Generated Commits
I think the author is saying you commit the prompt with the resulting code. You said it yourself, storage is free, so comment the prompt along with the output (don’t comment that out that if I’m not being clear); it would show the developers(?) intent, and to some degree, almost always contribute to the documentation process.
7speter··on Windows 10 spies on your use of System Settings (2021)
Maybe you know this, but steam does more than get games playing on Linux. They (Valve?) have a group that develops drivers for AMD gpus on Linux. Their contributions still may not ve limited to just that primarily, but if there wasn’t Valve it would seem we’d have a lot less to play on Linux at the very least.
7speter··on Researchers develop ‘transparent paper’ as alternative to plastics
Wow, I was just wondering about this yesterday! I had read about how some researchers made a sort of glass out of wood and wondered if they could make resilient bottles for beverages out of a sort of maybe polymerized paper.
7speter··on Building an AI server on a budget
I dunno everyone, but I think Intel has something big on their hands with their announced workstation gpus. The b50 is a low profile card that doesn’t have a powersupply hookup because it only uses something like 60 watts, and comes with 16gb vram at a msrp of 300 dollars.

I imagine companies will have first dibs via the likes of agreements with suppliers like CDW, etc, but if Intel had enough of these battlemage dies accumulated, it could also drastically change the local ai enthusiast/hobbyist landscape; for starters this could drive down the price of workstation cards that are ideal for inference, at the very least. I’m cautiously excited.

On the AMD front (really, a sort of open compute front), Vulkan Kompute is picking up steam and it would be really cool to have a standard that mostly(?) ships with Linux, and older ports available for Freebsd, so that we can actually run free as in freedom inference locally.

7speter··on How we’re responding to The NYT’s data demands in order to protect user privacy
Maybe I’m wrong, and maybe this was discussed previously, but of course openai keeps our data, they use it for training!
7speter··on Intel versus AMD is currently an emotional decision for me
P and E cores were around on arm at least a decade before Alderlake released. I remember being told to hold out for Haswell because it was rumored to have big and little cores like arm cpus; enabling your computer to use minimal power to check for mailbox updates.
7speter··on Intel versus AMD is currently an emotional decision for me
I don’t really think apple cares about gaming. AI is a big part of why their SOC’s matter (coupled with the potential to have 128-512gb of unified memory coupled with these SOCs. These chips are all about running llms locally pretty well at under 100w. Also great for creatives as well.
7speter··on OpenAI to buy AI startup from Jony Ive
Usually, if you have an account that old, you built up enough karma, especially in subs you’re a regular on, to speak your mind and absorb being downvoted heavily multiple times over. Its not worth it spending time to be able to do that again on a site that is increasingly astroturfed.
7speter··on The Problem with Teens Isn't Smartphones–It's Their Families
I don’t think I’ve ever seen anyone use suicide rates as a sole metric for mental health crises by demographic population.
← PreviousPage 2 of 25Next →