HNHacker News
TopNewBestAskShowJobs

xiphias2

8,476 karma · joined September 7, 2018

submissionscomments
xiphias2··on Removing stuff is never obvious yet often better
May be the problem is just having so many people (the real cost).

Pinecone is just generally thought as something extremely overpriced:

https://www.timescale.com/blog/pgvector-vs-pinecone/

Until they can solve the feeling (or cut down on their own overhead), I don't see that great future for the company.

xiphias2··on Beating the L1 cache with value speculation (2021)
It's cool, I would love to have this for ARMv8 Mac
xiphias2··on My life-changing SaaS exit
Probably they do, but also the main page looks like spam instead of a blog.
xiphias2··on Cyber Scarecrow
The more scarecrow is installed, the easier it gets for real security researchers to hide from these checks and detect viruses. So actually the dynamic helps security research.
xiphias2··on I sold TinyPilot, my first successful business
I would be interesting in reading the ,,buying process'' part of the same deal from the buyers.

BTW tinypilot.com is down: https://www.isitdownrightnow.com/tinypilot.com.html

xiphias2··on Tinygrad 0.9.0
Thanks for the answer
xiphias2··on Tinygrad 0.9.0
That issue seems a month old, while the 58ms number looks 1 day old.

I have seen last month getting a lot of work done in improving performance (it's in the release announcement as well), but of course I still don't think it can compete with that number...still, a new comparision would be cool.

xiphias2··on Electric cars more likely to hit pedestrians than petrol vehicles, study finds
,,Drivers of electric cars tend to be younger and less experience''

Not adjusting for driver age after finding out as one of the main causes makes the research irrevelant.

Also the link should be to the research article itself, not a news site that doesn't link to it.

xiphias2··on Mercedes EQXX Record Drive: Riyadh to Dubai Single Charge 1000+ km Range [video]
As a person road tripping Europe with a 2 year old Taycan, fast charging not being fast enough is never a problem. It's always software / payment / availability / compatibility (not working).

I just went to a Shell recharge station in France, and mobile payment / my debit cards / Porsche charging card / My Porsche app weren't working, so I payed cash to a nice person who had a shell recharge card. The app wasn't working because I don't have a French bank account to connect it to, and in my country where I have bank account shell recharge is ,,coming soon''.

In another place in Spain I went to a 350kWh Porsche fast charger in a Porsche sales center recommented by the online Porsche navigation app, and the charger was out of service, and the dealership didn't take any accountability, just told me to go to another station. They didn't even realize that they should make sure that it's offline in their navigation app at least for their own chargers.

I had many places where there were no wifi / mobile net available for me (or extremely slow), and most of the time was taken not by charging the car (which can happen while I'm in the restaurant / bathroom), but by waiting for the 100MB app to download and register with all my details.

Quite often it takes 20 minutes to just start charging / 5-10 minutes to get to the charging station by going down from the highway.

xiphias2··on ChatControl: EU ministers want to exempt themselves
It would be great if this was that simple (and in general I agree with you), but Bukele taking over El Salvador was an exception: the whole judicial system was captured by criminals that enabled killing people on a mass scale, he got rid of it all, and crime rate went down significantly.

He also changed the (otherwise unfair) constitution that prohibited him from going for reelection, although at that point I believe a referendum would have been a much better solution.

I'm seeing the same taking over court happening in other countries, so I just don't think there's a simple solution that can be applied in all cases.

xiphias2··on Edward Snowden Is Among Those Sounding the Alarm over Spying Expansion
Trump signed the bill:

https://www.politico.com/story/2018/01/19/trump-surveillance...

xiphias2··on Mid-level Nvidia employee gets $62M in stock options; another lost it all
,,Sadly, this employee had to sell up his green gold to pay for losses when his broker “margined his account with another stock that fell 90%''

It wasn't just pure luck for the person who didn't use margin trading, like the other.

For any stock where the log price is moving in one direction with Brown motion, margin trading is just stupid, as it moves the log value of the asset held to minus infinity.

xiphias2··on Lessons after a Half-billion GPT Tokens
> so unless the prediction itself is uncertainty (which it should rarely be based on the training corpus, I think)

Why shouldn't you ask for uncertainaty?

I love asking for scores / probabilities (usually give a range, like 0.0 to 1.0) whenever I ask for a list, and it makes the output much more usable

xiphias2··on The FCC needs to stop 5G fast lanes
At that point Netflix should just provide its own VPN / internet access for paying users
xiphias2··on Scaling will never get us to AGI
The word scaling has multiple definitions. It's not just the same hardware getting cheaper over time, there have been many architectural improvements:

  - Better training algorithms for training with lower precision
  - fastattention, fastattention 2 for decreasing bandwidth inside the GPU
  - ring attention for decreasing bandwidth across GPUs
  - algorithmic improvements in handling long context window
  - MoE
  - Lots of algorithmic improvements in fine tuning / alignment
  - GROQ hardware architecture (deterministic hardware, storing all data in SRAM for inferencing instead of using cache hierarchies)
  - Improvements in tokenization
So far softmax(K * Q')*V is the only thing that hasn't (yet) been touched.

If the question is that ,,just'' improving LLM perplexity by further algorithmic and hardware improvements will lead to AGI, at this point many researchers believe that the answer is yes (and many others that the answer is no :) ).

xiphias2··on How I tripped over the Debian weak keys vulnerability
Even if those ,,small amounts'' were 5% of net worth of some people (which was not uncommon), the same small amount would consist of more than 99% of the net worth of the same people currently.

As Android wallets were the easiest to use wallets and exchanges routinely robbed people, it mattered a lot even back then.

While Coinbase has a quite good protocol for securing keys, what's scary to me is that so many ETFs are trusting it to be the only key holder instead of using multi-signature wallets between multiple entities (like Fidelity and Unchained capital as the other 2).

xiphias2··on How I tripped over the Debian weak keys vulnerability
https://news.ycombinator.com/item?id=6195493
xiphias2··on Llm.c – LLM training in simple, pure C/CUDA
Talking directly to the kernel / driver / firmware.

As others have said, George Hotz is doing his best in reverse-engineering and skipping layers.

xiphias2··on CUDA Is Still a Giant Moat for Nvidia
That same bug is still open, not fixed. Azure announced access to AMD GPU cloud with NDA, but the cards are unusable for compute work as they lock up randomly.
xiphias2··on CUDA Is Still a Giant Moat for Nvidia
A shortened version of what was happening: the firmware / hardware is so bad that instead of fixing it the AMD team just added some restarts when the AMD card locks up (which happens all the time with computatiins), and even those restarts don't work, the whole computer had to be restarted.

This serious bug was open since May and AMD doesn't seem to respond as seriously as it should be.

xiphias2··on Experiments with Bitnet 1.5 (Ngmi)
NVIDIA was confident enough to come out with FP4 cards for training, so 16 bit floats are not the best that can be done.

As most hardware speedups over the years came from decreasing precision, I'm sure NVIDIA tries everything to make FP4 work (and then get rid of FP8 multiplies if it can get away with it).

xiphias2··on -2000 Lines of Code (2007)
If you want to see an extrema of people being afraid to speak up, just look at the Gemini image examples in a company that in theory encourages people to speak up. There are always topics that are exceptions.
xiphias2··on Michael Saylor's MicroStrategy Raising Another $500M to Buy More Bitcoin
Accoding to the CEO (Michael Saylor) most of the price premium comes from institutions like pension funds not being allowed to directly hold BTC, but they are allowed to a ratio of the money in stocks. At the same time they need exposure to BTC as an independent asset that performs well (funds have performance mandates).

Of course now that spot ETF is approved it changes the picture somewhat, but it looks like MSTR is still needed as an institutional vehicle for wrapping BTC.

xiphias2··on Elon Musk sues Sam Altman, Greg Brockman, and OpenAI [pdf]
Actually NVIDIA just took over Saudi Aramco, but they are sharing 3rd position.
xiphias2··on Elon Musk sues Sam Altman, Greg Brockman, and OpenAI [pdf]
Progress is definitely not inremental, it's exponential.

The same performance (training an LLM with a given perplexity) can be achieved 5x cheaper next year while the amount of money deep learning infrastructure gets increases exponentially right now.

If this method is able to get to AGI (which I believe but many people are debating), human intelligence will just be mostly ,,skipped'', and won't be a clear point.

xiphias2··on I turned my open-source project into a full-time business
I see, do you think just _starting_ with payed product would have been better? (Or starting with a product + open source tools for marketing?)

BTW good luck to scaling up to $60k / month, it will be fun

xiphias2··on Google has another 'woke' problem with Gemini and it's going to be hard to fix
For many years before that we (Googlers) were incentivized to mix work and life:

Do you really think playing pool,foosball, guitar hero, eating dinner at 18:30 when work hours end at 17:00, bringing kids to workplace on weekends to play, sleeping at the workplace, bringing laptops with you / being oncall when not working are work appropriate?

The problem was specifically not agreeing with democrat US politics, which is relevant to what's happening, nothing else.

xiphias2··on I turned my open-source project into a full-time business
One important thing the author got from working on open source is free feedback (issues).

I don't view people taking the time to open issues as entitled people, but people offering their free time providing invaluable feedback.

Those issues are quite often different from what I expect, and they represent of how people are using the software.

The only mistake the author did was waiting too much monetizing, not doing open source software in the first place.

xiphias2··on Google has another 'woke' problem with Gemini and it's going to be hard to fix
James Damore spoke up and Google made an example of him.

The company already changed a lot before, but it was a strong signal that speaking up will be punished no matter how good engineer you are .

xiphias2··on Argentina Sees First Monthly Budget Surplus in 12 Years
I believe radical is a better wording than extreme, as the goal of Milei's politics is trying to make life better through a non-violent manner for all non-corrupt citizens. Even Milei knows it that he's running an experiment, and he doesn't deny it.

While it's extreme politics as well, that word is mostly used for violent politics that try to gain advantage for a group of people while bringing suffering to another big group of people.

← PreviousPage 14 of 34Next →