HNHacker News
TopNewBestAskShowJobs

diziet

2,147 karma · joined March 28, 2010

Alex Malafeev founder @ https://sensortower.com

We're hiring: https://sensortower.com/jobs

submissionscomments
diziet··on We need a more sophisticated debate about AI
I wanted to give another parallel - we understand what DNA does from a structural level of the building blocks up, but...

We're not close to being able to bio-engineer a 20 point IQ improvement, or the ability to regrow a missing limb, or the ability to grow muscle on demand, or the ability to forgo lipogenesis beyond some amount or or or...

To me the epistemological question on this is not just understanding the parts but being able to reason with some high degree of certainty about cause and effect and be able to simulate things, etc. I do not think it is totally correct to say that since we initiated the training runs on the LLMs and hence made them we understand them. There is a large difference between computers as physical engineered devices and X terabyte matrix weights that are a result of an emergent iterative process wherein we train it on a vast amount of data. The latest estimation for GPT3 training set is 500B tokens.

Unpredictable behavior manifests itself in the size of models demonstrated in that paper, which are quite small. Even with interpretability tools we have a long way to understanding relatively smaller models, as shown in said paper. The state of the art for the size for current models is vastly larger, and the interpretability challenges are larger too. We're not talking about word2vec here but we're talking about neural nets.

Can a large enough neural net with enough layers reproduce the effects of the human brain? Due to speed of neurons firing a lot of actions humans take are akin a few dozens to low hundred layers of a neural net. GPT3 has 96 layers. Yes, there are possibly temporal signals and more complexity in the way the human brain works, but we can solve that with scale. Imagine a model, running on a computer, that is enough to almost perfectly simulate the thinking process a human brain does. Do we know how it works? I don't think we can say we know how human brains work from an information processing capacity.

I think we're defining the problem differently. Understanding the underlying hardware (though frankly, I for example don't know what is running on Intel's Management Engine) and principles of software still do not necessarily scale to understanding, especially when in a relatively short time we will have multi trillion parameter multi terabyte scale LLMs or other NN powered models. Now, let's scale it a few more orders of magnitude...

Thank you for linking the paper on The Surprising Creativity of Digital Evolution.

diziet··on We need a more sophisticated debate about AI
We are not close to determining the answer to Busy Beaver(5,5). Not every problem is decidable.
diziet··on We need a more sophisticated debate about AI
Here is an example of a paper on inner alignment misalignment with a relatively simple level of complexity and even reward/punishment layers visualized.

https://arxiv.org/pdf/2105.14111.pdf

The authors show specific examples of goal misalignment. To say that we know how something works because we know the underlying principles is not correct. What is going on in a 150gb~ 65B parameter model (ie, llama 65B) of matrix multiplications is not just complexity, it is tough to say "we know how they work inside".

We can explain backpropagation and transformers and RLHF principles. When you scale that to the size of GPT2, the model layers become practically inscrutable to our current understanding.

You can have a conceptual understanding of chemistry and physics, but that knowledge is not enough to look at a human brain and say "We know how it works inside!".

diziet··on Pausing AI Developments Isn't Enough. We Need to Shut It All Down
within some constraints it is possible to "beat" stockfish.

Ie, on chess.com I think stockfish times out on bullet games.

Some versions of stockfish can lose vs specific gambits, ie: https://www.youtube.com/watch?v=C5ul6b695Pw https://www.youtube.com/watch?v=TtJeE0Th7rk

of course it is probably much less likely with more cpu times on current version of stockfish.

diziet··on Mysterious leak of Booking.com reservation data is being used to scam customers
I've had this same experience multiple times with US hotel chains.
diziet··on I measured the pollution from my gas stove
What specific meter did you use? I want to try it myself.
diziet··on Meta Quest Pro – Bad AR Passthrough
Not having the battery be on the device but plugged in the phone or on a waist strap, and using more expensive, but smaller pancake vs fresnel lenses can make the effected perceived weight a lot.
diziet··on Grade inflation: What goes up must come down
As echoed before in the discussion, I suspect for most jobs the GPA one receives is not relevant not even disclosed in job applications. It might matter for folks going for graduate degrees / law / med though. A 180 on the LSAT or 528 on the MCAT speaks quite a bit, too.
diziet··on Building an e-ink weather display for our home
I wish there was a weather station I could purchase that would do 2 things:

Give an hourly (or 2 hour) 24.. or even 12 hour weather forecast, in 6-12-24 chunks. Allow natural scrolling to see hourly forecast for further than 12/24 hours.

Give a 7 day weather forecast. No need to connect with a wind direction sensor or anything fancy, just pull from the weather.com api or anything similar

It would also not show me ads or try to track me or crash. I would even be ok dedicating a full time iPad/other device to display this.

diziet··on Level responds to lock picker opening its $330 Apple Store lock in seconds
Those two methods seemed very simple and not a high skill attack at all. Aren't there a lot of commercially available lock cylinders/cores that prevent these attacks from multiple manufacturers that Level could swap their sourcing for?
diziet··on Housing in Tokyo is cheaper and more spacious than people think
I actually compared train-to-train distance to Hachioji, not Okutama.
diziet··on Housing in Tokyo is cheaper and more spacious than people think
Okutama, Tokyo is part of "Tokyo Metropolis". https://en.wikipedia.org/wiki/Okutama,_Tokyo . The furthest I've been is Hachioji, which was about 1 hour by train from 23-ku. Hachioji is roughly half as far as Okutama. In New York City terms, getting to Hicksville, NY takes about 1 hour by train. For Bay Area folks, both Dublin / Pleasanton and Bay Point / Pittsburg ... or even Antioch are about an hour away by BART.
diziet··on New motorcycle lighting design could save lives
Paper appears available here via "Open PDF in Browser" link:

https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4084982

diziet··on Why do all these 20-somethings have closed captions turned on?
Closed Captions are more available now through settings, great audio <> text models, exposure of people to foreign language films and shows, etc. The 20-somethings are exposed to it more and adopt to using them. Youtube's closed captions are both a noticeable button and a "c" keyboard shortcut.
diziet··on Imagen: An AI system that creates photorealistic images from input text
A photo of a Shiba Inu dog wearing a sunglasses and black leather jacket playing a guitar in a garden, does not work correctly.
diziet··on The EU Commission accepts high error rates when checking chats
The fact that type I and type II error rates are not mentioned is an interesting point by itself.
diziet··on Apple Silicon is an inconvenient truth
The Apple.com e-commerce website allows much more configuration and customization options, ie: offering more colors and memory / disk size configurations, engraving, etc. The experience on the apple website is really excellent.
diziet··on Apple Silicon is an inconvenient truth
The reason for exclusion of Apple products might have something to do with how the Apple Affiliate program ( https://www.apple.com/shop/performance-partners ) functions. Wirecutter doesn't seem to list products without strong affiliate programs. See previous related discussion: https://news.ycombinator.com/item?id=31541669
diziet··on Sunsetting Atom
I hear you, but atom and vscode are noticeably slower at interacting and searching even at those small file sizes. So we're in violent agreement here!
diziet··on Sunsetting Atom
Will it be native Sublime Text fast? Not on electron?

I tried using VScode and Atom. Both were noticeably slow compared to sublime text. I can do silly, bad practice things like open a 50 meg log file in sublime and search for simple regex in the editor. Electron based editors stall and potentially crash.

diziet··on Reverse engineering Xiaomi air purifier NFC stickers
The Best Drill article doesn't even mention impact drivers, which are going to be tremendously easier on the wrist/hand for screwing in screws. An explanation for the lay audience would help. Nor are questions such as: "How much torque is there? What is the torque curve? How much torque do you need? Do you need a hammer drill? What is the noise like?" addressed.

I do think more specialty gear is hard to cover, as for example the the impact driver here: https://www.youtube.com/watch?v=l_pCeGmQU8w or AvE's youtube coverage of tools goes beyond that. Project Farm tends to have better coverage of general equipment with pretty good objective tests: https://www.youtube.com/channel/UC2rzsm1Qi6N1X-wuOg_p0Ng but even he can't cover all the brands/models: He covered Festool but not Hilti's SF 2H-A Hammer, for example.

Techgearlab has pretty unbiased coverage, and they also have an small incentive to cover products that have affiliate programs -- however, for example their parent rock climbing site Crash Pad Coverage: https://www.outdoorgearlab.com/topics/climbing/best-boulderi... includes Organic pads which have no affiliate program.

diziet··on What Ever Happened to Scandium Bike Frames? (2016)
There are a few of ski manufacturers making Scandium-based/reinforced skis.
diziet··on Choosing the Right Wall Anchors
Also relevant from the amazing Project Farm youtube tester:

https://www.youtube.com/watch?v=lHb-Tcvkn7M

diziet··on Breeze Keyboard
Cool idea, I appreciate the effort to make it affordable, and the wider spacing around the arrow keys. I do wonder why the shift key is regular key sized -- I find hitting it with the little finger requires more target space.
diziet··on How to lower the price of plant-based meat
From an athletic or 'health' perspective, these plant-based meat substitutes have way too high fat content. You can get 93+% lean beef with 3-4 grams of fat per 20~ grams of protein, or even higher with game meat. None of the plant proteins appeal to a healthy eater, with the high coconut/canola/sunflower oil content.
diziet··on We Test PCIe 4.0 Storage: The AnandTech 2021 SSD Benchmark Suite
The amount of thought that the Gamer's Nexus team puts in their work and benchmarks is incredible.
diziet··on Our Journey to PostgreSQL 12
Imagine there are 10m users. That's 600kb per user.
diziet··on A review of Dominion, 4000 plays later (2012)
It looks like most of them were removed for being too weak.
diziet··on Science Fiction Books I’ve Read (2018)
Well, I wouldn't really say Banks wrote Hard SciFi, but the authors you mentioned are great.
diziet··on Neighborhoods with Limited Access to Streets
I checked the neighborhood I grew up in Ukraine, that had great road access. It was orange and red. I think the methodology is too aggressive.
← PreviousPage 4 of 23Next →