HNHacker News
TopNewBestAskShowJobs

sinemetu11

324 karma · joined May 23, 2013

Software Engineer

https://github.com/sinemetu1

submissionscomments
sinemetu11··on LLMs use a surprisingly simple mechanism to retrieve some stored knowledge
From the paper:

> Finally, we use our dataset and LRE-estimating method to build a visualization tool we call an attribute lens. Instead of showing the next token distribution like Logit Lens (nostalgebraist, 2020) the attribute lens shows the object-token distribution at each layer for a given relation. This lets us visualize where and when the LM finishes retrieving knowledge about a specific relation, and can reveal the presence of knowledge about attributes even when that knowledge does not reach the output.

They're just looking at what lights up in the embedding when they feed something in, and whatever lights up is "knowing" about that topic. The function is an approximation they added on top of the model. It's important to not conflate this with the actual weights of the model.

You can't separate the hallucinations from the model -- they exist precisely because of the lossy compression.

sinemetu11··on Apple forced to make major cuts to Vision Pro headset production plans
Consider the alternative -- most people don't care about this device...how many non-video-game playing people bought a VR headset until now?
sinemetu11··on Cormac McCarthy has died
Blood Meridian.
sinemetu11··on Apple Vision Pro: Apple’s first spatial computer
So it's a big screen?

The tech looks impressive, and I'm sure many people will buy it. I'm guessing they'll also shortly after find it as exciting as their phones...

sinemetu11··on Sam Altman goes before US Congress to propose licenses for building AI
They reached a wall, and need to ensure others have a more difficult path to the same place.
sinemetu11··on Red meat is not a health risk. New study slams years of shoddy research
Did the author even read the abstract let alone the paper?

> We also found that while risk for the six outcomes in our analysis combined was minimized at 0 g unprocessed red meat intake per day, the 95% uncertainty interval that incorporated between-study heterogeneity was very wide: from 0–200 g d−1. While there is some evidence that eating unprocessed red meat is associated with increased risk of disease incidence and mortality, it is weak and insufficient to make stronger or more conclusive recommendations.

Doesn't sound like it particularly slams years of shoddy research.

sinemetu11··on Lab-grown meat may never be cost-competitive enough to displace traditional meat
I guess you could say this, but given that the planet is essentially burning it seems like we're getting way ahead of ourselves with this type of "solution" when we could be working on more important problems.
sinemetu11··on Lab-grown meat may never be cost-competitive enough to displace traditional meat
Tablespoon of peanut butter really isn't any more work. It's probably less.

> How many beans equal a serving of meat?

> In general, 1 ounce of meat, poultry or fish, ¼ cup cooked beans, 1 egg, 1 tablespoon of peanut butter, or ½ ounce of nuts or seeds can be considered as 1 ounce-equivalent from the Protein Foods Group.[1]

[1] https://www.myplate.gov/eat-healthy/protein-foods

sinemetu11··on Lab-grown meat may never be cost-competitive enough to displace traditional meat
You don't understand or you don't like it?

People eat more meat than they need. Most people would be healthier if they consumed less of it or none and substituted vegetables/beans/nuts for those calories while still getting proper amounts of protein from non-meat sources.

Reducing meat consumption reduces a bunch of other consumption of resources letting people get their calories more efficiently.

> Meat is considered one of the prime factors contributing to the current biodiversity loss crisis.

> the livestock sector is a major stressor on many ecosystems and on the planet as a whole. Globally it is one of the largest sources of greenhouse gases (GHG) and one of the leading causal factors in the loss of biodiversity, and in developed and emerging countries it is perhaps the leading source of water pollution.

> farmers would reduce their land use of feed crops; currently representing about 75% of US land use, and would reduce the use of fertilizer due to the lower land areas and crop yields needed. A transition to a more plant based diet is also projected to improve health, which can lead to reductions in healthcare GHG emissions, currently standing at 8% of US emissions [1]

What's not to understand? Stop eating meat. We don't need lab-grown meat. We don't need meat substitutes.

[1]https://en.wikipedia.org/wiki/Environmental_impact_of_meat_p...

sinemetu11··on Lab-grown meat may never be cost-competitive enough to displace traditional meat
Ah yes, most people's testosterone levels would be too low without meat. lol

Regular exercise should help with metabolism and just about everything else you could imagine.

sinemetu11··on Lab-grown meat may never be cost-competitive enough to displace traditional meat
Most americans would not meet suggested exercise levels for "relatively active" even if that was at the 30 min. per day level.

16% is 60% more than 10%. Most americans are consuming meat for at least 2 meals a day, possibly 3 for those who are eating sausage or bacon for breakfast.

The general point is that americans consume way more meat than what they actually need. This has been promoted heavily in the high protein diet fads recently. Educating people on what they actually need for a healthy diet would go a long way and cost a lot less than alternatives like lab-grown meat.

sinemetu11··on Lab-grown meat may never be cost-competitive enough to displace traditional meat
In which cases are the animals more efficient?

Most americans are consuming 100+ grams of protein a day (its very likely all of that coming from meat - I don't know anyone who consumes a lot of beans).[1] Average person needs about .36 grams of protein per pound of body weight.[2]

[1] https://www.nytimes.com/2017/07/28/well/eat/how-much-protein...

[2] https://www.health.harvard.edu/blog/how-much-protein-do-you-...

sinemetu11··on Lab-grown meat may never be cost-competitive enough to displace traditional meat
I wonder if lab-grown meat is also carcinogenic.[1]

Funds directed at educating the public on the amount of protein they actually need instead of high-protein diets would go a long way towards reducing energy consumption and emissions to help the climate. Lab-grown meat seems like the wrong direction when there are numerous good protein sources already.

[1] https://www.hsph.harvard.edu/nutritionsource/2015/11/03/repo...

sinemetu11··on Lab-grown meat may never be cost-competitive enough to displace traditional meat
> Getting people to stop beef in countries where it's not a problem is a waste

It's a problem. Most americans consume way more meat than what they could possibly need and they do it because they've heard they need lots of protein which could come from many other sources besides dead animals.

sinemetu11··on Lab-grown meat may never be cost-competitive enough to displace traditional meat
> If cultured protein is going to be even 10 percent of the world’s meat supply by 2030

Why do we need protein from meat? The money to engineer cultivated protein could be directed to educating simple americans on the fact that they're consuming way too much protein already. Most americans consume twice the daily protein they need.[1][2]

[1] https://www.nytimes.com/2017/07/28/well/eat/how-much-protein...

[2]https://www.health.harvard.edu/blog/how-much-protein-do-you-...

sinemetu11··on Lab-grown meat may never be cost-competitive enough to displace traditional meat
Plenty of brown rice, soy, nuts, beans etc for people to stop eating meat altogether if they actually needed more protein (they probably don't). ¯\_(ツ)_/¯

Maybe we should direct funds towards advertising meat-free and the benefits of not consuming carcinogenic meat instead of all of this meat replacement. [1]

[1] https://www.hsph.harvard.edu/nutritionsource/2015/11/03/repo...

sinemetu11··on In 2020, two thirds of Google searches ended without a click
Do AMP clicks count as no click since the user didn't leave google?

And how many are no click because google has presented semi-correct but not really correct information at the top of the results so the user finds what they think they're looking for without actually clicking?

Seems like google is doing just fine so I'd imagine both of the above scenarios account for a significant portion.

sinemetu11··on How bad is your Spotify?
AI means a chat bot in this case or? I don't see anything that would imply more interesting computation is going on under the surface here.
sinemetu11··on Understanding GauGAN: Model Evaluation Techniques and Comparative Performance
Wasn't Gauguin a paedophile?
sinemetu11··on Tech and Antitrust
Is all this antitrust talk directed at tech companies not just a way for media to direct that energy away from themselves?
sinemetu11··on Facebook Bans Louis Farrakhan, Milo Yiannopoulos, InfoWars and Others
By dangerous they mean dangerous to advertisers. Facebook's decisions like this have nothing to do with harm to humans. It's to profit.
sinemetu11··on Instagram hides Like counts in leaked design prototype
...or a modified hosts file.
sinemetu11··on The Healing Power of Gardens
One of the gardens pictured in the article, Elizabeth Street Garden, is a great spot in the middle of retail chaos in New York. Sadly a real estate development filed a lawsuit this month in hopes of destroying it: https://static1.squarespace.com/static/581fb257b8a79bf741c67...
sinemetu11··on Facebook Bans Far-Right Groups and Prominent Hate Figures
Indeed, see The Misguided Attacks on ACLU for Defending Neo-Nazis’ Free Speech Rights: https://theintercept.com/2017/08/13/the-misguided-attacks-on...
sinemetu11··on Rick Steves Wants to Save the World, One Vacation at a Time
Or just not eating meat. :P
sinemetu11··on An open letter to FB, Twitter, Instagram regarding algorithms and my son's birth
> the algorithmic rejection of my reality on these platforms takes a pretty consistent toll

That sucks. :/

https://someonewhocares.org/hosts/ and https://github.com/StevenBlack/hosts/blob/10bba14590738c445c...

sinemetu11··on An MSG Convert Visits the High Church of Umami
Many people don't know that tomatoes, cheeses and other foods naturally have MSG. And:

> FDA considers the addition of MSG to foods to be “generally recognized as safe” (GRAS). Although many people identify themselves as sensitive to MSG, in studies with such individuals given MSG or a placebo, scientists have not been able to consistently trigger reactions. [1]

[1]: https://www.fda.gov/Food/IngredientsPackagingLabeling/FoodAd...

sinemetu11··on Search engine manipulation effect and possible impact on election outcomes
> Specifically, we show that (i) biased search rankings can shift the voting preferences of undecided voters by 20% or more, (ii) the shift can be much higher in some demographic groups, and (iii) such rankings can be masked so that people show no awareness of the manipulation.

Interesting research given how everyone is currently looking at facebook.

sinemetu11··on Caffeine and Cannabis Effects on Vital Neurotransmitters in Rats
Yep - illusion of explanatory depth: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3062901/
sinemetu11··on Facebook Really Is Spying on You, Just Not Through Your Phone's Mic
On desktop I use a custom hosts file redirecting all facebook and instagram traffic to localhost. Can the same be done on my iphone?

A "like" or "instagram this" widget is all they need to track basically everything you do even if you don't have fb.

Page 1 of 2Next →