HNHacker News
TopNewBestAskShowJobs

loveparade

2,076 karma · joined December 30, 2022

Meet Me At The Love Parade
submissionscomments
loveparade··on Ask HN: How can I get rid of addiction to HN?
This, and it applies not just to HN but all distractions. I have periods where I cycle through various distractions. Sometimes I don't visit HN for a few weeks, but I instead visit a reddit community that I discovered. Then I drop reddit for a few weeks and replace it with Twitter. Then I replace Twitter with playing a game instead. It's not because any of these are particularly interesting or useful, it's because I want to escape from whatever else I'm supposed be doing, which most of the time is boring work.
loveparade··on Is modern mass media a mind prison?
I agree for personal usage, but I'm struggling to justify throwing away social media for work-related usage. A lot of opportunities and connections in my life have come from being active on social media.
loveparade··on Exodus Bitcoin Wallet: $490k swindle
No, I don't. But Bitcoin also isn't particularly interesting because it's not (very) programmable and not useful for mainstream use anyway. I don't consider Ethereum itself a pyramid scheme, just useless. The protocols on top of these chains though, nearly all pyramid schemes. The best way to describe Ethereum is that it provides a platform for pyramid schemes.
loveparade··on Exodus Bitcoin Wallet: $490k swindle
Solutions have been on the way for more than five years, but literally nothing has changed and all we've gotten is pyramid schemes and gambling. Chains and protocols have exploded in complexity and technical debt to the point where nobody fully understands the attack vectors. By now I am convinced that anything beyond pyramid schemes is never going to happen.
loveparade··on YouTube's search function is atrocious now [video]
The most frustrating thing about youtube is how it's not smart enough to figure out that I want to watch "XX Part 55" after watching "XX Part 54". It just gives me random other videos on autoplay.
loveparade··on A steep rise of Hacker News in Google rankings
I disagree with the harder problem. I agree that the problem is low-quality comments, but not the lame or mean kind. When I see comments on a topic I happen to be an expert in it's obvious to me that the majority of them are misinformation or uninformed users. These people don't mean harm, they are legitimately misinformed or inexperienced. There typically are insightful comments as well, and often they are upvoted, but they have become the minority compared to the low quality comments. This ratio has steadily gotten worse over the past years. It's not as bad as reddit, but every pseudonymous community seem to suffer this problem as it's directly tied to trust and identity. There is very little to be gained from comments on HN anymore, I mostly come here for the links now since it's a decent source of news curation.
loveparade··on Let me clear a huge misunderstanding
Self-supervised learning is such a trivial concept that it doesn't need a new term. It's just marketing/PR speech to attract attention. You could just call it "generating labels from data"

All these stupid new terms of trivial concepts confuse people who are new to the field. That's nothing new though, research has always been like this, people love to make up new phrases that they can own and sell as novel ideas to reviewers, even if they're just trivial renamings. It's nothing more than a PR game.

loveparade··on Why Crypto and Bitcoin not going to 0 if it's all scam?
Yeah, I don't understand either. How could HN or random internet people ever be wrong about something?
loveparade··on $500 a day to pretend to be a model: The big business behind OnlyFans 'chatters'
> Imagine if dating apps paid you to keep your profile active even if you have no interest in meeting anyone. They pay you $5/month per match with a minimum of 5 messages before ghosting. It keeps lonely men on the platform. For some people, OnlyFans chat is no different.

What many dating apps do is very close to this. They encourage fake female accounts to keep men on the platform, and what you are being shown is fake/inactive to a large extent. LLMs are the next step of this, I wouldn't be surprised if there are already tons of them. The dating app business is one of the most scammy businesses that exist.

There are some exceptions to this (mostly specific local apps), but they are far and few between.

loveparade··on Simplifying Transformer Blocks
I don't think we disagree. All I am saying is that if your goal is to filter papers by their likelihood of having a useful result, the best signal is the author and their reputation, not necessarily the content (unless there is perhaps some obviously amazing demo). We don't disagree that for the community as a whole the system of publishing early and often is much better than the alternative of imposing restrictions.
loveparade··on Simplifying Transformer Blocks
It has always been like this in DL research. Also, providing justification doesn't necessarily help, because they are usually just guesses. The problem goes deeper than this. It's easy, and common, to make up justifications after the fact. You can try a bunch of random stuff, some thing randomly works, and then you make up an explanation for why it works that sounds plausible, but in reality is nothing more than a fictional narrative to convince reviewers (and possibly yourself). The underlying problem here are the incentives of the academic system. Reviewers reward good narratives and stories. Also, in DL especially, it's quite difficult to perform ablation studies or get statistical significance numbers due experiments taking a long time to run.

I hate to say it, because that's not how science should work, but with the flood of papers, looking at who wrote a paper is probably one of the more reliable indicators of quality. The reason is that people with a reputation are putting their reputation at stake when publishing something. Publishing BS would reflect badly on them, so they tend to go through more quality control. An unknown researcher at an unknown lab has nothing to lose by flooding arxiv with BS papers, which on the surface are indistinguishable from high quality work.

loveparade··on Ask HN: Why do half of Internet users think we are living in a simulation?
This whole argument is meaningless because the term Simulation isn't well defined. In the narrowest sense, you could define simulation as "human-like creatures running computer-like machines that we're part of, just like the Matrix". In the broadest sense you can define simulation as "The universe follows a set of fixed physical laws, and we are part of that"

While the former is just ridiculous, the latter is pretty plausible. When people are answering this question they can imagine any definition of simulation they like.

loveparade··on Choose the browser that best suits your privacy needs
A decade or so ago when Chrome was first released there were good reasons to switch to it. It was better than Firefox in almost every way, especially speed.

Today that's no longer the case, but there also isn't a huge reason to switch to Firefox. They're all kind of the same, especially to the average user who doesn't strongly care about privacy.

loveparade··on Please ignore the deluge of complete nonsense about Q*
They have the scale in terms of hardware, but they likely don't have the infrastructure to experiment efficiently on this scale on LLMs specifically. OpenAI has been building LLM-specific infrastructure for years. Why do you think Google Bard sucks so much? It's not because there's some special magic secret that only OAI knows. It's because you need a huge amount of purpose-built infrastructure and trial-and-error iteration from experiments each of which take months. You can't easily catch up to that in a few months. Even if you throw 10x more staff at it, you are not going to make progress faster.

The only way you could catch up faster is by having orders of magnitude more hardware. But due the global shortage on hardware right now, nobody has that, not even Google.

loveparade··on Please ignore the deluge of complete nonsense about Q*
If you do search for Reinforcement Learning based decoding in language models (or neural machine translation) you'll find hundreds of papers. It's a super common research topic that has been around forever, way before LLMs were a "thing". Just follow the reference from there. Nothing new here, really.

But doing it on the scale of something like GPT-4 is only something OAI can do, and I don't doubt that there's some breakthrough there. But IMO it's likely that the breakthrough isn't algorithmic, but a result of scale, like most of the other OAI breakthroughs.

loveparade··on Ask HN: OAI employees who signed to follow Sam, what was your decision process?
I think the primary reason was that there's little to lose by signing the letter. It's not a legally binding agreement to quit and never go back. If you changed your mind, OAI would happily take you back. On the other hand, if you don't sign you'll lose a potential opportunity.

So from a game theory perspective the only rational action is to sign, no matter what you believe.

loveparade··on Spinning Up in Deep RL (2018)
Needs a (2018)
loveparade··on Before OpenAI, Sam Altman was fired from Y Combinator by his mentor
I subscribe to the HN RSS feed, which shows flagged items since they're published on the feed before they're flagged. The craziest thing that stands out to me is how so many negative stories on Sam Altman end up being flagged, even though they are just as legit as the positive ones. I'm almost 100% certain that HN is highly manipulated for this story.

For no other topic have I seen so many flagged stories, and all of them are the ones that paint Sam in a negative light.

loveparade··on Before OpenAI, Sam Altman was fired from Y Combinator by his mentor
If you give me the choice between making a lot of $$$ by working for a for-profit company or staying at a nonprofit with limited upside I'd also choose the former, even if I don't like the CEO much. Don't know where this myth of "people followed him" comes from. There is no evidence for it.
loveparade··on Ask HN: Great Interview Questions You Have Been Asked
This is a great one!
loveparade··on We have reached an agreement in principle for Sam to return to OpenAI as CEO
I think people following Sam Altman is jumping to conclusions. I think it's just as likely that employees are simply following the money. They want to make $$$, and that's what a for-profit company does, which is what Altman wants. I think it's probably not really about Altman or his leadership.
loveparade··on We have reached an agreement in principle for Sam to return to OpenAI as CEO
> I think only a minority of the general public truly cares about AI Safety, the rest are happy seeing ChatGPT helping with their homework

Not just the public, but also the employees. I doubt there are more than a handful of employees who care about AI Safety.

loveparade··on Sam Altman exposes the charade of AI accountability
Depends on your definition of AI Safety. Like you said, there is in fact some very legit research that (unfortunately) is done under the umbrella of "AI Safety", but that's quite different from the threat-to-humanity AI safety crowd.
loveparade··on Sam Altman exposes the charade of AI accountability
The problem is the same as some of the woke movements. Nobody wants to publicly speak out against AI safety BS because a Twitter mob who has made a career out of it will descend onto them and ruin their career. There is nothing to gain from speaking out against it, but you gain career opportunities by being part of the AI safety BS community. In fact, this has happened with Hinton (I think it was?) when he dared to explain how models aren't inherently biased. Had to publicly apologize for it later.

Even ML conferences have AI safety tracks these days. Nobody sane wants to be excluded from opportunities.

loveparade··on Sam Altman exposes the charade of AI accountability
I think people have yet to realize that this whole AI Safety thing is complete BS. It's just another veil, like Effective Altruism, to get good PR and build a career around. The only people who truly believe this AI safety stuff are those with no technical knowledge or expertise.
loveparade··on Ask HN: Extracting insights from personal knowledge database?
I stopped using Obsidian, etc for this reason. I spent a fair amount time creating a database but never got real value out of it. It was just a waste of time. I'm questioning the whole premise of these systems. Why do I need a personal database when I can find anything I need on demand online?

I now have a few simple text files with project ideas, book notes, and todos. It feels much better and I don't spend time managing it.

loveparade··on Definite Guide to Building a Machine Learning Platform
If I were to ask ChatGPT to write a vague content marketing piece about MLOps for SEO purposes, this is exactly what I'd get.
loveparade··on Sam Altman, Greg Brockman and others to join Microsoft
Yes, for most AI researchers the umbrella organization (or university) doesn't matter nearly as much as the specific lab. These people are not going to work at Microsoft, they are going to work at whatever that new org is going to be called, and that org is going to have a pretty high status.
loveparade··on Sam Altman, Greg Brockman and others to join Microsoft
"Talent secured"
loveparade··on Sam Altman, Greg Brockman and others to join Microsoft
I agree, any potential hire who has the choice between OpenAI and the new team at MSFT will now choose the latter. And a lot of the current team will follow as well. This is probably the end of OpenAI. Can't say I'm too sad, finally a chance to erase that misleading name from history.
← PreviousPage 7 of 13Next →