HNHacker News
TopNewBestAskShowJobs

andreyk

5,023 karma · joined December 28, 2015

www.andreykurenkov.com
submissionscomments
andreyk··on Why Twitter didn’t go down: From a real Twitter SRE
Yep, agree. Twitter's revenue was primarily from ads, and now I'd bet their ads revenue has dropped a huge amount. Given how Musk is behaving now (reinstating Trump etc.), and losing many pivotal sales people, and the firing of a ton of people in charge of dealing with hate speech and such, it seems unlikely advertisers will return now.
andreyk··on 100s of Twitter employees leaving after Musk's 'extremely hardcore' work demands
Wrt 2: "I am going to miss this place. We built something special here, and I do not expect to see its like ever again. I have worked here at Twitter for over 11 years. Back in July, I was the 27th most tenured employee at the company. Now I'm the 15th. I am not going to click "yes""

https://mobile.twitter.com/THISWILLWORK/status/1593376111563...

Twitter is full of employees with 5-10 years of experience sharing that they are leaving. There is no doubt many people with critical knowledge and skills that are not easily replaced are gone.

andreyk··on The Fediverse is inefficient but that's a good trade-off
I don't think it a large proportion; the vast majority of users are on a few large instances such as Mastodon.social which are not via MastoHost. The owner also stated he would not want to host more than a 4th of all instances

https://masto.host/the-25-percent-commitment/

We will likely migrate to our own cloud setup once size gets stable.

andreyk··on The Fediverse is inefficient but that's a good trade-off
Signing up and using it is no more complicated than Twitter once you choose an instance. The Gradient (which I am part of) set up a new Mastodon instance (sigmoid.social) last week for the AI community which now has 3.5k active users - it took off rather quickly. My hope is that Mastodon becomes like a cross between Discord and Twitter; specific communities such as AI people set up an instance for themselves via a simple hosting service (eg we used MastoHost which made it almost as easy as starting a Slack or Discord) which makes signing up super easy.
andreyk··on Sigmoid Social, a Twitter Alternative by and for the AI Community
Note: it appears that Google Safe Browsing decided to flag our site for some reason, and Chrome now says "Deceptive site ahead" when going to it.

We have no idea why this happened, and we'll work to fix it. Bear with us please.

andreyk··on Moderation is different from censorship
Isnt part of the appeal of federation that each instance/server can set its own rules and moderation teams? Much like Discord / reddit / etc.
andreyk··on Taking a Look at Mastodon
I think mass migration of people from Twitter to Mastodon is unlikely, but I do have some hope that specific communities will be able to make the switch. For instance, just yesterday I set up a new instance -- which was incredibly easy thanks to masto.host, literally two clicks and a config change on Namecheap -- that can hopefully become a space for people interested in AI to move to from Twitter (in case you are curious, it's https://sigmoid.social/).

Here's my rationale: Twitter is kind of invaluable if you are an academic working in AI (and in many other fields as far as I can tell), it's a great way to discover new work as well as promote your own (and yeah there is silly drama sometimes, but it's rare). Many academics genuinely love it, including myself. Those same academics generally loathe or at least dislike Musk, and worry about the future of the platform, and don't care that much about non AI stuff on there. So if just the part of Twitter you care about it migrates to a Mastodon instance, such academics would likely consider it. And if you are a person or entity with a decent following on Twitter, it does seem feasible to encourage the community to at least try to move over. Maybe, maybe not, but I figure it's worth a try (I am planning to announce it on Twitter later this week).

andreyk··on Tell HN: YouTube's web UI just got even worse
I also usually watch from subscriptions (I am subscribed to 100s of channels). But I do like the home page and recommendations for discovering new channels! In my experience it actually captures what I like to watch a lot (perhaps because I subscribe to a lot of stuff and like many videos).
andreyk··on Tell HN: YouTube's web UI just got even worse
Why even worse? I use youtube a LOT and I don't particularly dislike it.
andreyk··on Shutterstock will start selling AI-generated stock imagery
Fair question. For something as simple as "women laughing with salad", totally, you can generate yourself. But, for anything less concrete/more conceptual, I think needing to explore various options will remain. Often when you are looking for a stock photo you don't have an exact idea of what you want in mind - just something that might fit with the article/concept. So you search a few different things on Shutterstock and see what kinds of stuff exists and looks good. The question is, is it going to be quicker and easier to explore the prompt space (try a prompt, see what happens, revise, see what happens...), or will it be easier explore the space of uploaded photos/generated media by other creators by just searching on a site such as Shutterstock. Basically I think there is still going to be a market for people who just want to find stuff that is generated instead of generating it themselves.
andreyk··on Shutterstock will start selling AI-generated stock imagery
DALL-E and such is often not good enough yet to generate conceptually specific stock stuff (just try to generate nice looking cartoonish illustrations that look natural); as someone who uses stock photos/illustrations pretty often, just looking up human creations is often still easier and faster (and not that much more expensive). And if they offer both AI and non-AI generated stuff, isn't the whole point for them to stay relevant as the main platform for getting stock photography.
andreyk··on Behind TikTok's boom: A legion of traumatized, $10-a-day content moderators
To be fair, this is true for solo artists in general - musicians, writers, indie game devs, youtubes. Even substack writers. More often than not it takes a long time to build up an audience and all.
andreyk··on Fake Books
I've watched the video as well and wholeheartedly agree! His 'Line Goes Up' documentary about crypto is also exceptional; very critical but in educated and actually nuanced ways (https://youtu.be/YQ_xWvX1n9g).
andreyk··on Most people on antidepressants don’t need them
Pretty short article, this quote sums it up: "When the results of all trials submitted to America’s medicines regulator between 1979 and 2016 were scrutinised by independent scientists, it turned out that antidepressants had a substantial benefit beyond a placebo effect in only 15% of patients."

It's unclear what paper they refer to, as it is not linked. This article (https://www.ncbi.nlm.nih.gov/books/NBK361016/) has many citations to papers that cover this stuff. I think the important take away is in "Antidepressant drug effects and depression severity: a patient-level meta-analysis" (https://pubmed.ncbi.nlm.nih.gov/20051569/):

"Results: Medication vs placebo differences varied substantially as a function of baseline severity. Among patients with HDRS scores below 23, Cohen d effect sizes for the difference between medication and placebo were estimated to be less than 0.20 (a standard definition of a small effect). Estimates of the magnitude of the superiority of medication over placebo increased with increases in baseline depression severity and crossed the threshold defined by the National Institute for Clinical Excellence for a clinically significant difference at a baseline HDRS score of 25.

Conclusions: The magnitude of benefit of antidepressant medication compared with placebo increases with severity of depression symptoms and may be minimal or nonexistent, on average, in patients with mild or moderate symptoms. For patients with very severe depression, the benefit of medications over placebo is substantial. "

Short version: if your depression is mild, antidepressants may not work better than a placebo (though placebos are not exactly nothing). If it's severe, there is more of a chance it'll really help,

From my personal experience, I can definitely attest to them helping, though they are not by any means a magic bullet.

andreyk··on Meta Quest Pro
Meta's whole vision of the 'metaverse' may be silly, but come on, this is super exciting! The specific use case of using this for meetings aside, it just looks like a pretty huge leap forward in terms of hardware for AR/VR. It remains to be seen whether AR/VR is actually useful for things beyond playing video games, but my bet is that it will definitely be the case. Maybe this sort of hardware won't be quite as impactful/omnipresent as personal computers or smartphones, but it seems like it could be on the same order of magnitude as those things long term.
andreyk··on Starting a Business Around GPT-3 Is a Bad Idea (2020)
It has happened in some cases, eg with all the "generate marketing copy with AI" businesses.

But yeah, in general the article assumes that GPT-3 will have lots of applications that make it super easy to make a useful product with very little extra effort, and that is just not true. Twitter demos are easy, robust and useful products are not.

andreyk··on Starting a Business Around GPT-3 Is a Bad Idea (2020)
The Implicit assumption here is that AI in general is one of several possible tools to a given problem. This is true in some cases, but not in others (eg media synthesis, automated transcription/translation/classification, etc.). So I think "starting a business around AI" should imply that AI is a core necessity, not just a chosen tool. Granted, it may be just one tool among many that could be useful, even if it necessary.
andreyk··on The AI Scaling Hypothesis
I think comparing to humans is a bit of a distraction, unless what you care about is replicating the way human intelligence works in AI. The mechanisms by which learning is done (in these cases self-supervised and supervised learning) are not at all the same as humans have, so it's unsurprising the qualitative aspects are different.

It may be argued we need more human-like learning mechanisms. Then again, if we need internet-scale data to achieve human-level general intelligence, so what? If it works it works. Of course, the comparison has some value in terms of knowing what can be improved and so on, especially for RL. But I wouldn't call this a 'troubling problem'.

andreyk··on The AI Scaling Hypothesis
I agree - I think scaling laws and scaling hypothesis are quite distinct personally. Scaling hypothesis is 'just go bigger with what we have and we'll get AGI', vs scaling laws are 'for these tasks and these models types, these are the empirical trends in performance we see'. I think scaling laws are still really valuable for vision research, but as you say we should not just abandon thinking about things beyond scaling even if we observe good scaling trends.
andreyk··on The AI Scaling Hypothesis
agreed, we did not discuss that sufficiently
andreyk··on The AI Scaling Hypothesis
Thanks! I'll take a look, those do look interesting.
andreyk··on The AI Scaling Hypothesis
Co-author here, happy to answer any questions/chat about stuff we did not cover in this overview!
andreyk··on Mastodon.technology Shutdown
As per my comment in reply to monkin, I keep wondering why there isn't an open source website that makes it (almost) as easy to setup a fediverse instance as it is to create a Discord or a subreddit. Surely it's possible for a service to have a nice frontend UI for easy administration by non-technical users, while at the backend dealing with the technical API calls to cloud providers to make it all happen?

This sort of website would be incredibly light weight (just API calls, no data storage), and the users would not be tied down to it; as long as they retain ownership of the login credentials to whatever cloud provider they choose, even if this front end shuts down the fediverse instance won't. And if it's open source, it would be easy to migrate to another such 'frontend management' website.

I have thought about this quite a bit, and it seems like a great idea - is there something I am missing (aside from it perhaps being nontrivial to set up a Fediverse instance via API calls to cloud providers)?

Of course, a clear issue is that there would still be (small) ongoing costs even for tiny instances, so it would not be the same as Discord or reddit in terms of having a 'free tier'. But the pitch of a 'personalized social media website' seems like a pretty cool idea and i'd be willing to pay a bit to try it out.

andreyk··on Mastodon.technology Shutdown
I think the problem is exactly that the average consumer can't start their own instance. What if there was a front-end service that made creating a fediverse instance as easy as creating a discord or Slack, and handled all the messy technical stuff with setting up an instance for the average user, while at the same time allowing said user to have full control of the cloud files? The front end would be incredibly light weight (just API calls, no data storage), so even if it shut down, as long as it is open source someone else could run their own instance of it on a different URL and the user could keep admin of their instance through that.
andreyk··on Imagen Video: high definition video generation with diffusion models
Yep. The people who build Imagen are researchers, not engineers, and these announcements are accompanied by papers describing the results as a means of sharing ideas/results with the academic community. Pretty weird to me how so many in this thread don't seem to remember that.
andreyk··on DALL·E Now Available Without Waitlist
Great summary - just to add my 2 cents, I find Midjourney is far better than DALL-E 2 for creating 'artistic' / visually appealing images. DALL-E 2 actually struggles sometimes to be un-realistic, whereas MidJourney has no trouble being a bit weirder / out there.
andreyk··on I Visited Bucha Today
Plenty of politics stories do get posted and discussed as on-topic, even if they are the minority. I mean, "Russian forces invade Ukraine after Putin orders attack" was a huge thread on here... https://news.ycombinator.com/item?id=30450336

These guidelines are deliberately broad and allow for many exceptions wrt politics.

andreyk··on I Visited Bucha Today
It seems to me that lots of things get upvotes from people who just want to discuss it and don't click to actually read it. In particular, I wonder how many things in the 'new' page actually get read before being upvoted -- links are usually on the first page of 'new' for only 15 minutes or something like that. It would be interesting to see the composition of the front page if people instead had to click first before being able to upvote.
andreyk··on Did GoogleAI just snooker one of Silicon Valley’s sharpest minds?
Technically this is possible with these same techniques if you just initialize the image with the prior one, though I am sure that does not work that well.

Really you need image+text->image instead of just text->image generation. Some examples of relevant papers: "Conditioned and composed image retrieval combining and partially fine-tuning CLIP-based features", "IMAGE GENERATION WITH MULTI-MODAL PRIORS USING DENOISING DIFFUSION PROBABILISTIC MODELS". There was a more recent one I saw on Twitter I don't recall the name of. I wouldn't be surprised if these kinds of things work well by a year from now.

andreyk··on Show HN: TattoosAI – AI-powered tattoo artist, using Stable Diffusion
FYI, you still have "Lorem ipsum dolor sit amet, consec tetur adipis elit " in the pricing page.

Also, the ideas page has lots of weirdly low quality stuff (eg heath ledger joker does not look like heath ledger, baby yoda does not look like baby yoda, Totoro tattoos are generally bad, etc.). And then there are things like this: https://www.tattoosai.com/tattoos/62ecce4651c8873ccf2bbe67

The pricing model of a one time payment is also quite weird... I get that this is a quick project so it's not polished, but as I would not start charging for it.

← PreviousPage 4 of 21Next →