Evolving beyond 100B recommendations a day at Reddit
reddit.com
reddit.com
Reddit has been sort of this weird place where they face the issues that Digg and Twitter have and want to slowly transition itself into some Facebook competitor but due to the communities that exist on the platform its a really hard sell. The new UI is harder to use and visually distracting. It feels like they just want you to use the App so you have to look at their advertisements.
For instance, Eddie Van Halen recently died. So I clicked on a few links from Twitter to check out some concert highlights from his life and career.
Now my entire YouTube recommendations feed is nothing but Van Halen and 1980s rock music.
The Go-Go's recently got inducted into the Rock and Roll Hall of Fame. I clicked on a few links from Twitter to see some highlights.
Now my entire YouTube recommendations feed is nothing but the Go-Go's and 1980s pop music.
And not only that, but because I don't use Google search anymore, the only signal that Google can get from me is my YouTube watching, so my Google Now (swipe-left sidebar on Android phones) is nothing but Van Halen and the Go-Go's.
It's the dumbest freaking recommendation engine on planet Earth. It's ridiculous how bad it is.
I ask myself this question every time I watch a youtube video. A lot of them I watch with private browsing to avoid it. Though lately it feels like I'm getting stuff recommended despite the private browsing measure.
Absolutely, some of the recommendations seems to be recommended based on IP. I don't watch anime but I have friends that do, sometimes after they visit my place, I start getting ads for manga and anime for a few days, until they figure out I'm not actually interested in it.
I also browse stuff via Firefox Focus on my phone, and get related content recommended on my desktop just minutes after watching something for the first time on the phone.
Basically in firefox do a "open in container tab" instead of "open link in private window".
Sometimes I wonder if The Algorithm know something that we don't.
Honestly, though, that is the ad targeting that people are scared of (I know I am), but I am absolutely unconvinced that's what it is. Whenever I need a fresh perspective on tracking, I turn off all of my anti-tracking things and adblockers and search for toilets. Everything you see after that is related to toilets like you're some kind of collector and hoarder of toilets.
Youtube's recommendation engine is to get you click on it and watch a certain percentage.
It's not designed to show you things that you "like." It's way more sophisticated than that.
Nowadays it's hot garbage. I just checked. There's 7 videos in there it's been pushing on me for the better part of the year but I have no interest in. 4 videos I've already watched (and it KNOWS this because it shows the full red bar at the bottom), 3 videos I bailed out of because they were not interesting. How many that are related to the video I just watched? Zero.
The original algorithm was clearly and forcefully replaced by something that was advantageous to YouTube's metric but I'd wager detrimental to the majority of their users. Everything feels dumbed down now and it's clear video's are playing to this new kind of algorithm in attempts to cling to their audience.
I browse using iOS Safari in privacy mode. Over the past few months Reddit has been doing everything they can to discourage that, including blocking me from reading threads by throwing up a non-dismissible modal with the bogus statement “We cannot verify this content yadda”, preventing sub-comment expansion, and screwing with the URL made available to the iOS share via messages.
The latter is just stupid: instead of the URL for the thread, they substitute the Reddit homepage. Instead of being able to track which of the links I send are interesting to the recipients, they get no useful info whatsoever, and discourage me from attracting eyeballs to their product. It’s stupid, squared.
All they are really accomplishing is hardening my resolve to not give an inch. Eventually another popular headline & dopamine feed will come along and they’ll lose my eyeballs.
All that engineering work to produce 100B recommendations, and it’s not even been put to good use.
https://www.visualizingsep.com/#/entries/vico/ <- It's very annoying to drag around the topics.
"This component maintains a 99.9% uptime and constructs a feed with p99 in the low hundred milliseconds. Which means that this design should hold as we scale to handle trillions of recommendations per day."
Is that why Reddit is the only major website that regularly can't keep up with demand? They are wasting all their resources on sending millions of spam emails filled with these 'recommendations'?
If you can't evaluate your change then you will be stumped by a very simple question. Did you succeed? Are you done? If you fix a bug by thinking "I know what the problem is", then change a few lines of code and say "Done" how do you know you actually fixed it? How do you know you didn't make things much worse? Same thing here. So, you changed the recommendation system - did you make it better or worse?
I was quite interested to see how they were evaluating the system and whether or not it was an improvement. Their section on evaluation says "Scaling this component of the system is something we think about a lot and are actively working on." That seems really, really, backwards to me. You are thinking about evaluating it after you've changed the system? Huh?
When did developers stop naming things properly and go straight to weird codenames? What is wrong with 'recommendation service'?
curl: cURL (library)
grep: g/re/p "globally search for a regular expression and print matching lines"
cat: as in, concatenate
Gazette is just meaningless.
Anyway, the reason you don’t “name things properly” is because it’s one of those truly hard problems (in a class beyond EXPTIME in input program functionality).
By bypassing it you no longer have to worry about the connotations and you can do things like split the tool without having to worry if the name will stay the same or if which piece will retain the name.
I would strongly recommend it.
Telling dozens of competing recommendation services apart somehow.
Gazette Feature Stores and Model Prediction Engine
Reddit Recommendation Service
Just in case you are also asked to install the app as a content gate.
Such a shame to see what has happened to Reddit
Most of the changes to reddit over the last year or two seem focused on driving short term engagement.
In spite of the best efforts of the administrators...
Next thing I know, I'm banned from /r/india. For participating in a sub that was recommended by Reddit itself!
And there's no appealing these bans.
But the recommendation level came from Reddit, not from the mods of /r/india.
Most of the big subreddits are co-opted by toxic, power-mad moderators, or completely devoid of moderation entirely. A complete purge & reset wouldn't be a bad idea.
GP mentioned that he "commented a couple of times", which means that his participation in the other subreddit is public knowledge.
If that other sub is so bad, then Reddit should ban it outright; why recommend it to users only to get them banned in other subs?
Because reddit is generally hands off when it comes to moderation. It generally doesn't replace moderators nor punishes moderators for their actions.
>why recommend it to users only to get them banned in other subs?
probably because the recommendation algorithm isn't smart enough to figure that out.
Most larger subreddits are managed pretty poorly.
Between that sort of nonsense and the redesign, they've Digg-ed themselves a hole and as soon as a viable competitor appears, it might just collapse as catastrophically.
There's no reason that reddit would collapse if they maintain the status quo, because the status quo (while worse) is still better than 90% of other sites on the internet. The average quality of user has gone down, but that's inevitable online.
That sub seems to be regularly featured on r/AgainstHateSubReddits
Misogyny
https://www.reddit.com/r/AgainstHateSubreddits/comments/na9y...
Racism
https://www.reddit.com/r/AgainstHateSubreddits/comments/ly6n...
https://www.reddit.com/r/AgainstHateSubreddits/comments/jh3j...
Islamophobia :
https://www.reddit.com/r/AgainstHateSubreddits/comments/ndor...
https://www.reddit.com/r/AgainstHateSubreddits/comments/mu1a...
https://www.reddit.com/r/AgainstHateSubreddits/comments/m71k...
https://www.reddit.com/r/AgainstHateSubreddits/comments/nap7...
https://www.reddit.com/r/AgainstHateSubreddits/comments/mvha...
https://www.reddit.com/r/AgainstHateSubreddits/comments/nbh1...
Transphobia
https://www.reddit.com/r/AgainstHateSubreddits/comments/mm0l...
https://www.reddit.com/r/AgainstHateSubreddits/comments/mfot...
I'm amazed that the reddit mobile app pushes notifications about upvote thresholds by default - it is incredibly trashy.
Anecdotally, I used to mod a sub which suddenly became active due to a meme. I got messages from mods of different subs offering to help or asking me to make them mods. When I refused. the sub started getting reported for comments made by new users(Auto mod was not much helpful back then), The sub died out along with the interest on meme. If someone were to say there is a mod cartel on reddit, I wouldn’t doubt it one bit.
https://www.youtube.com/watch?v=TG8xWJaJO-c
I've heard about AHS false flag operations many times, but i've never seen incontrovertible evidence of it. It feels like something that competent and technically savvy mods should be able to document. I'm not sure how many mods are even one of competent and technically savvy, let alone both.
Same thing, different day, just a new platform to continue these kinds of failing sociological controls.
Reddit has 52 million daily active users
You are sending 100B recommendations to 52 million daily users, that's 2000 recommendations per user per day. How many new subreddits do you think your users need to be made aware of in a given 24 hour period??Just because you can do something doesn't mean you should.
It's a slight tangent, but it seems somewhat relevant - they're not only making so many recommendations, but the recommendations seem to be universally hated (judging by the comments here). It's like they're bragging about how epic their fuckup is.
In my opinion Reddit can be a fine social network if you are selective about the subs you read. It has a degree of granularity that Twitter simply doesn't offer, and most subs are heavily moderated.
The last few years my Twitter timeline was insufferable, and it didn't have a trivial solution -their algorithms work very hard at creating noise and upsetting people, to a disturbing point-, while Reddit allows me to improve my experience in a couple of minutes.
I appreciate they are operating at a very large scale and that has its own challenges, but it is by far and away the worst engineered product I use. I really do mean from soup to nuts, Reddit is just garbage software. The modern front end is obviously and plainly terrible. The backend is slow and suffers very frequent downtime, often for hours at a time. I could go on for hours about the terrible engineering of Reddit.
My favourite instance was when they assumed I liked "programming", based on having (accidentally, once) visited the /r/f5networks subreddit, so they suggested the Europa Universalis 4 modding subreddit.
Lately, they've given up and are just recommending me "gaming" related subreddits, by which I mean literally any random subreddit that it thinks is related to "gaming", including subreddits for people who main a specific fighter in Super Smash Brothers or subreddits for random indie iOS TCG games.
The only "recommendations" that seem remotely reasonable are basically trending posts, and that's just because them trending indicates a broad appeal for that specific post.
Meanwhile, their mobile app is wildly unreliable; if I'm having any sort of network issues while I start it, it will fail to load any of my feeds, and then just refuse to try to load them until I kill the app again. Refreshing my feed will typically result in a new feed with new posts, about half of which have no text in them and just a giant blank space where the title and description should be.
Reddit is a colossal nightmare, engineering-wise, and I wouldn't listen to a word they said about implementing technology.
I guess if you're some sort of alien AI you'd think that's a relevant question... but otherwise what possible use would there be to ask it and take up valuable screen real estate (which could be used for ads or relevant content) asking it?
But I agree. I used to have the same respect for Reddit as I do for HN (I even donated to it when this buying stars thing wasn't around) but clearly the site is not even a shadow of it's former self. The last straw for me was when they started showing "Only available in mobile app" bullshit.
Now to me they are in the same league as FB, i.e. their engineers may be doing some cool stuff but I can't help feel sorry for people who work there.
It provides a paradigmatic example for people who believe SPAs are an invention from Satan himself. I actually love React and could have an SPA built that is a 100x better - but that is neither here nor there. The problem is that some features are half-assed or simply not implemented. The comment tree is a disaster, and pretty much in every interaction I discover new problems and bugs.
Cheery on the cake is that lately I am clicking on certain posts and getting a message along the lines of "We cannot verify whether this content is suitable for work and therefore cannot place ads against it. Please download the app to view it."
What. The actual. Fuck.
I understand why from a company perspective an app is more interesting to you than a mobile site, but you haven't managed to persuade me in all these years why I need an app for what amounts to viewing content, saving my subreddit selection, and posting an occasional comment. If your strategy is to simply kick us out of the mobile site, then fine - I will stop using your site. I guarantee it.
All of the value of reddit comes from the users adding, sorting, and moderating content. The people running the site actively make it worse and they aren't profiting by doing so.
HN doesn't try to be everything to everyone like Reddit tries, and the moderation methods employed here are a lot less heavy-handed and take a few offenses before someone gets a meaningful ban or silencing.
IMHO, the signal-to-noise here is amazing; not perfect, but _so_ much better. If I really want memes or jokes, I'll go back to reddit (and I occasionally do if I want some mindless downtime). I get a lot more insightful information and community interaction here than there.
I remember a while back when /r/cfb was invited to join the front page and there was considerable pushback from members who were afraid the reddit-wide readership would ruin the quality of posts. Kind of an eternal september thing...
The karma loss limit of six per comment is also helpful - on reddit you may be hesitant to break with generally expressed opinions over how drastically it can drain your comment - here the two options are -6 or banned (if you're really spewing hate speech).
Also, a shout out to dang for remaining very good at not interfering except when it's really warranted and then shutting things down quick.
I think you many 'any given Reddit subreddit', which is very true.
To others comments below: the signal to noise ratio here on HN is pretty good, and the average S/N on Reddit is pretty poor, but some subs over there are exceptional. For instance, https://old.reddit.com/r/askhistorians
I've been using Reddit for 10 years now. I still mechanically go the comment section when I come across something interesting to find the link to the source. It's never there anymore. No intelligent discussions. No pointing out the obvious fakes and advertisements/astroturfing. People write long, idiotically fake posts just to get upvoted, to either farm karma or because they're children.
Unfortunately with HN getting slowly flooded as well, I don't know where else to turn for an online news aggregator/discussion platform that fits my demographic.