Bay Area woman is on a crusade to prove Yelp reviews can’t be trusted
sfgate.com
sfgate.com
If I search for "dinner" on Yelp for "current location" and look at the map, it leaves out an astonishing number of places that I can see within a mile if I drive down the street.
And if your business model is centered around hiding all but the winners - who might pay for placement + reviews both - then you have to try to keep people from talking about it, and the moral interests just get worse and worse.
Google Maps isn't any better; OpenTable seems the "least bad" of options I've looked at recently, at least for fancier reservation-having places, in terms of actually showing my options.
(It's a broader internet problem in general - "trending" algorithmic reinforcement stuff will push everyone towards the ONE TRUE BEST HOTTEST MOST POPULAR bbq/ramen/whatver place, when probably there's half a dozen other options within 10% of taste and quality, that some people very well could legitimately like better if they heard about them too.)
Instagram doesn't help -- gotta get a shot of me eating noodles at the hot new place! There's a new ramen shop in downtown San Mateo that has a 30-person line outside at all times... I can't imagine it's that much better than the half-dozen other ramen places within 3 blocks, but by god it's new, and anyway would people be lining up like this if it wasn't good? I better get in line too...
That’s why new restaurants hire people to line up outside.
Totally tangential but follow-ups on that psychology:
* some people would walk in and see the still mostly-empty bar and get fed up that they waited in line for "nothing". This was surprisingly few people though.
* some people would ask and buy just about any explanation - "oh that guy is new and still learning", "we had someone get in on a fake ID and got a fine the other day so the guys are just being careful" or whatever and the people would be glad they got in early to get a good spot.
* sometimes we'd slow down the bar staff a bit too so that there was a line to buy drinks and people were happier that they had to wait in line again - confirming their bias that they must have gotten in at the start of the rush.
* some people were wise to the scam and everyone who called us on it thought it was great. They often offered to have their buddies come through the line a few times in exchange for a free drink.
* for some reason when you let your buddies, regulars and off-shift staff cut the line and get in quick, the rest of the folks seemed more willing to wait in the line.
tl; dr - group psychology of humans is wierd.
Once I became an old fart, I started seeing these lines as a sign to move on. The question in my mind (at any age) was always "is the place worth waiting in line for?" But these days, I already know from years of experience that the answer is very likely "no".
Skipping the line has improved my nights out, though, because in looking for an alternative, I frequently find hidden gems and can enjoy them before the rest of the city discovers them.
This has been a process for me. I still occasionally succumb to the silliness, but for the most part when I see a line, my reaction is, "meh, I'm hungry/thirsty now; let's go somewhere else". One thing that's telling is that some of the places I already know I really enjoy rarely have lines or are completely busy.
And absolutely agree that you often find hidden gems that way. A lack of a line will often just mean the business is too inexperienced or honest to use some of the psychological manipulation practices the GP talks about.
https://en.m.wikipedia.org/wiki/El_Farol_Bar_problem
He also talked about this on Mindscape
https://www.preposterousuniverse.com/podcast/2021/08/23/161-...
I thought maybe it's some kind of weighted rating, because it's showing me the 4.3 star restaurant with 1,100 reviews, instead of the 4.5 star restaurant with 600 reviews. So, perhaps Google thinks the additional number of reviews make up for the lower rating, and they rank it higher, even though I'm specifically asking to not see those results. However, it also shows a 4.4 star restaurant with 40 reviews, while hiding a 4.5 star restaurant with 90 reviews.
This is par for the course when it comes to modern recommendations though. Do you want to see Netflix movies released in the past 3 years? Or what about a simple list of top rated movies? Too bad, you can watch what we tell you to watch. It's a complete lack of respect for the user.
Google is proving the central limit theorem by catering to the average.
It's one of the things that has reduced the usefulness of these tools.
Your search - "abcdfksosifjdjwkdkwotmdnwkqk" - did not match any documents.
Suggestions:
Make sure that all words are spelled correctly. Try different keywords. Try more general keywords.
————————-
“No results found on Google Maps
Try searching for something else or in a different area”
At least viewing the most recent comments and reading the comment that goes with it helps figuring out if it might be a decent place or not... at least sometimes.
But there's not really any alternative. Apple Maps can't show me things because it's missing the entries entirely. Yelp became useless years ago. I feel like we're going back in time because the best way to find local restaurants has become walking / driving around the neighborhood to see what's there, or getting word of mouth recommendations.
Search-based interfaces with ranking, controlled by someone else, are all screaming to be gamed and monetized. We should hate this but we don't.
Let's face it, that never stopped being the best way. There have always been problems with internet reviews, if only the ones inherent in the 1-5 star mechanism. But, it is very inconvenient to ask around for recommendations when you're (for example) hungry and passing through an unknown town or something. So I get why we need a source that isn't completely unreliable.
Often it’s a place a bit off the road or harder to find, but I’ve had as good luck or better vs the mapping tools.
I think they are trying to integrate their bard UI into search and it is killing the results.
At this point, I use google to search reddit in order to find organic results. Unfortunately, that will probably be taken over by spammers soon enough.
I'm grateful for places like Rumble and Twitter, where real news can be found. :)
And targets often have a Starbucks inside thier belly.
Google maps is still getting worse and worse though.
There's also a lot of brigading on Maps. You'll see 5 1-star reviews in a row, and realize they are either duplicate accounts or friends who are all reviewing the same experience.
For example some of my favorite Asian restaurants in the city are rated 3.5ish while Uber Eats is rated like 4.7. It leads me to believe a lot of people are rating Google Maps restaurants also based on service. One in particular
https://www.ubereats.com/ca/store/china-lan-lanzhou-beef-noo... (4.7)
https://goo.gl/maps/GnLmwJNRjBHP9UnN8 (3.9)
This place is awesome, and personally have experienced bad service but don't really care, so I do understand the Google Maps rating, but do find the whole rating system not helpful for me as I'm interested in good food and willing to accept bad service.
You're correct. This is a problem with ratings. You really have to read into them to see what they're complaining about or praising. This is true even for individual reviews, written solo. Many are unhelpful, or stuff that doesn't concern you.
One of the best examples I can remember is a venue that had 2-3 stars. However, all the negative reviews were like: "They have massive parties going hard late into the night... but my kids go to bed at 9:30, so 1 star".
If only. Its more like "these are the businesses that have paid me. They don't match what you want, but tough cookies."
Same with the much vaunted Amazon and Netflix recommendation engines. They stopped recommending stuff that you would like a long time ago, around the time everyone was trying to copy their recommendation engines, and started recommending stuff that makes the company more money.
A good restaurant directory - some exist for restaurant niches, but none in general - could clean up with non-obtrusive ads if the focused on completeness and accuracy with a fairly minor feature set. It would just require having enough capital and time to establish social trust.
Curating reviews is just broken, just like SEO has turned out to be. It is unavoidably gameable. Yelp seems like a zombie site. They are free-riding on their prior reputation and gradually spending it away to acquire revenue. When the reputation is gone, the revenue will be, also.
People must have read a different article than I did. This woman is finding tons of third-parties that are either posting fake positive reviews for money, or extorting businesses by writing bad reviews and offering to reverse them for money. She's looking for people who are trying to scam Yelp, or trying to scam businesses through Yelp.
But HN seems stuck in a narrative (for a decade, not new) that Yelp is some sort of organized crime syndicate, and refuses to budge.
I just mean that Yelp has chosen to filter and limit in addition to what I'm actually searching. It might be a conversion thing - if I have one really good match it's easier to decide than if they actually show me all 10.
But it means it's really really important to the business now to be that 1 that doesn't get filtered.
And THAT really increases the market for all these fake-review things.
> Dean said [Yelp's] notices validate her work, but also perfectly exemplify what she calls Yelp’s “whack-a-mole” approach ... she showed SFGATE several sketchy posts that she hasn’t mentioned in her videos — and which are still up and active.
> “I find it annoying, like, ‘You need me?’” she said. “... They’re a billion-dollar tech company that’s got teams of engineers and a trust and safety team.”
> ... Yelp said its automated recommendation software checked the 21 million reviews submitted last year for “quality, reliability and user activity” and had filed 75% into the “recommended” category, which are the reviews that figure most prominently on businesses’ pages and affect their star ratings. Of the remaining 25%, just 4% were removed by Yelp’s own moderators, 2% were removed by the reviewers themselves, and 19% were categorized as “not recommended reviews” — which don’t affect companies’ star ratings but are still accessible on businesses’ Yelp pages.
> In Dean’s mind, it’s not enough. She feels Yelp should better use account data to proactively identify problematic users and ban them altogether, and speculates that Yelp might be avoiding a crackdown on fake reviews because the positive boosts to businesses’ ratings might increase Yelp’s value to those businesses.
Given that this kind of problem is rampant across social media (where the platform is incentivized to promote horrible things, as we've seen with Meta, Insta, etc etc), it probably should be criminal if we ever want to erase this scourge. As the article shows, _businesses can't opt out from Yelp_ -- which is a pretty horrible state of affairs.
A popular local restaurant came under new management and their food is now atrocious. We actually threw their food in the garbage after getting takeout there a month ago.
Meanwhile, tourists are still leaving thousands of rave reviews on their google maps page. Noticeably, you will see one or two bad reviews every 50 reviews or so, where a person comments about their confusion about the restaurants score.
So you're getting both new reviewers (or travelers) who don't know it used to be better who still call it good, mixed with old reviews calling it good.
It's not even just a management change that causes this. This is when you almost wish Google maps would put your location history to use. It sees you visit the place frequently and thus if you stop visiting and leave a negative review it should weigh that review higher and give it more visibility. An old stale review or a review from someone who visited once I don't think should be as impactful or useful on the experience.
Overall I find discovering new places to be frustrating as reviews often seem useless. Usually I find the best method of discovering new places is still via word-of-mouth in person.
But how would that make Google more money, this quarter?
I could imagine an argument that, over a long enough time period, (re)gaining user trust would lead to an increase in ads revenue, but at best that long-term increase goes into the promo packet of the T9 leading "Geo/Commerce" or whatever the product area that contains Maps is these days.
The other option is using a bank api but seems too much friction..
The previous sentence makes sense. That is not the problem.
This is:
Change.
Read it through again and you'll get it.”
-- Douglas Adams, So Long, and Thanks for All the Fish
Any information repository eventually comes to face the problem that the phenomena it is describing is no longer the same, for intrinsic or extrinsic reasons.
And you better be happy with it.
SMH... I mean, how difficult is it for Yelp to catch this?!? Hire a high school student with interest in data analysis, and you'll catch these idiots quickly.
The calls are coming from inside the house!
It's not in Yelp's interests to try to catch this. At least in the short term.
The mistake you're making is assuming Yelp: * Wants to "fix" this problem. * Isn't actually complicit in this problem as a means to incentivize small business owners to sign up and pay for Yelp to help "manage their business profile".
Whereas if 1024core or bombcar posts a review, and it gets blocked/shitcanned/shadowbanned/ignored/never posted, we give up and move on with our lives, we have better things to do.
It'd be less controversial to kill bad reviews like this (because bad reviews often can be extortion or attacks on competitors), but the users would notice and also bitch. [edit: even worse, businesses that got bad reviews deleted by talking to Yelp might be characterized as "in bed with" Yelp.] A Yelp-like business is no-win imo. Voting isn't much of a signal if you let anybody who happens to walk by vote.
Yelp makes 96% of its revenue on advertising.
They probably make more money if reviews for a restaurant are in question. If someone spends 20 minutes clicking around on a list of restaurants to read the reviews and see if some seems genuine or fake... yelp makes lots of money.
If yelp reviews were 100% trusted, everyone would just click once, and then go to the highest rated restaurant.
Think that's the root of the issue. A review system should not be in the business of advertisement or any kind which could change the review ranks
The problem is there's no accountability.
Sure, we can sue them, but for what damages? How do you account for the value of lost business opportunities caused by Yelp selling your honestly earned ranking spot on their website to your competitor?
The only way to prove they've done something wrong is to commit corporate espionage and get the proof yourself, which would then most likely invalidate the ability to use that evidence for revenge.
https://www.youtube.com/@fakereviewwatch
It's pretty good stuff. She builds a devastating case very methodically, showing how the identical glowing review text is posted to yelp, to FB, and to Google, by different users -- and then traces other reviews posted by those same user ids showing how they are plagiarizing Tripadvisor posts.
The review will be posted as "verified transaction" on the site and overall score of the restaurant is determined from there. "Anonymous" reviews can still be posted but won't be factored into the overall score and will be deprioritized by the system/algorithm.
Of course this does not necessarily stop businesses from pumping out fake transaction tickets and offering users to write fake reviews. But at least a paper trail would be established; and if a historically 1-2 star business with verified transactions and 1-2 reviews per day suddenly sees a spike to 4-5 stars with 10+ reviews per day over the same period. Then it can be flagged as suspicious and team can review the paper trail.
Turns out a lot of restaurant owners would prefer to straight up own the reviews/influence it themselves rather than get legitimate, anonymized ones. There's just not that much of a reason to genuinely improve as a service when there's so much cutthroat competition
I imagine this is trickier than it seems initially a lot like content moderation, seems so obvious until you realize how you are walking a fine line.
You need restaurant's and the reviewer's cooperation, and it seems your proposition would to have the restaurant foot the bill. Which means, they pay to you give more control over their reviews and ultimately their business to random customers.
The user spend more time and effort to leave a reviews, and while they might see some side benefit in improving your service, they now have to trust you won't screw them and sell them to the restaurant.
Do you see a third party willing to pay enough to keep you alive, outside of spam and ads ?
Retailers do this on their own stores via "mystery shoppers" The retailer pays a firm to go in shop at the stores and they write a detailed report of customer service, how clean the store was etc.
Why would Yelp forbid people from talking about this? While it is certainly possible to create fake email screenshots, this seems like a relatively small risk compared to the much more common risk that's being called out here.
I guess they just don't want people to know how common this type of occurrence is, since it would undermine all trust in their platform.
But from Yelp's perspective, a paid-for review claiming bad food is just fine, because it only tarnishes the restaurant's reputation. On the other hand, a claim of fraudulent review manipulation hits both the business and Yelp's reputations.
A review claiming paid-for-fraud isn't so easy to wave off.
I agree that this sort of information is useful for potential patrons to have, but can understand that Yelp wants their reviews to be about actual visits.
> Meanwhile, Dean took SavantCare to small claims court over the letter and calls she later received, and won a $275 judgment in March 2018 for “negligent infliction of emotional distress.”
NIED claims are nearly impossible to win. In law school we were taught to point them out on issue-spotting questions, but that they were basically unwinnable.
And it could have been a default judgement.
I actually managed to get one company's fake reviews removed from google maps, bringing them from a 4.8+ to a 1.x overnight. Within a few months they were back to > 4, but the owners had sold the company and started a new one.
It's insane how deep this goes. At best it's done by companies that want to cheat the system by getting an unfairly good review, but at its worst it's used to trick users into a false sense of confidence so that they can be scammed.
My solution was to pay for the roadside assistance via my car insurance and call them to sort things out.
Now emergency plumbers - same mess, but I haven't figured out a solution for that.
For tow trucks just search for ones that can do a semi. They’ll know who to call.
(Use AAA for tows and vehicle lockouts, never a locksmith you find on your own.)
Unlike roadside assistance (which works), the one thing I can tell you not to do for emergency plumbers is trust a home warranty service like American Home Shield. These sorts of "services" pay contractors subpar and flat rates, which deprioritizes your claims and incentivizes corner-cutting. They will not deliver miracles like finding you a plumber on Thanksgiving.
1) They work in business sectors which you usually only need rarely, so there's no need to build customer loyalty.
2) But when you do need help from one of these businesses, you need it now. There's little room for a customer to negotiate or shop around.
3) As a result, online advertisements and reviews for these businesses are an utter cesspool. There are very few honest reviews, and it's common for "local" business listings to actually connect you with brokers.
Kind of sick of reading this advice. If I knew someone I trusted to recommend me a contractor why would I be on Yelp looking in the first place? Hello.
of course secrets can be kept in large organizations, but it's funny how often that get repeated.
A scrupulous person wouldn't join the Gestapo, y'know?
However, hyper aggressive sales reps were there and while I don't have specific details, I know their methods were the cause of at least some people not comfortable staying there. They however would not have access to things like reviews.
That, and, as the article details, and I’ve seen in my own personal experience, business owners are extremely aggressive about trying to get you to take down negative reviews, which I’m sure not only gets people to take them down but also discourages people from writing them in the first place.
I.e.:
(1) Guess at what information triggers this kind of shakedown by Yelp for a new business. E.g., credit-card sales data for new restaurants.
(2) Set up a fake business that pushes all of those buttons. E.g., register a new restaurant business in the state; temporarily rent a space and maybe put up signage; generate realistic credit-card purchase data and/or cell-location data for fake customers.
(3) Wait for the Yelp reviews to come in. [Possibly legal offence #1]
(4) Wait for the Yelp sales call. [Possibly legal offence #2]
(5) Turn down the sales offer.
(6) Wait for the negative reviews. [Possibly legal offence #3]
(7) Ask prosecutors to pursue criminal charges, and/or file a civil suit. Either way, get to the point of legally compelled discovery.
I wonder if this would be a fun first project for a newly minted government prosecutor.
I leave negative reviews for places that deserve them, and there's nothing they could ever do to get me to take it down, or discourage me from doing it. I doubt they could ever do anything that would make most people feel differently from me about that. In fact, I'd be pissed and just start leaving more negative reviews if they even thought of getting aggressive.
I wouldn't think so. In a society so rife with obvious scams everywhere you look, at every level in public and private sector orgs, it would be patently idiotic to trash your own career on account of a dishonest restaurant review operation.
I wish we lived in a world where such bravery were meaningfully valued, but we don't. For any might-be whistleblowers, this reality has been made painfully clear in the time since the Snowden leaks nearly a decade ago, during which nothing has changed.
We "appreciate" them when they call foul on others, but you appreciate them a hell of a lot less when you have such moral crusaders in your own ranks. They aren't loyal to anybody but their own sense of self-righteousness and can't be trusted to keep their mouth shut if you piss them off after they discover dirt on you. They're only ever a liability.
On the flip side, barring being vindictive it's not worth it to blow the whistle on anything unless you can prove it beyond all doubt and intend to pivot to motivational speaking for the rest of your career. Outside of the defense industry (the DoD does pay generously to anyone tattling on Snowden/Teixera types), there is literally no incentive to speak out, and a lot of potential retribution you invite.
(I repurposed that from an aphorism about being in politics.)
I don't get this automatic assumption that everyone is a hypocrite and no one is willing to face accusations of doing things wrong in their own life. I mean, is that how you operate? That's not how I do things. If I'm doing something wrong I love finding out about it - otherwise, how will I eve do things right?
if your goal for relationships with other people is to prevent them from discovering dirt about you then... I dunno man, I'm not sure how it's possible to live happily around other human beings with that kind of attitude. what kind of person does that make you?
We're talking about a few different things-- most of what I said applies to employer/employee relationships. If you hire a known whistleblower, you better make sure there are no skeletons in your closet because they've already proven what they're willing to do with such information.
> if your goal for relationships with other people is to prevent them from discovering dirt about you then... I dunno man, I'm not sure how it's possible to live happily around other human beings with that kind of attitude. what kind of person does that make you?
In both cases, it's just a matter of discretion. There is no prevention; discovery is inevitable.
again, I feel like this is you projecting - what are you hiding, anyway?
It's normal for a new local restaurant to get a bunch of good reviews because locals are trying it for the first time and want to help. Then it's normal for reviews to drop off because every local who would leave a review, has. Then it's normal to start attracting negative reviews from people who have never visited because local competing restaurants have realized where the downtick in their own business has come from, and so start trashing the competition. And then the negative reviews stop because the competing restaurants were satisfied they'd left enough negative reviews.
These stories have been going around about Yelp for over a decade at this point. And Yelp has churned through so many salespeople... you'd think there would have been tons of credible whistleblowers by now if this were really how Yelp operated.
They may not actually be writing the reviews, simply choosing when to publish or unpublish them, and in what quantities, and which to count for the overall rating.
It doesn't matter who's casting the reviews, but who's counting them.
The fact that this seems to be commonly-accepted knowledge without a single piece of evidence is strange to me.
I agree that its hard to believe one restaurant hasn't tracked it yet but I think its more a confluence
- are you good enough/ no dip in performance that you can claim this correlation or are you confident enough to go out saying that knowing you have to defend against ppl saying "well maybe you just suck now!"
- did you have time to screenshot it when it was happening aka the day Yelp called and your dishwasher was out sick and your supplier of eggs upped their price
- how long does the business even run. lots of restaurants close down and Yelp is not on a top ten list of concerns
- if you're established then your focus is growing business not dealing with the mafia. maybe you pay them, maybe you double down on other channels like uber eats or a new location or whatever.
Small biz across the world are subject to the reach of social media addicted primates with persecution complex. Few will take the risk of a review bomb or nobodies traveling to vandalize their business.
It’s not a new meme by any means: https://fortune.com/2015/04/07/yelp-reviews-controversy/
https://www.propublica.org/article/ugly-truth-behind-we-buy-...
Amazon also somewhat infamously uses contracting organizations with scandalous labor practices.
But to the contrary, these allegations have been levied against Yelp for nearly a decade, and yet no real clear evidence of this happening deliberately at least once has appeared. Meanwhile, people have switched to Google Reviews, which also have a pay-to-play element (for visibility) and dubious corporate backing.
One rather mundane explanation might be that people who click on restaurants near the top of the search results are just friendlier reviewers overall, while people who search to the fifth page are more picky.
If they go to the media, even if they are 100% on the whistleblower's side, it'll be a week (at most) of slightly negative PR. People will forget, if they noticed in the first place.
Is there a government body that will act on this? What will they do? A small fine? Would this actually go to court?
Even if it’s not yelp doing it the fact that they are publicly advertising the reviews should make them culpable.
https://scholar.google.com/scholar_case?case=336153126478324...
which ended with: The case was dismissed on appeal on the grounds that the complainants had not adequately proven (1) Yelp had wrongfully threatened economic loss by manipulating user reviews, (2) it was unlawful for Yelp to post and sequence both positive and negative reviews, (3) Yelp authored negative reviews, and (4) Yelp’s conduct amounted to a violation of antitrust laws by threatening or harming competition.
Yelp was also sued for false advertising (essentially saying they were a trusted, unbiased review source) which they somehow also won:
https://blog.ericgoldman.org/archives/2020/03/yelp-finally-d...
anyway, I actively avoid Yelp reviews because of this chicanery.
My non-lawyer intuition is that this is something like fraud, extortion, or racketeering.
The parent comment doesn't mention the restaurant's location. Are the relevant jurisdictions are some combination of the following?
(a) the restaurant's location
(b) Yelp's HQ in the restaurant's country, and/or
(c) Yelp's HQ in the U.S.
If one sales rep is caught, easy for the company to label them a rogue, bad actor.
There were lawsuits in the early 2010s over trying to reveal the identity of negative reviewers because so many restaurants were claiming they were fake/extortion.
Im surprised there hasnt been a class-action defamation suit. That would force discovery at least.
It's such a consistent story it beggars belief that there's nothing there.
This kind of conspiracy would be trivially uncoverable in the discovery phase of a lawsuit.
I mean, I'm not saying that Yelp isn't doing this, but if it is, it would bust right open the moment anyone sued them for anything related to this.
Fun times ahead!
Online reviews need their Google-search moment. Something that levels the playing field, establishes a mechanism for credibility, and doesn't require an extortion-based business model.
If you have 20 minutes I did a show about it 2 years ago https://youtube.com/watch?v=e9rmh8O_ksM.
I guess you can 2.0 speed that and get it done in 10.
I made dozens of them ... they failed to gain traction. A few are over 100 views a couple years later (like this: https://www.youtube.com/watch?v=3byGVjPq468) but I have still failed to crack the world of social media. It's not zero ... that's nice I guess.
I'm planning to do a reboot sometime soon. I took a couple weeklong trips around the country to some research libraries in the past year or so, but I'd like to execute differently to try to be more effective. This was my third show run attempt.
I think I may need a new foil for my host. The guy I did the shows with is a longtime TV comedy writer (https://www.imdb.com/name/nm1104065/) but he's not exactly a second city graduate.
I'm just really wondering why the owner feels the need to do this. Is it a situation where you just have to do it, else you'll get buried under your competitors? Should I expect that our primary vet does this too, and that the other vet practices in our area also do it? Shady either way, but could it be a damned if you do, damned if you don't type thing?
Certainly there are business sectors where there's so much competition that some of them will resort to shady tactics like this to gain customers. But if anything, there's a shortage of vet practices in San Francisco (and the entire bay area, really). Gaining customers here feels like it's more about having available appointments in a reasonable time frame than anything else.
Everyone knows people who had negative reviewers are more likely to leave reviews, but what people don't often understand is, percentage of people who actually leave ANY review is still exceedingly small. I've heard as long as 1 in a few hundred or even a thousand.
So getting that first few positive ones is critical, to kick off the virtuous cycle of customer acquisition. You'd better deliver though, once customers start coming in.
Perhaps if the review site could somehow prompt recent patrons of a set of establishments to not rate but rank the establishments, then some algorithm could convert that into a global score/ranking. You, an otherwise disinterested citizen, receive an email or text asking you to rank restaurants A, B, C which you have recently visited. You are incentivised to respond by a prize draw or something. Would this work? The hard part I suppose is getting the contact details of the potential reviewers.
However, this strategy only works if a very small number of businesses use it. Once the novelty wears off, the word-of-mouth benefit vanishes.
Since she couldn't get Yelp to help with that, it makes every review suspect. It doesn't take much of that behavior to convince people to only leave good reviews, and then they're basically useless.
There are multiple comments like this and I wonder how does it work? Like, you can just tell they guy to f-off, block his number and warn him that you are calling police if he continues to "stalk" you, no?
It seems to me that all of them can be and actively are gamed.
Googling using the extension site:reddit.com caught on for a reason.
Many small businesses get their viral loop started from glowing reviews from family and friends. That sort of growth hack will never disappear, and the subtle cases will be undetectable. I decline to write such reviews, but others won't.
> We will never have completely trustworthy user reviews.
just reading these to comments helped me figure out how to solve this: since apps have location tracking, for restaurants at least, your reviews should be weighted by how much time you spend close to a restaurant. If you claim to like a restaurant, but you don't eat there much, that means your reviews are not reliable. This unreliability would transfer to reviews of places that are not close to your home/work.
bonus points to combine it with confirmed food expenditures on your credit card/applepay.
It's not that people are making up their restaurant visits.
It's that they are going to the restaurant, they had a good time, but they didn't disclose that they are close to the owner, and maybe they overlooked a few things here and there that an impartial reviewer would note.
They also seem to have a much broader range of things covered now, so I think the strategy was to go cheaper, faster, wider.
Consumer Reports does independent testing with their established criteria. But it's a paid service and doesn't do user submitted reviews.
Steam gets gamed with review bombs but provides plenty of transparency and data for people to make informed decisions. They identify recent review biases and show spikes in volume. Importantly Steam has a generous refund policy with little friction, so they have a profit incentive to match you to a game you want to keep.
Admitting you worked for Yelp on HN: not even once
When cards are cloned, it's exceptionally easy for a bank to determine which merchant is compromised by looking for common denominators.
Take three actors.
What are the odds that two of them have reviewed one business, and only that business? Pretty high. All good. Same for all three.
Now, what are the odds that two of them have only reviewed two businesses, and both businesses are the same, on both accounts? Still decent, sure. All three actors, same two businesses reviewed, and only them? Getting a little dicier.
Two actors, seemingly independent, have each reviewed three businesses only. And they've reviewed the same three businesses, in the same order. And perhaps they each reviewed the first business, then two weeks later, the second business, and then the third. Odds? Getting pretty slim now. A third actor, doing the same? You're stretching the bounds of credulity for sincere reviews.
This stuff is basic probability theory. Looking across reviews for sets and unions of reviews and reviewers, and increasing the number of reviews, but still seeing commonality between them points to SOME malfeasance worthy of review.
I worked on an anti-fraud team in a similar role, and I agree with GP that it's a harder problem than people realize. It's easy to come up with a simple metric that would identify the fraud that you observe, but you don't know what false positives it would catch as collateral damage.
Like this example that you find wildly implausible:
>Two actors, seemingly independent, have each reviewed three businesses only. And they've reviewed the same three businesses, in the same order. And perhaps they each reviewed the first business, then two weeks later, the second business, and then the third. Odds? Getting pretty slim now. A third actor, doing the same? You're stretching the bounds of credulity for sincere reviews.
I think it's highly likely that if you used this metric to find patterns, you'd find fraud, but you'd also find lots of legitimate reviews (e.g., friends who go to the same restaurants together, friends who recommend restaurants to each other).
I don't have the full text of that comment, as they've edited it our, so I don't know specifically what they said. But perhaps they just don't know everything about how Yelp operates; it's not a small company where everyone knows everything.
I also know someone who previously worked at Yelp, and they've talked about some of Yelp's shady internal practices. Everything is not all above-board there.
Gold Plated Bugatti's do not buy themselves, after all.
Is it actually? My bank calls me to ask which transactions were mine and which ones werent, thus requiring outside feedback
What they are looking for in a different context is "Customer A reported unauthorized transactions, and so did Customers B through D. Each of these customers, prior to these reports, all had a transaction occur at XYZ gas station, so is there a skimming problem at that gas station?"
If sales people etc have special access to add or remove reviews, which they do, or at a minimum leave negative reviews themselves when you don't pay, it is corrupt. It is well documented at this point that they do this.
1. The ones unable to effectively police shills and spam. I'd put Google in that bucket.
2. Those that turn a wilful blind eye to review fraud, as long as they boost sales, like Amazon
3. Those like Yelp or Glassdoor whose entire business model is built around extortion and a protection racket ("nice business you have here, it would be a shame if a bad review happened to it. Unless you buy ads with us, of course").
That is a serious thing to do. This is criminal fraud right?
i.e., while there certainly can be paid/manipulated reviews, the barrier to doing so is higher here than elsewhere (e.g., google reviews, tripadvisor, etc.) and there's enough people who are happy to use other less controlled sites, I haven't witnessed any truly widespread fraudulent reviews like I have elsewhere)
Generally speaking, I'd say Yelp reviews are, generally speaking, comparatively the most reliable
I can't speak to how they sort/present search results - that does seem potentially shady
But even with such dominance, in the last 10 years, Yelp! is up about 38% and Trip Advisor is down 42%. What is it about their businesses that makes profitability growth so elusive?
is it really? couldn't tell you the last time i loaded yelp.com on purpose.
I tried to use a few apps for finding restaurants, compared their rating with the experience I had and concluded it's a waste of time and money.
There's not even a need to know or understand anything about it. No insider info from Yelp, not experiencing it as a business owner. Just try and see for yourself.
https://www.vice.com/en/article/434gqw/i-made-my-shed-the-to...
I've found Google Maps or Tripadvisor to be too hit-or-miss especially when traveling abroad where Yelp isn't as prevalent.
I thought Apple was supposed to be working on their own review system or switching to a different service, but I haven't seen anything come of that.
I don't recall ever seeing that and I just checked about 25 places in my city and none of them had TripAdvisor.
-Apple Maps native reviews
-Yelp
-OpenTable
And I'm definitely seeing a lot less Yelp than I used to. At least in Toronto, yelp is pretty much dead anyway. People mostly use Google Maps.
It seems Apple Maps and Pay could result in good reviews, because they'd all be tied together.
I havent used since I missed a turn. Why not use google maps?
"Use the left two lines to take exit 12 towards Buemont Street"
"Use the second from the right lane to continue on Sepulvada Drive"
It's also useful for seeing if particular menu items are good, since fake reviews don't typically get into that much detail (or at least there are other real reviews that would outweigh them in search results for that item).
FWIW, I live in silicon valley.
The 1 star reviews complain about the organ meat, which there were totally grossed out by. "Beef tendon pho" is super legit, and what you get in Asia. You're in the wrong place if you expect American-Chinese fare.
My take, having seen a lot of these posts on yelp, is that people leave such reviews because restaurants are offering something which they are not familiar with, or does not match their notions of "normal" (however narrow that may be). You see this less at restos which serve burgers and pizza, and more with places serving non-American food.
I just took a spin through the couple of Asian places in my town, and they have relatively high numbers of 1 star reviews. Digging into them, what you see a lot of are is complaints like:
"This is the worst Asian food I have ever had because (proceeds to describe exactly how the dish is supposed to be)". Also a lot of complaints about these Asian restaurants being "dirty" (which they aren't - as I'm only reading through places my wife and I go to / order from frequently). It was like this specifically with Asian food in the last town I lived in as well. I recall one complaint about how they romanized a Thai word, insisting "pad see ewe" was misspelled (ORLY!). It's bizarre. Mexican restaurants by comparison, get complaints about the food being too spicy, or the decor (at takeout places no less) being bad. And, of course, "dirty", which again, the places I frequent, aren't.
I can't help but conclude that people who write these reviews are judging things based on their own biases, of which they are not self-aware. A more harmless example is a review from a great Thai/Chinese resto where I used to live where someone suggested the place smelled "musty". Well - it was in a sublevel of a large building ("basement" is the word they used), but it was not in any way musty in the 10 years I spent going there. None of my friends ever took issue, even a good friend with a really sensitive nose.
The problem is a real lack of reviews for smaller places, especially outside the downtown area. Google Maps has more content there.
Google Maps I still don't understand where they get a lot of reviews from in the first place. While some look like normal reviews, there's a lot that have no comments at all or comments completely unrelated to the place ostensibly being reviewed (or just cryptic things like "not good" or "good"). It's not a bad comparison to use alongside Yelp, but it's definitely led to more clunkers, especially for places with n<20 reviews.
I use yelp for personal entertainment, because the outraged, bombastic reviews are often hilarious in how just beneath the surface are classist, racist, xenophobic and jingoistic undertones. These are among the few reviews I believe 100% are actually real people!
There are literally dozens of 100+ person companies in China and India who's entire business model is faking online reviews.
The entire industry is broken, and the average consumer can't find literally a single source for unbiased, trust-worthy reviews of anything anymore, which I for one believe is the system working exactly as designed and intended. Never forget the rich will sacrifice literally anything that's generally considered to be part of the "Public good" if it means they'll get rich faster, which is exactly what's happening here.
Is it possible to vote anonymously without being able to fake those votes/reviews?
5-star, less than 100 reviews: probably paid for reviews. I've never been to a "bad" place in this category, but I usually avoid it unless it's the most appealing option, so my sample size is small
4+ star, 1000+ reviews: definitely not bad. i would rate every place ive been to in this category as good or excellent, although some are overpriced. all of my favorite places in the bay area fall between 4.0 and 4.5
3.5 star, 100+ reviews: possibly good, probably not bad. ill check reviews, if people are primarily complaining about service and not food, it's probably good. i never pick 3.5 places if it's somewhere i've never been before, but i won't veto one if someone else suggests it
3.5 star, less than 100 reviews: i avoid these completely. i've still never been to one
less than 3.5 stars, any number reviews: i also avoid these completely
Humans are biased, deceptive creatures and whether intentional or not we can misrepresent ourselves, others and every...thing. AI would definitely help to drop a "badge of approval" on something in some cases.
Reviews for restaurants may be harder, but just simple fact checking it's going to be so amazing to have a trusted AI that can say "yep, this is most likely true" with a click-through to references/sources/reasons why.
Look at trending Twitter tags, I've been looking at #ukrainerussiawar etc a lot and sometimes like 90% of the tweets have _nothing_ to do with the topic, jsut shameless self-promotion spamming tags, or misinformation tweets from either Russia's information warfare team, or quite simply right wing morons parroting propaganda. Would be nice to make all of that go away...
I can only imagine that this means all these recent troubles I've been hearing about San Francisco have been resolved and people do not need the help from their horoscope anymore to know what to do to resolve their problems.
Alice from [brand] would then have to find a way to get customers to take off their watches or somehow artificially inflate their happiness scores. Or, funnel naturally happier people to their establishment, similar to lead sourcing.