News for hackers. Stuff that matters.
Re:This is the best drone according to Amazon? – The HS100 by amai on Tuesday October 30, 2018 @07:57AM (#18335665)
Just use https://reviewmeta.com/ to validate Amazon scores of products. When you do it on HS100 it immediately gives you a warning: "Unnatural reviews possible" . Fakespot shows a Fakespot Grade F and a corrected rating of 1.3: https://www.fakespot.com/product/holy-stone-hs100g-drone-wit... It seems to me that Reviewmeta and FakeSpot do work. It is just Amazon that is too lazy to do anything against fake reviews.
Re:This is the best drone according to Amazon? – The HS100 by hippich on Tuesday October 30, 2018 @01:33PM (#18339208)
In addition to obvious flaws others noted, these tools fails to catch a certain type of reviews manipulation:

Try:

https://reviewmeta.com/amazon/B07FTFFY24

https://www.fakespot.com/product/28pcs-wood-burning-kit-crea...

While fakespot gave D, it gave it for other reasons. What really happened there - seller completely replaced product on that page with another one. Read existing reviews to understand what is going on.

One more example - https://reviewmeta.com/amazon/B07FSW8VMQ - just read reviews to see how ridiculous it gets.

Not all of them are easy to detect. This seller added soldering iron as a variation to a wood burning unit - https://reviewmeta.com/amazon/B07D9H5H9Y - even by reading reviews you can't easily figure out fakeness of it. (https://www.fakespot.com/product/vastar-wood-burning-kit-44p... Fakespot gave A)

This type of blackhat stuff happens right now right and left. It is even cheaper/quicker/easier than paying reviewers for reviews now.

Re:This is the best drone according to Amazon? – The HS100 by ReviewMeta on Wednesday October 31, 2018 @10:21AM (#18345892)
Just wanted to chime in about this issue. We call it "Review Hijacking" and we've been seeing it more and more. We're actually starting to keep a history of any product title changes and also show you the different product variations that are being reviewed. On your second example, (https://reviewmeta.com/amazon/B07FSW8VMQ), you can click the link under the picture that says "See 3 product variations" and it will show you exactly the breakdown of reviews that come from a log carrier bag and a nut milk bag...

The first example is a little trickier since the first time we analyzed the product, the title had already been changed. (You can click on the "Title History" link for any product).

We're working on being able to detect when these changes/variations are normal or being used to deceive shoppers. It's extremely easy for a human to immediately tell, but much harder to train a computer to do it. For example, a seller might have a t-shirt with different product variations: "Large Blue", "Medium Green". These are very different words, but obviously a legit reason to have a bunch of variations.

Here's more info about Review Hijacking: https://reviewmeta.com/blog/amazon-review-hijacking/ and here's an article that BuzzFeed News recently did: https://www.buzzfeednews.com/article/nicolenguyen/amazon-rev...

Re:This is the best drone according to Amazon? – The HS100 by brink on Tuesday October 30, 2018 @08:44AM (#18335955)
So if I want to harm a competitor's product on ReviewMeta, review it a bunch of times, then delete the reviews. Got it.

This is a crappy game of cat and mouse, and if producers are willing to exploit Amazon's system, they'll exploit ReviewMeta. The only thing that protects ReviewMeta at this point is that it's a niche service.

It'd be nice to see a mechanism that recognizes trusted reviewers, but even that can be exploited I suppose.

Re:This is the best drone according to Amazon? – The HS100 by rtkwe on Tuesday October 30, 2018 @10:22AM (#18336688)
Depends on how effective the corrected score mechanism is. If it's taking out the scores it deems fake then recalculating the score based on the remaining scores that campaign will only hurt their FakeSpot score while still leaving their overall score mostly intact. If they drop the score just because of fake reviews the attack would work but if it basically just filters out spam reviews it's much less attackable.
Re:This is the best drone according to Amazon? – The HS100 by ReviewMeta on Wednesday October 31, 2018 @04:27PM (#18349009)
That's not exactly how it would work. As stated on the reports, deleted reviews don't actually affect our adjusted rating or pass/fail/warn result.

Technically speaking, of course ReviewMeta can be "gamed", but it would require much more effort on the part of the seller to generate reviews in such a way that it wouldn't set off any warnings on our side. Basically force them to be very deliberate in their efforts. It would just add yet another hoop for sellers to jump through, making it that much more difficult on their part.

Re:This is the best drone according to Amazon? – The HS100 by Aunche on Tuesday October 30, 2018 @11:03AM (#18337159)
Fakespot and reviewmeta seem to have a bunch of false positives. I recently looked up a hair brush on fakespot and it had an F because the reviews were too similar. Turns out there isn't too much variety in how you can describe a hair brush. The reviewers I looked at had bought a variety of items and gave varying scores, so I doubt they're fake. It's more accurate to read the reviews and see if they sound genuine. A numerical score for something qualitative isn't very useful anyways.
Re:This is the best drone according to Amazon? – The HS100 by jrockway on Tuesday October 30, 2018 @12:38PM (#18338513)
The real problem is that the review aggregator sites don't have all the data that could possibly be available to them. For example, I wrote a 2 star review of an LED light bulb I bought on Amazon. Claimed to be 90+ CRI, was actually a garish green color with a little bit of red and blue thrown in. I measured it with a spectrophotometer and included the spectrum chart in my review. The review was not posted for "violating their guidelines" or something. So any review aggregator is missing that genuine review, as is anyone browsing Amazon.com. For this reason, I don't trust _any_ reviews anymore. Amazon filters out the negative ones!
Re:This is the best drone according to Amazon? – The HS100 by crescentfresh on Tuesday October 30, 2018 @01:20PM (#18339016)
> The review was not posted for "violating their guidelines"

Aww man this bums me out. I love the critical (detailed) reviews, they're the first thing I look for on amazon.

Re:This is the best drone according to Amazon? – The HS100 by rootw0rm on Tuesday October 30, 2018 @01:54PM (#18339459)
I agree that negative reviews attract a lot more scrutiny. I've also had negative reviews scrubbed.
Re:This is the best drone according to Amazon? – The HS100 by JumpCrisscross on Tuesday October 30, 2018 @01:33PM (#18339201)
> "violating their guidelines"

Any guesses as to what guidelines were violated?

Re:This is the best drone according to Amazon? – The HS100 by jrockway on Tuesday October 30, 2018 @06:25PM (#18341791)
My guess is that the spectrum chart triggered some spam protection, honestly. I would call customer service but Amazon's customer service can't do anything other than send you another copy of the item you're complaining about.

(That's my other Amazon story. One time, I bought some bicycle tires on Amazon. They sent me the wrong model, mountain bike size instead of road bike size. I wrote them a detailed email describing what they sent me and what they should have sent. "We're so sorry!". The next day, two identically wrong tires arrived. I complained and they refunded my money. I now had to find a way to use four mountain bike tires, and I still had no road bike tires. 2 riding days lost. An hour writing emails lost. And I still had no bike tires. I bet 99% of people would call that "great customer service". I think it's terrible. (Amazon did eventually remove the listing in question, so that's nice.))

Re:This is the best drone according to Amazon? – The HS100 by ReviewMeta on Wednesday October 31, 2018 @04:32PM (#18349054)
The challenge here is that there's no answer key, so nobody can really know for sure which reviews are authentic and which are not.

We all can look at reviews and make our best guess, but at the end of the day, it's always going to still be a guess. At ReviewMeta, we aren't claiming to know all the answers. We try our best to ensure everyone knows it's an estimate (you're actually forced to click an I agree button before accessing the site) and we also provide all our work so you can use the numbers to help you make a more informed decision.

Re:This is the best drone according to Amazon? – The HS100 by crazcarl on Tuesday October 30, 2018 @11:12AM (#18337284)
I agree with you overall, but I'm curious - did you also go to the other items and read the reviews there, or run those items through fakespot?

If you're going to create a fake account to promote your items, you could give your items 5* and then copy other reviews on other products exactly (including # of *s) to make the account look more legitimate.

Re:This is the best drone according to Amazon? – The HS100 by glenneroo on Tuesday October 30, 2018 @09:35AM (#18336273)
The last few pages of the article mentions this, not to mention the author tested multiple articles from Holy Stone.

Here are some relevant quotes:

> "I personally believe that somehow Holy Stone is able to game the system beyond what even Faskespot can detect. A DroneDJ source confirms that Holy Stone uses “black hat” techniques to game the system."

> Among other tricks, Holy Stone is likely getting 100s of reviews from people who were provided product in exchange for a promise of a good review. These reviews pass the test as original reviews, but not the test of being unbiased reviews. I also think Holy Stone must be doing something to appease unhappy customers in exchange for not providing a negative review. It’s just too good to be true. Just 6% of reviews of the HS100 have 1, 2, or 3-star rating. That’s unheard of for drones. Unheard of unless you are looking at a Holy Stone drone.

Re:This is the best drone according to Amazon? – The HS100 by josefresco on Tuesday October 30, 2018 @08:34AM (#18335899)
To put this in perspective, the DJI Phantom 3 mostly passes: https://reviewmeta.com/amazon/B013U0F6EQ
Re:This is the best drone according to Amazon? – The HS100 by JohnJamesRambo on Tuesday October 30, 2018 @12:27PM (#18338369)
Thank you for this, I didn't know this website existed!
Re:This is the best drone according to Amazon? – The HS100 by onetimemanytime on Tuesday October 30, 2018 @08:49AM (#18335987)
Amazon can buy Fakespot etc with pocket change and integrate them in, maybe, weeks if not days. Why they don't is the question.
Re:This is the best drone according to Amazon? – The HS100 by ceejayoz on Tuesday October 30, 2018 @09:28AM (#18336227)
It'd be pointless. After a week or two, the review scams would figure out what signals Fakespot etc. use and adjust their behavior to evade.

They don't bother now because there's no significant userbase for these tools. That'd change quickly if Amazon built it into their system.

Re:This is the best drone according to Amazon? – The HS100 by hyperbovine on Tuesday October 30, 2018 @09:10AM (#18336094)
Why spend money when you can make money.