jeff bezos

Amazon Responds re Review Erasures

The Library

The Library

My last post was an open letter to Amazon head Jeff Bezos. Today I got a call from an “Executive Customer Relations Specialist,” a nice young man who explained what he could find out about the incident. We talked about their review problems for some time, and I continued thinking about it long after (as usual.) So of course I couldn’t resist writing them a memo:

[This message is intended for Bnnnn Bnnnn, ECR, but I have no direct email for him.]

Bnnn —

Thanks for taking time out to talk today. Our conversation has triggered a lot more thought, and since I now know you may actually be able to convey some of what we’re thinking out here back to the people who decide these things, I am writing in the interest of improving Amazon and self-publishers’ cooperation.

Why You Should Listen To Me – Qualifications

[Various accomplishments and credentials omitted] I was one of your earliest customers, perhaps back around 1995, and I have been a big supporter, doing an increasing amount of business with you over the years. I managed the investments of [tech guy], founder of [bubble-era company name], during and after the dotcom bubble era, and came away with [large sum of money], so my book earnings in retirement are not critical to me — unlike some of my fellow authors, who depend on Amazon sales for much of their income, and are too afraid to speak up to you in public. In my role as portfolio manager, I became quite familiar with e-commerce and marketing.

Market Trends

Amazon is a key actor in the restructuring of publishing and general retailing, disintermediating and lowering the cost while increasing selection of goods. Books are especially suitable for this, since they are not commodities — each book and its reader/buyer have a different relationship, and there’s no simple linear scale like star ratings which can predict how satisfactory the book will be for that reader. Formerly publishers treated books like produce — with a big marketing buildup, often with paid or negotiated display space in bookstores, and a short shelf-life, with the unpredictable return rate adding to risks and costs. This led to fads and copying of trends, flooding the market with books similar to previous bestsellers and shutting out some quality books that were less commercially promising.

We understand why legacy publishers want ebook prices to be very high, often higher than print — they control the print model, which can be very profitable still, and want to slow the disintermediation restructuring, which leads to a world where they have a lesser role. This is damaging the quality of books produced by their system, and their low-paid lower level employees keep out a lot of fresh new perspectives, especially if they’re not in agreement with their politics.

The future is with online groups of readers who cross-recommend books to each other. Online communities are not likely to promote crap books like those that make up 95% of Amazon’s new books catalog. All of us online have our own reputations to guard, and we don’t push stuff on our readers that they are unlikely to like. Amazon needs to encourage this kind of community.

The Problem of Crap — Book Discovery in an Age of Excess

We all know you have too much bad material on Amazon — quite reasonably, how could you judge quality with an automated process?

When I started relying on Amazon for books, you emphasized your algorithm for recommending suitable books based on the ratings of the reader for other books they had read. This has disappeared, and you recommendations are useless now. I relied on the list of new science fiction books you made available, and bought from it based on author’s reputation, “institutional” reviews, and lastly customer reviews. This is not working at all now, as there are far too many new books, some of the best writers are self-published, and the Big 5 push less quality stuff; most small and self-pubbed writers can’t afford the delay and expense of Kirkus reviews, and the other big reviewers refuse to review us. The gatekeepers have narrowed the gate so much that many quality writers can’t get through. Meanwhile, voracious readers of genres like Mil-SF can’t find enough to read, and often end up buying low-priced books that are barely literate to keep their habits going. Genres like Romance and Mil-sf are a big part of your ebook sales, and are very poorly served by the Big 5 — not enough books in some niches are legacy-published to satisfy reader demand. This situation will only get worse as your review policies make it harder for us to meet that demand by making it harder for us to get new books off the ground with enough reviews to round out the customer’s knowledge of whether that book is likely to satisfy.

Misuse of Customer Data – Violating the Customer’s Trust

I respect Amazon as one of the most ethical companies, working hard to make the customer’s lives better. This image was gained by being exceptionally careful to fight for customers when short-term profits might have been easier by agreeing to supplier’s demands. You risk that image, though, when you use private customer data in the interest of anyone but that specific customer — it simply does not fly that you can trace customer’s relationships and injure them as a result of your desire to protect the review system’s integrity. Using customer data to inform that customer about products they might interested in is fine; using it to erase the reviews they spent time and effort to share on your system is damaging to customer trust and results in strange advice like “don’t send de minimis gift books via Amazon to your literary group, it will forever bar them from reviewing your work.” It’s quite creepy and damages your image, the kind of damage that eventually leads to government regulation or antitrust issues.

Better Ideas – Some Problems and Solutions

Problem — fake reviews, generally paid-for. If anyone can review a product at Amazon without proof of purchase, then there really is no way to stop this entirely. The two ends of the problem can be addressed: 1) any account that has generated unusual numbers of extreme positive or negative reviews can be warned, then barred from reviewing if it doesn’t stop, and 2) reviews from verified purchases can be given display and rating priority, which I understand you’re rolling out now.

Problem — Helping new authors get real reviews, because they absolutely have to have a way to distinguish their good product from the flood of crap. You are actively damaging us now, but you could implement a system allowing a book’s author to send out codes redeemable for review copies, then let the reviewer use that code when entering their review to give it the flag “This item was reviewed in return for a certified review copy.” This neatly solves two problems: our difficulty getting DRM’d review copies to reviewers, and your fear that we will only select favorable reviewers. The reviewers can be watched and rated using your account system, so that those who are good get higher weights, and those who regularly trash everything or five-star everything get low ratings. Currently NetGalley has this market sewed up, but at high prices most authors can’t afford — $150 or more per book. You should displace them and give more support to the small and self-publishers that are your future suppliers.

Problem — review “skew.” Where an author’s successive works get higher and higher ratings, because as a known quantity, those buying his/her books are more likely to be previous readers and fans who already like that writer’s work. I’m noticing that now, where the list of people who agreed to read the ARC of the third volume of my series tend to like my work already, and gave it a higher rating than a more randomly-selected previous groups which included more science-phobic readers. But this is actually not a problem; it is the expected result of consumer preference and a writer’s reputation. That writer clearly has readers who love that style, and if the rating attracts a new reader who hasn’t read the reviews and noted how science-heavy those books are, then that reader may be disappointed. But you’ve protected them as well as you reasonably can.

So, recommendations:

— As you are already doing, weight product ratings according to likely reliability of reviewers,
— Additionally rate reviewers themselves, to weed out the bad ones and give the best more weight in ratings.
Stop erasing reviews because of de minimis connections, which abuses your access to customer data. At most put a disclaimer tag on suspect reviews and underweight them in overall rating.
Implement a “review copy” code system, which authors can use to send out review copies. These reviews can be quality-controlled statistically and help good authors gain enough sales to eventually have a larger number of organic customer reviews.

These recommendations are based on the special nature of the ebook market, but some of them can also work for physical product reviews, like keeping ratings of reviewers as a weighting factor.

Open Letter to Jeff Bezos re Review Erasures

Another data point for the self-pubbed dealing with Amazon’s paranoid reviews policy. I uploaded the latest Nov. 25th, and by Dec. 1st had eight 5-star reviews from the 20 or so people I had emailed ARCs to. Amazon deleted the last three reviews, all posted on the same day, claiming they had found “associations” between the accounts. I suspect it is a dumb algorithm that assumes too many 5-star reviews too quickly must mean they are paid, and that Amazon is lying about it.

Here’s their boilerplate language:

We removed the Customer Reviews for your book because our data shows elements of your Amazon account match elements of the reviewers’ Amazon accounts. In these cases, we remove the reviews to maintain trust in our customer reviews and avoid any perception of bias.

Customer Reviews are meant to give customers unbiased product feedback from fellow shoppers. Because our goal is to provide Customer Reviews that help customers make informed purchase decisions, any reviews that could be viewed as advertising, promotional, or biased will not be posted.

Here’s my response:

I have read your guidelines thoroughly and note “family and *close* friends” is the standard you cite to disallow reviews. I share your desire that reviews be unbiased and fair across products. I question your commitment to achieving this goal when you will not remove obviously fake one-star reviews which have been posted by competitors or people who dislike the book’s author for political reasons.

First let me comment that I bring Amazon significant yearly revenue on my books, audiobooks, etc. My family also directly spends about $10K per year with you. You have set up an algorithm which uses poor guilt-by-association correlation data to intentionally wipe out the hard work of Amazon customers who take the time to review my works, which damages my perception of Amazon, and as we the authors make our stories known, will damage your other customers’ views of your company.

Self-pubbed authors must make more efforts to keep in touch with their fans to have any chance of succeeding in a marketplace dominated by legacy publishers who are allowed to promote their products by direct payments to Amazon. Your efforts to give small press and self-pubbed authors a way to advertise are complete failures. Amazon has allowed legacy publishers to overprice their ebooks, pay you for what appear to be endorsements, and game the reviews system with large numbers of paid reviews for their products.

Frankly I think you are lying. You have implemented a review-cancelling algorithm which in my case appears to have been triggered by “too many” 5-star reviews in a short time, since you cancelled the last three out of eight, and those three are fans of my writing, not family or *close* friends as you specify in your guidelines. I think it is just accidental that all eight of my first reviews were 5-star, though it’s possible it’s just that good a book.

You have damaged our relationship. I request a re-review and restoration of those three erased reviews.

The erased reviews, (all 5-star), and not a hyped or misleading one in the group:

1) Stephen Marino reviewed Shrivers: The Substrate Wars 3
I very much like the story – December 3, 2015

First let me start with the disclaimers.

1, I helped workshop part of this story at Taos Toolbox.
2. I was a beta reader of the completed work.
3. I very much like the story.

Because I am giving this story all five stars, let me state why you should not read it.
Do you like to think for yourself or do you want every little detail of what is happening spelled out for you? If you only like to read fluff, this is not your book. I am not saying, it is a hard read, just that it is many layered. Pay attention to the sub subtexts.

Do you only like to read books from authors who have no understanding of technology and the effects it can have on society? If so, there are lots of writers who don’t know what they are talking about.

Have you read the previous books in the series? If not, You will probably enjoy the book more, if you start with Red Queen and move on to Nemo’s World. The story stands alone nicely, but a bit of background can be a good thing. (You can’t unread book three before going back to read 1 and 2.)

What are the books about? Spoiler free, this universe is a big honking computer simulation and in about 20 years, a few university students begin learning to program it. The world is beginning to go in a very dystopian direction and war breaks out between the students and the world’s governments.

I know this has been said by everyone who has read this series, If you enjoyed Robert a. Heinlein, You will greatly enjoy this author.

2) Bookgirl reviewed Shrivers: The Substrate Wars 3
Engrossing addition to the Substrate Wars saga – November 30, 2015

Shrivers are coming.

Complex plotting, political intrigue, and a galaxy­spanning saga. Shrivers builds relentlessly to a climax filled with surprises. Kinnison weaves multiple plot lines, characters, and different planetary settings together adroitly, crafting a tale that will captivate and delight hard science fiction fans.

3) M. Cunningham reviewed Shrivers: The Substrate Wars 3
Captivating read – November 30, 2015

I was provided an advanced reader’s copy for review and found it to be a captivating and entertaining read. Mr. Kinnison has channeled his inner Heinlein to create a fitting wrap­up to the Substrate Wars trilogy. I was especially impressed by the creative use of Kat’s training in the virtual reality world of the substrate to create stories of how other aliens lived and reached the substrate. I would highly recommend this book to anyone who appreciates the golden age of science fiction.

1) Properly discloses the relationship with the author. But it is a competitive relationship, and he is not my friend, much less my close friend.

2) No idea who “book girl” is, probably one of the 8-10 book bloggers I sent an ARC to for review. Arm’s-length.

3) Fan who has reviewed previous books and so was willing to read the ARC. Gave the previous books 4-stars, so not a pushover.

So stop lying about supposed “elements matching” — no such elements exist, though in the case of #3 I sent him a paper copy so that might appear in your search. The others have NO CONNECTION WHATEVER in account records.

Stop lying. Restore the reviews. Or authors and readers will turn on you. Why should customers make an effort to review books when you may arbitrarily erase their work?

A comment on Facebook:

I’m guessing they don’t want to admit that one of their computer guys has run a correlation study and suggested a simple “too-many-five-stars-too-quickly” screen. That might cut fake reviews down, but also cuts legitimate ones. And it’s embarrassing to admit they can’t come up with something more sophisticated. People are worried about them tracing Facebook and email list connections, but I’m pretty sure they have no access to that data… and apparently authors signed up with Amazon press labels are immune (hi, Robert Bidinotto!)

copied from createspace groups:

10. Aug 5, 2015 11:32 PM in response to: lipmag
Re: Amazon reviews – petition

The issue I have with Amazon’s review policy is that it does not accurately apply across the board. Yes I understand the need to ensure authors are not padding reviews otherwise the reviews will hold no value to the potential customers however, with my latest release Amazon Amazon randomly decided to remove 2 reviews generated through ARC releases. The only response given when queried as to why was that the reviews violated policy because they believed the reviewers knew the author. They knew of the author, obviously, but these were not friends and family. Additionally, upon review of the posted Reviewer Policies the only sections that could apply (though they do not) are

• Sentiments by or on behalf of a person or company with a financial interest in the product or a directly competing product (including reviews by publishers, manufacturers, or third-party merchants selling the product)
• Reviews written for any form of compensation other than a free copy of the product. This includes reviews that are a part of a paid publicity package

The reviewers were not compensated nor do they have a financial interest. This brings me to my original point. They do not apply the guidelines across the board. I have never heard complaint from a large publisher that an ARC review was subsequently removed. In fact, many large publisher purchase reviews as part of their marketing plan (a direct violation of the above guidelines) and those reviews are rarely, if ever, pulled.

The entire process seems to a) not follow the published restrictions and b) be enforced in a discriminatory fashion. In my experience questioning Amazons decision or pointing out that the guidelines were not broken has no effect. In the end the do as they please.

— R. C. Butler – Bulldog Press

Other stories on the topic:

Amazon Review Policy Under Fire: Indie Authors Call For Change In ‘Big Brother’ Policing

Amazon’s Review Policy is Creepy and Bad for Authors

Amazon… A virtual marketplace, or Big Brother?

Petition on Change.org – Change the “You Know This Author” Policy