amazon kindle

Amazon Responds re Review Erasures

The Library

The Library

My last post was an open letter to Amazon head Jeff Bezos. Today I got a call from an “Executive Customer Relations Specialist,” a nice young man who explained what he could find out about the incident. We talked about their review problems for some time, and I continued thinking about it long after (as usual.) So of course I couldn’t resist writing them a memo:

[This message is intended for Bnnnn Bnnnn, ECR, but I have no direct email for him.]

Bnnn —

Thanks for taking time out to talk today. Our conversation has triggered a lot more thought, and since I now know you may actually be able to convey some of what we’re thinking out here back to the people who decide these things, I am writing in the interest of improving Amazon and self-publishers’ cooperation.

Why You Should Listen To Me – Qualifications

[Various accomplishments and credentials omitted] I was one of your earliest customers, perhaps back around 1995, and I have been a big supporter, doing an increasing amount of business with you over the years. I managed the investments of [tech guy], founder of [bubble-era company name], during and after the dotcom bubble era, and came away with [large sum of money], so my book earnings in retirement are not critical to me — unlike some of my fellow authors, who depend on Amazon sales for much of their income, and are too afraid to speak up to you in public. In my role as portfolio manager, I became quite familiar with e-commerce and marketing.

Market Trends

Amazon is a key actor in the restructuring of publishing and general retailing, disintermediating and lowering the cost while increasing selection of goods. Books are especially suitable for this, since they are not commodities — each book and its reader/buyer have a different relationship, and there’s no simple linear scale like star ratings which can predict how satisfactory the book will be for that reader. Formerly publishers treated books like produce — with a big marketing buildup, often with paid or negotiated display space in bookstores, and a short shelf-life, with the unpredictable return rate adding to risks and costs. This led to fads and copying of trends, flooding the market with books similar to previous bestsellers and shutting out some quality books that were less commercially promising.

We understand why legacy publishers want ebook prices to be very high, often higher than print — they control the print model, which can be very profitable still, and want to slow the disintermediation restructuring, which leads to a world where they have a lesser role. This is damaging the quality of books produced by their system, and their low-paid lower level employees keep out a lot of fresh new perspectives, especially if they’re not in agreement with their politics.

The future is with online groups of readers who cross-recommend books to each other. Online communities are not likely to promote crap books like those that make up 95% of Amazon’s new books catalog. All of us online have our own reputations to guard, and we don’t push stuff on our readers that they are unlikely to like. Amazon needs to encourage this kind of community.

The Problem of Crap — Book Discovery in an Age of Excess

We all know you have too much bad material on Amazon — quite reasonably, how could you judge quality with an automated process?

When I started relying on Amazon for books, you emphasized your algorithm for recommending suitable books based on the ratings of the reader for other books they had read. This has disappeared, and you recommendations are useless now. I relied on the list of new science fiction books you made available, and bought from it based on author’s reputation, “institutional” reviews, and lastly customer reviews. This is not working at all now, as there are far too many new books, some of the best writers are self-published, and the Big 5 push less quality stuff; most small and self-pubbed writers can’t afford the delay and expense of Kirkus reviews, and the other big reviewers refuse to review us. The gatekeepers have narrowed the gate so much that many quality writers can’t get through. Meanwhile, voracious readers of genres like Mil-SF can’t find enough to read, and often end up buying low-priced books that are barely literate to keep their habits going. Genres like Romance and Mil-sf are a big part of your ebook sales, and are very poorly served by the Big 5 — not enough books in some niches are legacy-published to satisfy reader demand. This situation will only get worse as your review policies make it harder for us to meet that demand by making it harder for us to get new books off the ground with enough reviews to round out the customer’s knowledge of whether that book is likely to satisfy.

Misuse of Customer Data – Violating the Customer’s Trust

I respect Amazon as one of the most ethical companies, working hard to make the customer’s lives better. This image was gained by being exceptionally careful to fight for customers when short-term profits might have been easier by agreeing to supplier’s demands. You risk that image, though, when you use private customer data in the interest of anyone but that specific customer — it simply does not fly that you can trace customer’s relationships and injure them as a result of your desire to protect the review system’s integrity. Using customer data to inform that customer about products they might interested in is fine; using it to erase the reviews they spent time and effort to share on your system is damaging to customer trust and results in strange advice like “don’t send de minimis gift books via Amazon to your literary group, it will forever bar them from reviewing your work.” It’s quite creepy and damages your image, the kind of damage that eventually leads to government regulation or antitrust issues.

Better Ideas – Some Problems and Solutions

Problem — fake reviews, generally paid-for. If anyone can review a product at Amazon without proof of purchase, then there really is no way to stop this entirely. The two ends of the problem can be addressed: 1) any account that has generated unusual numbers of extreme positive or negative reviews can be warned, then barred from reviewing if it doesn’t stop, and 2) reviews from verified purchases can be given display and rating priority, which I understand you’re rolling out now.

Problem — Helping new authors get real reviews, because they absolutely have to have a way to distinguish their good product from the flood of crap. You are actively damaging us now, but you could implement a system allowing a book’s author to send out codes redeemable for review copies, then let the reviewer use that code when entering their review to give it the flag “This item was reviewed in return for a certified review copy.” This neatly solves two problems: our difficulty getting DRM’d review copies to reviewers, and your fear that we will only select favorable reviewers. The reviewers can be watched and rated using your account system, so that those who are good get higher weights, and those who regularly trash everything or five-star everything get low ratings. Currently NetGalley has this market sewed up, but at high prices most authors can’t afford — $150 or more per book. You should displace them and give more support to the small and self-publishers that are your future suppliers.

Problem — review “skew.” Where an author’s successive works get higher and higher ratings, because as a known quantity, those buying his/her books are more likely to be previous readers and fans who already like that writer’s work. I’m noticing that now, where the list of people who agreed to read the ARC of the third volume of my series tend to like my work already, and gave it a higher rating than a more randomly-selected previous groups which included more science-phobic readers. But this is actually not a problem; it is the expected result of consumer preference and a writer’s reputation. That writer clearly has readers who love that style, and if the rating attracts a new reader who hasn’t read the reviews and noted how science-heavy those books are, then that reader may be disappointed. But you’ve protected them as well as you reasonably can.

So, recommendations:

— As you are already doing, weight product ratings according to likely reliability of reviewers,
— Additionally rate reviewers themselves, to weed out the bad ones and give the best more weight in ratings.
Stop erasing reviews because of de minimis connections, which abuses your access to customer data. At most put a disclaimer tag on suspect reviews and underweight them in overall rating.
Implement a “review copy” code system, which authors can use to send out review copies. These reviews can be quality-controlled statistically and help good authors gain enough sales to eventually have a larger number of organic customer reviews.

These recommendations are based on the special nature of the ebook market, but some of them can also work for physical product reviews, like keeping ratings of reviewers as a weighting factor.

Open Letter to Jeff Bezos re Review Erasures

Another data point for the self-pubbed dealing with Amazon’s paranoid reviews policy. I uploaded the latest Nov. 25th, and by Dec. 1st had eight 5-star reviews from the 20 or so people I had emailed ARCs to. Amazon deleted the last three reviews, all posted on the same day, claiming they had found “associations” between the accounts. I suspect it is a dumb algorithm that assumes too many 5-star reviews too quickly must mean they are paid, and that Amazon is lying about it.

Here’s their boilerplate language:

We removed the Customer Reviews for your book because our data shows elements of your Amazon account match elements of the reviewers’ Amazon accounts. In these cases, we remove the reviews to maintain trust in our customer reviews and avoid any perception of bias.

Customer Reviews are meant to give customers unbiased product feedback from fellow shoppers. Because our goal is to provide Customer Reviews that help customers make informed purchase decisions, any reviews that could be viewed as advertising, promotional, or biased will not be posted.

Here’s my response:

I have read your guidelines thoroughly and note “family and *close* friends” is the standard you cite to disallow reviews. I share your desire that reviews be unbiased and fair across products. I question your commitment to achieving this goal when you will not remove obviously fake one-star reviews which have been posted by competitors or people who dislike the book’s author for political reasons.

First let me comment that I bring Amazon significant yearly revenue on my books, audiobooks, etc. My family also directly spends about $10K per year with you. You have set up an algorithm which uses poor guilt-by-association correlation data to intentionally wipe out the hard work of Amazon customers who take the time to review my works, which damages my perception of Amazon, and as we the authors make our stories known, will damage your other customers’ views of your company.

Self-pubbed authors must make more efforts to keep in touch with their fans to have any chance of succeeding in a marketplace dominated by legacy publishers who are allowed to promote their products by direct payments to Amazon. Your efforts to give small press and self-pubbed authors a way to advertise are complete failures. Amazon has allowed legacy publishers to overprice their ebooks, pay you for what appear to be endorsements, and game the reviews system with large numbers of paid reviews for their products.

Frankly I think you are lying. You have implemented a review-cancelling algorithm which in my case appears to have been triggered by “too many” 5-star reviews in a short time, since you cancelled the last three out of eight, and those three are fans of my writing, not family or *close* friends as you specify in your guidelines. I think it is just accidental that all eight of my first reviews were 5-star, though it’s possible it’s just that good a book.

You have damaged our relationship. I request a re-review and restoration of those three erased reviews.

The erased reviews, (all 5-star), and not a hyped or misleading one in the group:

1) Stephen Marino reviewed Shrivers: The Substrate Wars 3
I very much like the story – December 3, 2015

First let me start with the disclaimers.

1, I helped workshop part of this story at Taos Toolbox.
2. I was a beta reader of the completed work.
3. I very much like the story.

Because I am giving this story all five stars, let me state why you should not read it.
Do you like to think for yourself or do you want every little detail of what is happening spelled out for you? If you only like to read fluff, this is not your book. I am not saying, it is a hard read, just that it is many layered. Pay attention to the sub subtexts.

Do you only like to read books from authors who have no understanding of technology and the effects it can have on society? If so, there are lots of writers who don’t know what they are talking about.

Have you read the previous books in the series? If not, You will probably enjoy the book more, if you start with Red Queen and move on to Nemo’s World. The story stands alone nicely, but a bit of background can be a good thing. (You can’t unread book three before going back to read 1 and 2.)

What are the books about? Spoiler free, this universe is a big honking computer simulation and in about 20 years, a few university students begin learning to program it. The world is beginning to go in a very dystopian direction and war breaks out between the students and the world’s governments.

I know this has been said by everyone who has read this series, If you enjoyed Robert a. Heinlein, You will greatly enjoy this author.

2) Bookgirl reviewed Shrivers: The Substrate Wars 3
Engrossing addition to the Substrate Wars saga – November 30, 2015

Shrivers are coming.

Complex plotting, political intrigue, and a galaxy­spanning saga. Shrivers builds relentlessly to a climax filled with surprises. Kinnison weaves multiple plot lines, characters, and different planetary settings together adroitly, crafting a tale that will captivate and delight hard science fiction fans.

3) M. Cunningham reviewed Shrivers: The Substrate Wars 3
Captivating read – November 30, 2015

I was provided an advanced reader’s copy for review and found it to be a captivating and entertaining read. Mr. Kinnison has channeled his inner Heinlein to create a fitting wrap­up to the Substrate Wars trilogy. I was especially impressed by the creative use of Kat’s training in the virtual reality world of the substrate to create stories of how other aliens lived and reached the substrate. I would highly recommend this book to anyone who appreciates the golden age of science fiction.

1) Properly discloses the relationship with the author. But it is a competitive relationship, and he is not my friend, much less my close friend.

2) No idea who “book girl” is, probably one of the 8-10 book bloggers I sent an ARC to for review. Arm’s-length.

3) Fan who has reviewed previous books and so was willing to read the ARC. Gave the previous books 4-stars, so not a pushover.

So stop lying about supposed “elements matching” — no such elements exist, though in the case of #3 I sent him a paper copy so that might appear in your search. The others have NO CONNECTION WHATEVER in account records.

Stop lying. Restore the reviews. Or authors and readers will turn on you. Why should customers make an effort to review books when you may arbitrarily erase their work?

A comment on Facebook:

I’m guessing they don’t want to admit that one of their computer guys has run a correlation study and suggested a simple “too-many-five-stars-too-quickly” screen. That might cut fake reviews down, but also cuts legitimate ones. And it’s embarrassing to admit they can’t come up with something more sophisticated. People are worried about them tracing Facebook and email list connections, but I’m pretty sure they have no access to that data… and apparently authors signed up with Amazon press labels are immune (hi, Robert Bidinotto!)

copied from createspace groups:

10. Aug 5, 2015 11:32 PM in response to: lipmag
Re: Amazon reviews – petition

The issue I have with Amazon’s review policy is that it does not accurately apply across the board. Yes I understand the need to ensure authors are not padding reviews otherwise the reviews will hold no value to the potential customers however, with my latest release Amazon Amazon randomly decided to remove 2 reviews generated through ARC releases. The only response given when queried as to why was that the reviews violated policy because they believed the reviewers knew the author. They knew of the author, obviously, but these were not friends and family. Additionally, upon review of the posted Reviewer Policies the only sections that could apply (though they do not) are

• Sentiments by or on behalf of a person or company with a financial interest in the product or a directly competing product (including reviews by publishers, manufacturers, or third-party merchants selling the product)
• Reviews written for any form of compensation other than a free copy of the product. This includes reviews that are a part of a paid publicity package

The reviewers were not compensated nor do they have a financial interest. This brings me to my original point. They do not apply the guidelines across the board. I have never heard complaint from a large publisher that an ARC review was subsequently removed. In fact, many large publisher purchase reviews as part of their marketing plan (a direct violation of the above guidelines) and those reviews are rarely, if ever, pulled.

The entire process seems to a) not follow the published restrictions and b) be enforced in a discriminatory fashion. In my experience questioning Amazons decision or pointing out that the guidelines were not broken has no effect. In the end the do as they please.

— R. C. Butler – Bulldog Press

Other stories on the topic:

Amazon Review Policy Under Fire: Indie Authors Call For Change In ‘Big Brother’ Policing

Amazon’s Review Policy is Creepy and Bad for Authors

Amazon… A virtual marketplace, or Big Brother?

Petition on Change.org – Change the “You Know This Author” Policy

Hugh Howey and JAKonrath on the Indie Revolution, and Amazon’s Netflix-for-Books

Indie Reader Approved

Indie Reader Approved

Hugh Howey’s Wool Series is some of the best indie fiction so far, and it’s been optioned for a movie and published by legacy publishers — but only after he made it a success on his own, through Amazon. J A Konrath was a successful fiction writer with legacy publishers, but has done much better by going indie in recent years, and he acribes much of the support for legacy publishers to a variant of Stockholm Syndrome. His epic post on publishing and a “declaration of Independence” for authors is here:

When in the Course of publishing events, it becomes necessary for writers to sever their ties with the industry that is supposed to have “nurtured” them, a decent respect to the opinions of mankind requires that we should declare the causes which impel those writers to the separation.

We hold these truths to be self-evident, that all writers should have an equal chance to find readers. That their successes or failures should be dependent upon their own actions and their own choices. That they should be paid fairly for their work. That they should have control over the works they produce. That they should have immediate and accurate access to their sales data. That they should be paid promptly. That they should not be restricted from reaching those who may enjoy their work. That whenever a publisher or retailer becomes destructive of these ends, it is the Right of Authors to abolish all connections with the offending parties.

The history of the legacy publishing industry is a history of repeated injuries and usurpations, all having in direct object the establishment of an absolute Tyranny over writers. To prove this, let Facts be submitted to a candid world.

They have given us take-it-or-leave-it, one-sided, unconscionable contracts.
They have failed to adequately market works they have acquired.
They have artificially inflated the price of ebooks.
They have refused to negotiate better ebook royalties for authors.
They have forced unnecessary editing changes on authors.
They have forced unnecessary title changes on authors.
They have forced crappy covers on authors.
They have refused to exploit rights they own.
They have refused to return rights they aren’t properly exploiting.
They take far too long to bring acquired works to market.
They take far too long to pay writers advances and royalties.
Their royalty statements are opaque, out-of-date, and inaccurate.
They orphan authors.
They orphan books.
They refuse to treat authors as equals, let alone with a reasonable measure of fairness.
They make mistakes and take no responsibility for those mistakes.
For every hope they nurture, they unnecessarily neglect and destroy countless others.
They have made accessories of the authors’ ostensible representative organization, the quisling Authors Guild, and are served, too, by the misleadingly named Association of Authors’ Representatives.
They have failed to honor promises made.
They have failed to honor their own onerous contract terms.
They’ve failed the vast majority of authors, period.

This blog has documented nearly every stage of these Oppressions, and in many cases offered solutions to publishers, and has been answered with only silence and derision.

But that’s okay. Because now authors have a choice.

We shall never be taken advantage of again. We shall not support any publisher or retailer that continues the abuses listed above. And we demand to share in the rewards we’ve busted our asses for.

In other news, the subscription reading service a la Netflix is popping up everywhere: Scribd and Oyster have already been active, and Amazon is in test phases. For c. $10 a month you can read umlimited numbers of works from their catalog, a good deal for avid readers, and catalogs are growing more extensive. Amazon’s new service is most fully described by GigaOm:

So far, the differences appear to be that Kindle Unlimited has no Big Five titles and Kindle Unlimited includes audiobooks. One major difference is that Kindle Unlimited will likely be available through Kindle e-readers. That’s not true for Scribd or Oyster. And it would be a big reason for avid Kindle e-reader users to choose Kindle Unlimited rather than Scribd or Oyster: If they are already using their e-reader all the time anyway, and can now access more books through it via a subscription, that would be a big perk.

How do authors get paid?

It depends on who your publisher is. Publishers Lunch reported Wednesday (subscription required) that publishers participating “via direct agreement” — which appear to be Houghton Mifflin Harcourt, Bloomsbury, Open Road and Workman, among others — will be paid an ebook’s wholesale price when a reader completes a certain percentage of the book. That’s the same way that Scribd and Oyster operate. Then there are those well-known “big” books also included in the Kindle Owners’ Lending Library, like the Harry Potter series and the Hunger Games trilogy: Amazon has a separate Harry Potter deal that presumably encompasses (or was changed to expand to) Kindle Unlimited as well, while in the case of the Hunger Games, according to PL, “Scholastic will get paid their full wholesale price every time one of their ebooks is opened by a Kindle Unlimited subscriber.”

If you’re a self-published author participating in KDP Select, however, it looks as if your book can be included without your explicit permission simply under the terms and conditions you already agreed to: According to one poster on the Kindle Boards, “Books in Select will automatically be enrolled. Like the KOLL you won’t be able to opt-out if you’re in Select. You will be payed [sic] if you someone reads 10% or more of your book. The payment will come out of the same KOLL fund, just as if it was a borrow.” That “same KOLL fund” is a set pool of money from which self-published authors are paid each time their book is borrowed. Its amount changes every month but in July the total fund was $1.2 million.

The Hawking Index of Unread Blockbusters

Hawking Index of recent Political Bestsellers

Hawking Index of recent Political Bestsellers

Until now we only had anecdotal evidence that many “blockbuster” books pushed by media and reviewers went largely unread (the most famous past example was Gravity’s Rainbow, critically acclaimed literature that was so dense and bereft of compelling narrative that few purchasers actually finished it.)

But now we have the “Hawking Index,” named after Stephen Hawking for his Brief History of Time, also hugely recommended and rarely finished. While we have no way of knowing how many Major Books purchased in hardcover at bookstores end up as doorstops, we now have data from Amazon Kindle books, which make available on their Amazon pages the location and number of notations users make within the book; it turns out many books have notations near the beginning but few or none near the end, indicating users did not make it that far. Since many books do have notations to the end, we know it’s not just because readers get tired of annotating; they simply stop reading.

WaPo has a good story on this, adding Hillary Clinton’s latest as another much-purchased, rarely-finished book, to go along with Thomas Piketty’s Capital in the Twenty-First Century as a best-selling bust with readers:

The summer’s most-read book? Donna Tartt’s “The Goldfinch.” Least-read? Thomas Piketty’s “Capital in the Twenty-First Century,” for which the notations only get about 2.4 percent of the way in.

So, naturally, we decided to apply this methodology to “Hard Choices” and other recent or comparable political books. And we have our own ranking, which we now present in order from estimated-least- to estimated-most-read.

1. “Hard Choices,” by Hillary Clinton. Hawking Index: 2.04 percent. Well, there you have it. The deepest into Hard Choices the popular highlights get is page 33, a quote about smart power. Three of the five most-popular highlights occur within the first 10 pages. We will note the same caveat that Ellenberg applies to Piketty. “Hard Choices” is fairly new, and fairly long. Still, though, one would think more people had made it past page 33.

The most popular quote? “Do all the good you can, at all the times you can, to all the people you can, as long as ever you can.” Which, like several of the top quotes from the authors listed below, isn’t actually a quote from Hillary Clinton. Instead, it’s a mantra from her family’s Methodist faith.

I took a look at my own book and the highlights readers chose seem to indicate most readers read it all the way through — the two most popular:

Most of the trouble in relationships is about bad signaling and poor responses. (6 Highlighters)

A good partner is reliable and available to help on call, whenever possible; a good partner leaves his partner alone when help is not needed, staying quietly available behind the scenes…. (5 Highlighters)

…which I actually wrote, though some of the prettiest language highlighted by users is quoted from other books (where a thought was expressed so beautifully I could not improve upon it.)