top | item 8284155

Pricenoia shuts down

120 points| martinml | 11 years ago |pricenoia.tumblr.com | reply

45 comments

order
[+] GFischer|11 years ago|reply
This part is the one I'd be most worried about:

"They also wiped all the commission fees we were keeping there."

Amazon can be a jerk and unilaterally change the rules, but wiping out their commision goes beyond that. I know Google does the same, but it's not an example to follow.

It's odd because Amazon has got a good reputation as a fair arbiter of disputes for buyers, but it seems not in this case.

Things like these might impact the perception in other cases, I always thought Amazon AWS would have better customer support than Google's developer offerings, this might make me rethink that (I never had to contact AWS support yet and read mostly positive things about them, so this is surprising).

I guess they violated some provision of the Amazon TOS?

[+] personZ|11 years ago|reply
I know Google does the same, but it's not an example to follow.

When Google decides that clicks were invalid, they remove the commission and also remove the charges from the advertiser. The fact that they do this, and aggressively fight click fraud, is one of the major reasons they have so little real competition.

In the case of Amazon I'm not sure how they could do that...do they cancel all of the orders under the old agreement? Give customers their money back and ask for stuff to be shipped back?

As an aside, Amazon's Affiliate program is one of the big vehicles of noise on the net. When authors suddenly decide to write a big blog entry about the best headphones, or the best coffee grinders, etc, invariably you find that it was 100% affiliate fee driven. That might seem like a "well they might as well capitalize", but the corrupting influence of peddling commission goods is unavoidable.

[+] Someone1234|11 years ago|reply
Amazon has a good reputation from consumers, many people in the retail space who deal with them find them quite difficult (and arrogant) to work with.

The only company I've found worse is Walmart in the US. But US retailers in general like to make one anothers' lives as difficult as possible, even when they depend on each other to even exist, I don't get it! In western europe (aside from a few French companies) most businesses are pretty cooperative, and want to reduce workload not increase it arbitrarily (looking at you US companies, again).

I just think Americans love bureaucracy. It reminds me of Futurama with the "central bureaucracy" where everyone there takes pleasure in making things as slow and inefficient as possible.

[+] josefresco|11 years ago|reply
"Amazon can be a jerk and unilaterally change the rules"

Just guessing, but they probably didn't change the rules, only started enforcing rules they weren't prior. Therefore commissions earned would still be "invalid".

Considering Amazon fulfilled the orders sent from this affiliate and most likely re-invested the profits in their business (which is the Amazon way), makes it a dickish move.

[+] Domenic_S|11 years ago|reply
Too true. I have a single blog post explaining how to do something useful on Amazon (make a partial payment with a Visa gift card). It got picked up by the Consumerist and other retail-type blogs and actually generated a few hundred $$ a month.

Then Amazon shut down my account, kept the affiliate fees, and stonewalled me. They said I had violated a ToS provision that affiliate clicks couldn't be for resale purposes (wtf?).

Thankfully I was able to reach out to someone at the executive customer service team, and they actually responded with an "oops, our bad!" It was a very frustrating experience being stonewalled and not even knowing why.

[+] Stratoscope|11 years ago|reply
A couple of months ago Amazon changed its own price tracker to make it much less useful than it was before. I'm talking about the "Important messages about items in your Cart" that appears at the top of your cart when any prices have changed since the last time you viewed it.

They've had this feature for many years, of course. It used to be an incredibly verbose list with a bunch of boilerplate text repeated for every item, and the items were in apparently random order.

With only a few items in your cart this wouldn't matter much, but I use the Saved Items for a list of things I might want to pick up sometime but don't need right now. So I may have as many as a hundred items or more there. With Amazon prices fluctuating as much as they do - often by only a few pennies - it was hard to spot the more interesting price changes.

A couple of years ago they made some nice improvements to this feature on both the desktop and mobile sites. All the boilerplate was pulled out making the list much easier to scan, and the list was sorted in descending order by price change. So the items with the most interesting price changes were right at the top.

But a couple of months ago this list took a big step downhill. On mobile, the item names are no longer tappable links, and on both desktop and mobile the sorting was taken out! The list is still nicely formatted, but it's back in random order again, so the items with significant price changes are hard to find among all the two-or-three-penny changes.

I thought this was probably just a bug, but now I wonder if it was a deliberate move on Amazon's part. It seems they not only want to shut down third party price trackers, they don't want their own tracker to be very easy to use either.

[+] annnnd|11 years ago|reply
One would think it is not in Amazon's best interest if their customers are vigilant in price comparisons. ;)
[+] fookyong|11 years ago|reply
The scary part of this isn't that they were denied access. It's that they were denied with no opportunity for appeal.

As an entrepreneur this is probably one of the number 1 nightmare scenarios: one day you're in business, the next day you're not.

We always say never build a business off an ecosystem you don't control but the fact is there are many, many businesses that do just fine from it - and on the flip side, even non-ecosystem businesses are fragile in other ways (such as Uber being regulated into illegality in certain parts of the US and Asia).

That's just business! Somewhere, someone is just waiting to fuck you over :) the challenge is to make your fortune or build up your defenses before they do!

[+] tehwebguy|11 years ago|reply
> It's that they were denied with no opportunity for appeal.

And even if there was an appeal process it would still be unilaterally decided by Amazon.

It's the same feeling I get from Google whenever something goes down.

[+] patd|11 years ago|reply
My price comparison tool Shoptimate.com got hit a few months back. It's not Amazon only so I can keep the lights on but it sucks for Pricenoia.

Amazon has been changing the rules lately. They're not allowing installable software anymore and only allowing mobile apps that are not focused on shopping. They also refuse websites optimized for mobile. This is after they excluded affiliates over the state tax issues in the US.

Wikipedia says that Amazon gets 40% of their revenue from affiliates. They're probably dominant enough that they don't need to rely on affiliates as much as they used to.

[+] yasth|11 years ago|reply
Wiki is incorrectly characterizing their cited source. 40% is from third party sellers. (Actually I believe it is much higher now, but the way amazon breaks it out makes it hard to tell how much of their total revenue stream it is, as they only report their commissions). I've made the wiki changes.

I believe Amazon has realized that with their dominate place in the market most people would have gone to Amazon anyways, and they no longer need to pay to get people in the door.

[+] minouye|11 years ago|reply
There is no way that this is true. eBay has a similar affiliate program and historically I believe they do around 4-5% of GMB (gross merchandise bought) for the marketplace side of the business.

I'd imagine Amazon would be in the same ballpark. If Amazon was paying out 4-8% on 40% of their revenue they'd be in serious trouble.

[+] no_gravity|11 years ago|reply
"Wikipedia says that Amazon gets 40% of their revenue from affiliates"

It says 40% from affiliates and third-party sellers. The linked source says 40% from affiliates though. But it's 6 years old. I would love to see some current numbers.

[+] bitJericho|11 years ago|reply
This isn't a new thing. Amazon hasnt allowed installable software (without prior approval) nor have they allowed price comparison sites for years and years and years. Actually, have they ever allowed it?
[+] userbinator|11 years ago|reply
On a side note, Amazon does not allow the use of its API for price trackers, they made that clear, and has lately made it very difficult to get the data in other ways.

If people can still access the same data just by going to Amazon with their browser, I don't see any fundamental reason why they wouldn't be able to get the data if they really wanted to. I've always believed that APIs on websites are more than just convenience - they're a way for corporations to exert control over the data they give out, sort of like DRM.

In the same way, they're also pretty trivial to circumvent; with webscraping, the major issue is that your traffic stands out, but distribute it widely enough and it won't look anything different from the massive traffic Amazon gets already. You could make a browser plugin and have your users do it for you (just make sure your privacy policies are stated clearly...!)

I'm willing to bet that Amazon's data is already being scraped by many other sites, so that also gives rise to this similarity: the "pirates" win, the "legitimate users" going through their API lose.

[+] Someone1234|11 years ago|reply
With all due respect: Spoken like someone who's never actually tried to do scraping on a large scale. This line just cracks me up:

> If people can still access the same data just by going to Amazon with their browser, I don't see any fundamental reason why they wouldn't be able to get the data if they really wanted to.

Just so naive, like a little kid saying they can build a rocket to the moon because they have a cardboard tube and some petrol.

In its own right web-scraping is difficult, and when the adversary is intentionally fighting against it it can be almost impossible. Modern web-scrapers often have to be smart enough to incorporate almost a full web-stack of technology, since if you lack JS or CSS rendering it is trivial to hide content from you or worse give you bad content the users won't even see (and also keep in mind the scraper has to "understand" CSS using its own logic, as it cannot "view" the result).

They can also dynamically alter how the page is rendered (e.g. if you're treating DOM like a tree and going down to a specific branch, it is trivial to re-order the HTML to break that). CSS effectively removes the relationship between HTML tag order and location on the page.

If I had a team of engineers working full time, I could likely maintain a 90%+ good Amazon web-scraper after about a year of pure development on it (likely using something like WebKit as a starting point). But nobody puts in this type of effect because sooner or later Amazon would sue you for something obscure and effectively win via lawyers fees alone.

An easier solution is just to hire Mechanical Turk-like people to look at pages, note down the price, and pay them 1c/price. It would cost an absolute ton of money, but you're able to start operating almost immediately (no prior development overhead). Plus you could limit it to Amazon's top 100,000 items and nothing more.

[+] TeMPOraL|11 years ago|reply
> I've always believed that APIs on websites are more than just convenience - they're a way for corporations to exert control over the data they give out, sort of like DRM.

Back in the days of Twitter API fiasco (2012/2013) I was playing Mass Effect, and this little gem of wisdom stood out for me as something eerily relevant:

"Your civilization is based on the technology of the mass relays, our technology. By using it, your society develops along the paths we desire. We impose order on the chaos of organic evolution. You exist because we allow it, and you will end because we demand it."

(context without spoilers for those who haven't played the game: mass relays are devices that allow long-range FTL travel, left behind by a mysterious ancient civilization; every species in the galaxy finds a mass relay at some point, which leads them to discovering other species and becoming a part of galactic community)

[+] eli|11 years ago|reply
I'm sure it's technically possible to scrape Amazon. I'm much less confident that it would be legal.
[+] polyvisual|11 years ago|reply
I've not seen priceonia before - what's the difference between that and camelcamelcamel?

Reading the blog post it seems as though camelcamelcamel will be forced to shut at soon, too?

[+] martinml|11 years ago|reply
I use Pricenoia to check prices in the different european Amazons, because pretty much all items can be shipped to other countries within Europe. As far as I know camelcamelcamel doesn't do that :(
[+] paulhauggis|11 years ago|reply
This is the norm with Amazon.

They will shutdown your account, take your money, and ignore your emails/not give you any real reason why they shut it down.

Amazon is an evil company that abuses their monopoly position on a daily basis.

On top of this, when you are a seller, they get to keep your customers. You can't contact them outside of Amazon or get any personal info.

[+] Titanbase|11 years ago|reply
I was looking at the Uber API, and thought about comparing prices between Uber and Lyft... then I read this blog post on Pricenoia and it changed my mind.

It does seem like a gamble to work with a company's API. It also seems like free work, but perhaps with donations you could make it work.

[+] josefresco|11 years ago|reply
If you understand it to be a temporary venture and plan for the next step, you can still use API's etc. and create unique web apps that will attract users and give you either publicity or short term revenue.
[+] EToS|11 years ago|reply
It looks to be only a matter of time before amazon seek out other targets, such as pricezombie.com, camelcamelcamel.com
[+] legohead|11 years ago|reply
Could this be a hint at a larger business move? Such as, unique pricing by customer?
[+] hari_sem3|11 years ago|reply
Semantics3 (www.semantics3.com) has been tracking Amazon for almost 2 years now (we have price histories to boot!). We can, and do still offer price comparison functionality for products sold on Amazon; you can also compare these prices against other domains.
[+] finkin1|11 years ago|reply
I'm a happy customer of Semantics3, although the number of products they have data for isn't overwhelming.