While this is probably true -- or even worse -- I think this is already baked into the rates advertisers are paying. Sophisticated advertisers have conversion rates they track carefully and what they bid/spend on ads is worked-to backwards from that number. In other words, if a conversion is worth $5 to me, and I see I get a 3% conversion rate, I'm not going to spend more than $0.15 per click.
Obviously this isn't a universal truth, and branding campaigns are more difficult to price, but this story is posted cyclically and it I often read people's take that this is a stat indicating things are unsustainable and headed for a correction, but I think we're past that. Online advertisers have grown more sophisticated over the last decade and CPMs & CPCs have dropped significantly along with that.
I agree. Fake traffic or not, it's factored into the price and the stats are still just too good compared to what you can get anywhere else from an information standpoint. As a marketing person, you're always proving your worth--digital ads make this a lot easier (at least if you're good at your job).
The problem (at least if you're selling digital ads) is I don't see a scenario where margins increase. The "ad network" effect will continue and there will be more consolidation in the industry with more link-bait headlines coming out of blog mills. The area where there could be more profit would be if content creators integrated more with advertisers, which is only going to get hairy and annoying in a different way. But for something like NYT--I wouldn't be all that surprised if the line between advertiser and content continues getting more fuzzy in order to maintain decent CPMs on what is probably a relatively fixed amount of traffic/inventory.
Another opportunity comes to mind--better demographic targeting, better inference algorithms (given a list of factors, what can we tell about this person re: age/sex/income/likelihood-to-buy-our-specific product-based-on-past-purchases?)--these will also allow content creators to maintain higher CPMs, so there's probably a market there.
Yep, this is absolutely true. At Perfect Audience, our advertisers are often using as many as 3 or even 4 tools to track and measure their return on ad spend. The numbers don't always line up exactly from tool to tool, but they can see pretty quickly and clearly if a new channel's going to product ROI or be a dog for them.
On the one hand you're true, on the other hand if somebody steals £10 from my wallet every day I can budget my life to not care about it, but I'm still having money stolen from me.
Just because it works now, if you could get rid of the fraud then either advertisers could get better value, or legitimate sellers could make more money, or both.
Also, you'd be amazed how many advertisers don't track conversions. I've experience in both digital sales and buying, and on the sales side a huge number of clients wouldn't look at anything more than the impressions/clicks figures that we (truthfully) told them we delivered.
My last business was ad-supported (premium, big-brand advertisers). One day, out of the blue, one of the companies which sold ads on our behalf sent us a nasty letter accusing us of buying junk traffic / creating false impressions and clicks - something we most definitely did not do.
Digging through the raw ad server log files, I discovered that the "suspicious" impressions and clicks were all originating from AWS IP addresses - most likely someone was using AWS to run a spider on our site, the spider followed Javascript links, and therefore clicked every ad on every page.
We ended up adding a rule in our ad server to prevent ads from being served to any IP address which belonged to cloud hosting / VPS providers - this solved the problem for us.
I've since sold the business and therefore don't know if the problem ever arose again, but I believe blacklisting IP address blocks which are highly unlikely to belong to real human beings* could be a good start for anyone running into these sorts of issues, either on the advertiser or publisher end.
*Yes, I know some people run VPNs on AWS or similar VPS instances, which means they are real humans - that was a loss we were willing to deal with.
That solves the bad bot problem, it doesn't solve the actual ad fraud problem. There are at least millions, if not tens or hundreds of millions, of ad clicks per day coming from botnets of ordinary Windows computers on residential ISPs with full JS-executing browsers. You can't detect this activity based on IP address, user agent, script execution, etc. I've seen individual advertisers targeted and get hit by hundreds of ad clicks per day, when they usually only get a dozen or two, every click from a different Comcast/FiOS/TW/RR residential IP, with unique user agents, and varying search phrases that match the ads.
It's much, much harder to detect and block that; if we could only see activity on our own individual websites it'd be nearly impossible to tell the normal clicks from the fraudulent activity.
Only a quarter? Must have been a high-quality source.
The thing is a lot of publishers are fully aware of the fact that the traffic is mostly fraudulent. The ones who rely on bogus metrics such as Quantcast, Hitwise, Comscore, Alexa, etc. They buy up a ton of second tier search traffic for extremely low PPCs, we're talking sub-penny, and use that to inflate their "visitors" metric which is then used to sell how popular their site is to large brand advertisers.
I somehow doubt that any PPC search traffic, even 2nd tier, is cheap enough to arbitrage off in this manner. PPC costs have climbed over the years and any PPC -> CPM arbitrage seems unlikely to me these days. I'm thinking they have other sources. Do you know for a fact it's PPC search they're sourcing visitor count from?
I've been fortunate enough to have first-hand access to the analytics platforms of a number of fairly high-traffic sites (in the tens-to-hundreds of millions of unique visitors per month), and not once did Hitwise, Alexa, or any of those estimates come anywhere close to actual data. There was nothing shady about the way these sites got their traffic–the vast majority was organic, because they're sites everyone here has heard of–but for some reason the third-party data was just bogus. Like, not unreasonably outside the realm of totall-made-it-up bogus.
It's worth remembering that sites like comScore, Quantcast, Alexa and Hitwise derive a solid chunk of their business by enabling Google sales reps to better convince clients to spend more money. It's not far off from an academic whose career depends on grants by parties who are heavily invested in seeing a particular outcome.
This is a big problem even for Bing/Yahoo. They've recently partnered with Media.net for their content (display network ads) and many of the publishers in that network deliver fraudulent clicks (Keywordblocks and the like).
The other problem I've noticed is that if you don't bid high enough for search keywords, they start sending you traffic from Media.net and make it look like it is search traffic. For example I bid on the search term "get money now" (don't want to reveal the actual query). For real search traffic, the clicks convert very well for me. A few months ago I noticed that my conversion rates had fallen significantly. When I investigated I noticed that most of it was from media.net/5_ways_to_get_money.cfm and none of these clicks ever produced a sale. I am in the process of pursuing a refund and have blocked the site. Real search traffic always comes from search.yahoo.com or Bing.com.
It is an even bigger problem for AOL (Advertising.com) that includes supposedly premium sites like HuffingtonPost.com. You will frequently notice:
1. Inflated clicks. Your analytics show you got 100 clicks, their's show you got 170. When you raise this with their support staff the standard answer is they will not investigate based on someone else's analytics. I said, I have two different analytics programs on my server that show the same count which is a lot lower than theirs. They still won't budge. I am in the process of pursuing a charge back.
2. Clicks with 100% bounce rate and that spent exactly zero seconds on your site. There is just no way these are real humans.
> 2. Clicks with 100% bounce rate and that spent exactly zero seconds on your site. There is just no way these are real humans.
If you're using common analytics programs, you're probably misled about what the time-on-site statistic means. Unless they actively ping every visitor on your site the entire time your page is open, which is not the norm, they have no way to know the time-on-site for single page visits. It's computed as the elapsed time between two page views (two loads of the analytics script), but if there is no second page view, there's no second time to subtract from. Someone who clicks through to your page and reads intently for 13 seconds before closing the page is a "0 second visit" as far as those programs are concerned.
Can't a lot of this be solved by purchasing pay-per-day ads?
Paying per click or per thousand views just gives someone the incentive to increase clicks and views fraudulently. When you pay $10 to have your ad on the front page for the whole day the incentive to cheat disappears.
This is why I've been using Blogads.com and smaller networks instead of Google Adwords. The traffic is high quality, I don't have problems with high bounce rates and visitors that spend 0 seconds on my sites. I actually get legitimate traffic. Sometimes I over-pay for the ad space, sometimes I under pay.
Also, I knew a guy (who makes a social network and forums community platform for big companies) whose competitors would purposely pay an Indian company to search for his website in Google and click the sponsored ads using constantly changing IPs so they can cost him money and use up his budget. Something like 70% of his clicks were fraudulent.
Again, this wouldn't matter with pay-per-day/week/month advertising. Too bad it's not compatible with Google's current Pay-per-click auction / maximize profit system.
We spend an inordinate amount of time trying to combat click fraud. Clearly someone pulling in 2,500 - 5,000 a month via click fraud is a 'small potatoes' to the big ad networks but I'm sure a lot of people have made lifestyle businesses with it. Common fraud patterns are clicks from AWS or foreign hosting facilities. Or waves of clicks on a single ad from a swath of subscribers.
A closely related problem was the basis of a dissertation I wrote for my honours year. At the time I felt I had discovered a reliable way to track legitimate visits to websites by participating users.
Upon subsequent review it transpired that I was wrong. Given the primitives of HTML, Javascript and HTTP, I don't believe you can produce a robust tracking scheme, whether for advertising or for any other purpose. You need to add additional steps or software over and above the basics.
That latter observation is the basis of a new design which I am currently, in order to start brawls in certain circles, in the process of patenting.
I'm happy to forward my dissertation to interested persons via email, check my profile.
As someone who worked several years for one of the front running ad fraud agencies, I can tell you what most of our customers said. "We don't care about fraud, it is priced in."
Right, it's basically "the cost of doing business" overhead that encompasses unsavory costs like bribes, extortion, dishonest employees, etc. As long as the parasites in the process don't get too greedy, it's still possible to run a business. It's just not as profitable as it would be and/or the customers pay more as a result. Unfortunately the sleaziest advertisers tend to thrive better in this environment.
As someone who's spent several years researching and working within the online advertising industry, I can attest to this being quite common on a lot of the larger Alexa-ranked sites and traffic sources.
There are many highly ranked sources that will simply burn through your ad spends as quickly as you can deposit funds to the account. People often times spend thousands throwing away money on "testing" these sources, only to usually find they don't pan out.
That's why one of the most important things in online advertising is constant optimization and watching the conversion rates from different sources and adjusting bids as necessary. Drop the sources that don't pan out.
It's similar to stock trading, mitigate your losses quickly and don't bleed your ROI or throw away excess money on "testing" what works. Prune the sources that aren't doing anything for you, and watch your ad spends become much more productive.
The only thing the traffic described in this article is good for is vanity metrics and pumping up numbers like it sounds several of these large brand sites are doing.
If you're looking to inflate your numbers, sure... waste a bunch of money on a ton of bot hits, it's still 1999 right? Just don't expect any sales or conversions from that type of traffic... ever. It just simply won't happen.
I don't think i've evern seen an article so badly written. It has the right research, but it is pointless. The whole thing is sumarized in the last two paragraphs. With zero information lost:
"""
Says Woodman: “When we try to tighten things up, our measured performance goes down. There is an incentive among buyers to let the floodgates open. And publishers need more money, so they ignore.” So the bad traffic persists. “We need to fix this as an industry,” he adds. “Somebody needs to give a shit.”
The IAB seems to. Per Sullivan, the organization is working on devising a standard for publishers akin to the Good Housekeeping Seal. He’d like to see the biggest stakeholders get more aggressive about the problem, including brands and agencies. “If buyers came out and said, ‘I will only buy from certified vendors,’ that would change things,” he says.
"""
so basically, the industry measures clicks. and bots delivers clicks. fraudulents, but clicks. and everyone is trying to fix it with black/white-lists so they get a promotion for getting the clicks, but not looking bad with their boss when some known scam site shows up in the report.
The whole industry is based on allowing only the 'clean' bots of the week inflate your numbers.
[+] [-] encoderer|12 years ago|reply
Obviously this isn't a universal truth, and branding campaigns are more difficult to price, but this story is posted cyclically and it I often read people's take that this is a stat indicating things are unsustainable and headed for a correction, but I think we're past that. Online advertisers have grown more sophisticated over the last decade and CPMs & CPCs have dropped significantly along with that.
Curious what anybody else thinks..
[+] [-] dave_sullivan|12 years ago|reply
The problem (at least if you're selling digital ads) is I don't see a scenario where margins increase. The "ad network" effect will continue and there will be more consolidation in the industry with more link-bait headlines coming out of blog mills. The area where there could be more profit would be if content creators integrated more with advertisers, which is only going to get hairy and annoying in a different way. But for something like NYT--I wouldn't be all that surprised if the line between advertiser and content continues getting more fuzzy in order to maintain decent CPMs on what is probably a relatively fixed amount of traffic/inventory.
Another opportunity comes to mind--better demographic targeting, better inference algorithms (given a list of factors, what can we tell about this person re: age/sex/income/likelihood-to-buy-our-specific product-based-on-past-purchases?)--these will also allow content creators to maintain higher CPMs, so there's probably a market there.
[+] [-] brandnewlow|12 years ago|reply
[+] [-] corin_|12 years ago|reply
Just because it works now, if you could get rid of the fraud then either advertisers could get better value, or legitimate sellers could make more money, or both.
Also, you'd be amazed how many advertisers don't track conversions. I've experience in both digital sales and buying, and on the sales side a huge number of clients wouldn't look at anything more than the impressions/clicks figures that we (truthfully) told them we delivered.
[+] [-] gettheyayo|12 years ago|reply
[deleted]
[+] [-] kitcar|12 years ago|reply
Digging through the raw ad server log files, I discovered that the "suspicious" impressions and clicks were all originating from AWS IP addresses - most likely someone was using AWS to run a spider on our site, the spider followed Javascript links, and therefore clicked every ad on every page.
We ended up adding a rule in our ad server to prevent ads from being served to any IP address which belonged to cloud hosting / VPS providers - this solved the problem for us.
I've since sold the business and therefore don't know if the problem ever arose again, but I believe blacklisting IP address blocks which are highly unlikely to belong to real human beings* could be a good start for anyone running into these sorts of issues, either on the advertiser or publisher end.
*Yes, I know some people run VPNs on AWS or similar VPS instances, which means they are real humans - that was a loss we were willing to deal with.
[+] [-] dangrossman|12 years ago|reply
It's much, much harder to detect and block that; if we could only see activity on our own individual websites it'd be nearly impossible to tell the normal clicks from the fraudulent activity.
[+] [-] gcb0|12 years ago|reply
[+] [-] meritt|12 years ago|reply
The thing is a lot of publishers are fully aware of the fact that the traffic is mostly fraudulent. The ones who rely on bogus metrics such as Quantcast, Hitwise, Comscore, Alexa, etc. They buy up a ton of second tier search traffic for extremely low PPCs, we're talking sub-penny, and use that to inflate their "visitors" metric which is then used to sell how popular their site is to large brand advertisers.
[+] [-] arbuge|12 years ago|reply
[+] [-] CrankyPants|12 years ago|reply
It's worth remembering that sites like comScore, Quantcast, Alexa and Hitwise derive a solid chunk of their business by enabling Google sales reps to better convince clients to spend more money. It's not far off from an academic whose career depends on grants by parties who are heavily invested in seeing a particular outcome.
[+] [-] curiouslurker|12 years ago|reply
The other problem I've noticed is that if you don't bid high enough for search keywords, they start sending you traffic from Media.net and make it look like it is search traffic. For example I bid on the search term "get money now" (don't want to reveal the actual query). For real search traffic, the clicks convert very well for me. A few months ago I noticed that my conversion rates had fallen significantly. When I investigated I noticed that most of it was from media.net/5_ways_to_get_money.cfm and none of these clicks ever produced a sale. I am in the process of pursuing a refund and have blocked the site. Real search traffic always comes from search.yahoo.com or Bing.com.
It is an even bigger problem for AOL (Advertising.com) that includes supposedly premium sites like HuffingtonPost.com. You will frequently notice:
1. Inflated clicks. Your analytics show you got 100 clicks, their's show you got 170. When you raise this with their support staff the standard answer is they will not investigate based on someone else's analytics. I said, I have two different analytics programs on my server that show the same count which is a lot lower than theirs. They still won't budge. I am in the process of pursuing a charge back.
2. Clicks with 100% bounce rate and that spent exactly zero seconds on your site. There is just no way these are real humans.
[+] [-] dangrossman|12 years ago|reply
If you're using common analytics programs, you're probably misled about what the time-on-site statistic means. Unless they actively ping every visitor on your site the entire time your page is open, which is not the norm, they have no way to know the time-on-site for single page visits. It's computed as the elapsed time between two page views (two loads of the analytics script), but if there is no second page view, there's no second time to subtract from. Someone who clicks through to your page and reads intently for 13 seconds before closing the page is a "0 second visit" as far as those programs are concerned.
[+] [-] ChrisNorstrom|12 years ago|reply
Paying per click or per thousand views just gives someone the incentive to increase clicks and views fraudulently. When you pay $10 to have your ad on the front page for the whole day the incentive to cheat disappears.
This is why I've been using Blogads.com and smaller networks instead of Google Adwords. The traffic is high quality, I don't have problems with high bounce rates and visitors that spend 0 seconds on my sites. I actually get legitimate traffic. Sometimes I over-pay for the ad space, sometimes I under pay.
Also, I knew a guy (who makes a social network and forums community platform for big companies) whose competitors would purposely pay an Indian company to search for his website in Google and click the sponsored ads using constantly changing IPs so they can cost him money and use up his budget. Something like 70% of his clicks were fraudulent.
Again, this wouldn't matter with pay-per-day/week/month advertising. Too bad it's not compatible with Google's current Pay-per-click auction / maximize profit system.
[+] [-] ChuckMcM|12 years ago|reply
[+] [-] jacques_chester|12 years ago|reply
Upon subsequent review it transpired that I was wrong. Given the primitives of HTML, Javascript and HTTP, I don't believe you can produce a robust tracking scheme, whether for advertising or for any other purpose. You need to add additional steps or software over and above the basics.
That latter observation is the basis of a new design which I am currently, in order to start brawls in certain circles, in the process of patenting.
I'm happy to forward my dissertation to interested persons via email, check my profile.
[+] [-] clubhi|12 years ago|reply
[+] [-] dmethvin|12 years ago|reply
[+] [-] chaseideas|12 years ago|reply
There are many highly ranked sources that will simply burn through your ad spends as quickly as you can deposit funds to the account. People often times spend thousands throwing away money on "testing" these sources, only to usually find they don't pan out.
That's why one of the most important things in online advertising is constant optimization and watching the conversion rates from different sources and adjusting bids as necessary. Drop the sources that don't pan out.
It's similar to stock trading, mitigate your losses quickly and don't bleed your ROI or throw away excess money on "testing" what works. Prune the sources that aren't doing anything for you, and watch your ad spends become much more productive.
The only thing the traffic described in this article is good for is vanity metrics and pumping up numbers like it sounds several of these large brand sites are doing.
If you're looking to inflate your numbers, sure... waste a bunch of money on a ton of bot hits, it's still 1999 right? Just don't expect any sales or conversions from that type of traffic... ever. It just simply won't happen.
[+] [-] gcb0|12 years ago|reply
"""
Says Woodman: “When we try to tighten things up, our measured performance goes down. There is an incentive among buyers to let the floodgates open. And publishers need more money, so they ignore.” So the bad traffic persists. “We need to fix this as an industry,” he adds. “Somebody needs to give a shit.”
The IAB seems to. Per Sullivan, the organization is working on devising a standard for publishers akin to the Good Housekeeping Seal. He’d like to see the biggest stakeholders get more aggressive about the problem, including brands and agencies. “If buyers came out and said, ‘I will only buy from certified vendors,’ that would change things,” he says.
"""
so basically, the industry measures clicks. and bots delivers clicks. fraudulents, but clicks. and everyone is trying to fix it with black/white-lists so they get a promotion for getting the clicks, but not looking bad with their boss when some known scam site shows up in the report.
The whole industry is based on allowing only the 'clean' bots of the week inflate your numbers.
[+] [-] amalag|12 years ago|reply
[+] [-] striker44|12 years ago|reply
[+] [-] cylinder|12 years ago|reply
[+] [-] ars|12 years ago|reply
[+] [-] charleslmunger|12 years ago|reply