top | item 11199600

(no title)

typeiierror | 10 years ago

A couple of reasons - data quality and usage restrictions are the top. Here's an example - say I'm Big Box Retailer & Co and I want to measure how many people who visit my store also visited my competitor, Small Box Retailer Inc. Where can I go to buy that data?

-Facebook or Google don't sell their raw user data. They can tell me how effective the ads I placed on their sites were at driving visits or sales by matching my customer's email & phone numbers to their users (see [1] and [2]), but they won't give me data on my competitor, and the data will always be aggregated. So on to the next idea..

-Mobile ad server data aggregators might sell me their raw data, but the quality isn't great. Sure, they track 100m+ devices...but how many times do they see each of those devices a day? For most devices it's 10 times or less, so you're going to have a big problem with false negatives (people who visited Big Box Retailer and Small Box Retailer, but due to the sparsity of the data I miss one of those visits). On to the next...

-Foursquare is newly in the data business, but despite having a big audience (50m MAU), only ~1.3m users have opted in for continuous measurement ([3]). On top of that, Foursquare's audience is pretty skewed - if Big Box Retailer's customers are older, I'm going to have trouble finding them in Foursquare's data set, which means the effective size of their 1.3m 'panel' is really something like 200k-500k. On top of that, I can't survey them to verify they actually visited Small Box Retailer instead of the McDonalds next store, since the GPS data Foursquare pulls is LastKnown instead of exact.

-...so if the only data I can buy on the open market is skewed, not really that big (not to mention collected under potentially dubious privacy policies), whats my alternative? Thats the need these panels are filling.

As an aside, if you're curious what apps on your phone are collecting your location data, you can use a self-hosted MITM server w/ SSL decryption to sniff your own traffic. Here's own for Android: https://code.google.com/archive/p/sandrop/

[1] http://www.wsj.com/articles/google-touts-mobile-ad-technolog... [2] http://www.adweek.com/news/technology/facebook-gives-retaile... [3] http://techcrunch.com/2016/02/22/attribution-by-foursquare/

discuss

order

retbull|10 years ago

In addition to this people do things to their phones that make data useless quite often. They turn off their gps, root the phone and change the clock so they can cheat at games, use location spoofing apps so they can pretend to be somewhere else on tinder. Then on top of that it can be hard to tell where people are even with gps on because being in a building screws it up. There are several solutions to that problem but nothing is perfect.