top | item 7971918

SnapUp lets you shop on your iPhone by taking screenshots

29 points| satjot | 11 years ago |techcrunch.com

10 comments

order

satjot|11 years ago

If the tech just looks at the screenshot image, how does it have near full coverage of mobile web but has to train/fingerprint apps?

ericgoldberg|11 years ago

Good question- with Safari, we use the visible domain to help score the confidence for mobile websites. For native apps, we don't have any such "easy" confidence boost. So we have to fingerprint the app based on different features present in the image that is captured.

The system is computer vision / machine learning based, so even on novel sites, it will get better over time with more usage and training. We've trained it up for a bunch of the most popular sites already though.

Does this make sense?

proletarian|11 years ago

Do I have to upload the pics manually?

ericgoldberg|11 years ago

No, it detects the screenshots as you take them. (I helped build the app)