[taddeimania]

I've used BeautifulSoup to do stuff like this.

[jeffjia]

Yeah. Me too. The css selector is quite convenient. The only problem is that I need to pick the selector set for each website I need to scrape, and there are tens of them, which makes the work itself time-consuming...