python 3.x - Technology behind [crawlera](http://crawlera.com)(What tools the use to download page content) -
i use urllib module in python scrap data.
certain websites blocking download page content throwing 404 error website live.
in such cases use crawler proxies.
i wonder tools , technologies use blacklist website make work 404 200
could 1 have idea behind it?
Comments
Post a Comment