python 3.x - Technology behind [crawlera](http://crawlera.com)(What tools the use to download page content) -


i use urllib module in python scrap data.

certain websites blocking download page content throwing 404 error website live.

in such cases use crawler proxies.

i wonder tools , technologies use blacklist website make work 404 200

could 1 have idea behind it?


Comments