Developer-roadmap: Web scraping Roadmap

Created on 12 Dec 2019  路  2Comments  路  Source: kamranahmedse/developer-roadmap

I am not sure if it is front or back i consider it a totally different thing which deserves attention and some facts about it should be shared in roadmap

Most helpful comment

@kamranahmedse I think you are underestimating this, as it's not easy to learn how to scrape properly.

@giorgiberia
To learn to scrape you need to learn some web technologies as HTTP protocol (+ how headers, cookies, User-Agents, etc. work), CSS and XPATH selectors, JavaScript and JSON, RegEx, how to properly use proxies (proxy rotation), etc. and finally you should learn some language with/or without a framework (as Python + Scrapy).

All 2 comments

That doesn't require a roadmap :)
Just google how to scrape in the language of your choice.

@kamranahmedse I think you are underestimating this, as it's not easy to learn how to scrape properly.

@giorgiberia
To learn to scrape you need to learn some web technologies as HTTP protocol (+ how headers, cookies, User-Agents, etc. work), CSS and XPATH selectors, JavaScript and JSON, RegEx, how to properly use proxies (proxy rotation), etc. and finally you should learn some language with/or without a framework (as Python + Scrapy).

Was this page helpful?
0 / 5 - 0 ratings

Related issues

Oxymoron290 picture Oxymoron290  路  4Comments

hellpirat picture hellpirat  路  4Comments

sxnaprkhr picture sxnaprkhr  路  3Comments

parv0888 picture parv0888  路  5Comments

huseyincelik picture huseyincelik  路  3Comments