DEV Community

Shahidul Islam
Shahidul Islam

Posted on

Do you know what web scraping is?

Simply put, web scraping is the way to extract data from the internet in a structured format.

The internet is undoubtedly full of information, but it is merely structured. For any project which needs data, the format is fundamental. Some might need Excel, some require CSV format, and some need JSON format for use as an API. So, for that reason, web scraping is needed.

How does web scraping work?
A scraper will download the HTML of a page on requests and save entire data or some selected data in a file used for the project.

Which scraping tool is the best?
There is no best scraping tool. All tools are required in different situations. Each website is unique and has its challenge when scraping. Depending on the complexity of the scraping project, the tool selection varies. However, some tools are available like #python packages, no-code tools, browser extensions, e.t.c.


IF YOU LIKE THIS POST, PLEASE HIT THE HEART ICON ON LEFT.

Top comments (0)