DEV Community

Cover image for The Dawn of Scraping Browsers
Gidoneli
Gidoneli

Posted on

The Dawn of Scraping Browsers

Headless browsers were not designed specifically for web scraping. All of them are browser automation tools designed for website testing, etc. In most cases, bot-protection software (such as Akami & DataDom) detects these browsers, making it difficult to scrape on a large scale. It is only because Python and Node.js are open-source tools and easily accessible that programmers use them for scraping.

Learn how the first dedicated scraping browser attempts to simplify this task for dev teams here:
https://medium.com/p/18892624bbc9

Top comments (0)