DEV Community

fooooo-png
fooooo-png

Posted on • Originally published at helpcenter.octoparse.com

News: Crawler auto-generation tool!

The Octoparse 8.1(bate) is Octoparse brand new version, helping to improve the non-programmer's experience of web scraping. The greatest thing about this new version is the crawler auto-generation function.

Crawler auto-generation algorithm
Traditionally speaking, if someone wants to create a crawler, he/she should start from learning computer languages, like Jave Script, R, Python or some others and then write the codes with the assistance of the open-source libraries, like Github and Beautiful soup. Or they can choose a web scraping tool to get it done. The topmost popular tools are Octoparse, webscraper.io, and Parsehub, according to their traffic.

ranking

Compared with using computer languages to create a crawler, a web scraping tool could be an easier choice as learning using the tool is easier. To make it easier than easier, Octoparse develops the auto-generation algorithm to empower non-programmers the ability of web scraping. Everyone is able to achieve auto-generating a crawler after entering a URL.

Octoparse 8.1(bate) has been released with the crawler auto-generation function and available for everyone to have it a try!
Download

Here're two videos for further references.
https://www.youtube.com/watch?v=s6pirJKtVk0&t
https://www.youtube.com/watch?v=6TWJ2LKGWQk

If you have figure out a better way to create a crawler to scrape data online, please leave your message in the comment area!

Top comments (0)