DEV Community

Discussion on: A beginner guide to webscraping in Python

Collapse
mihaylov profile image
Petar Petrov

Scrapy and Selenium are also worth mentioning.

Specifically Selenium where the data is behind some JS or browser generated and BeautifulSoup isn´t enough.

Collapse
kalebu profile image
Jordan Kalebu Author

Yeah sure,
Thanks for mentioning that out

Selenium requires a special position when it comes to web scraping

Scrapy is also really great and structured for crawling and scraping guess beautifulsoup turn out to be friendly for beginners.

Collapse
mihaylov profile image
Petar Petrov

I also forgot to mention that combining them its very powerful, for example Selenium with BeautifulSoup.