DEV Community

Discussion on: Building a traffic fine scraper with Python

Collapse
 
aezore profile image
Jose Rodriguez

Nice! I didn't know the existence of the pprint module so thanks for that, but I was wondering...what are the benefits (or the reason) of using Selenium over BeautifulSoup and Request modules?

Collapse
 
rodolfoferro profile image
Rodolfo Ferro

With Selenium I can both simulate visually scraping activity by the opening of the browser and clicking the buttons, and also hide the browser for an underground simulation.

It was more for personal comfort actually, haha, since I wanted to experiment with Selenium.