DEV Community

Discussion on: Getting started with web scraping in Python

Collapse
 
datamatin profile image
Martin Breuss

Concise and nice informative graphic! 🙌 Quick note: I think one important aspect of web scraping that isn't always mentioned is that you need to first inspect the site you want to scrape.

IMO, the basic web scraping process goes like this:

  • Inspect the Website
  • Scrape the Content
  • Parse the relevant Data

If anyone wants a longer article on the topic that explains this process and goes into detail while scraping a job board step-by-step, check out my article on Real Python: Beautiful Soup: Build a Web Scraper with Python. Hope this helps someone as a next step if they are interested in this topic : )