DEV Community

loading...

Discussion on: WebScraping [Part-1]

Collapse
mahithchigurupati profile image
Mahith

Good tutorial. Well explained..!

Collapse
sunilaleti profile image
Collapse
zareefweb profile image
zareefweb

how to scrap news post in bulk which are dynamic? I searched lot unable to find

Thread Thread
sunilaleti profile image
Sunil Aleti Author • Edited

Yes, it's very difficult to scrape dynamic sites because the data is loaded dynamically with JavaScript.
In such cases, we can use the following two techniques:

  • Reverse Engineering JavaScript
  • Rendering JavaScript

And will definitely make a tutorial in future 🤞