DEV Community

Discussion on: Introduction to web scraping with Node.js

Collapse
 
aurelkurtula profile image
aurel kurtula

Thanks Alex

maybe covering topics like how to do pagination, scraping web pages that are using AJAX

Great idea. I can imagine the pagination being kind of easy (though manually changing the page urls). It would involve chaining axios promises/calls and refactoring the same code to keep it DRY.

Scraping Ajax pages, I want to say it can't be done but I have no idea, I'll have to research it. It be cool though

Collapse
 
jitheshkt profile image
Jithesh. KT

AJAX pagination is actually pretty simple. You don't need Cheerio then, since the API already responding in JSON 😂