Great tutorial! Really happy seeing this in Node.js on top of all the Python tuts out there on scraping.
I'd love to see a series of this too - maybe covering topics like how to do pagination, scraping web pages that are using AJAX, etc. Thank for sharing!
maybe covering topics like how to do pagination, scraping web pages that are using AJAX
Great idea. I can imagine the pagination being kind of easy (though manually changing the page urls). It would involve chaining axios promises/calls and refactoring the same code to keep it DRY.
Scraping Ajax pages, I want to say it can't be done but I have no idea, I'll have to research it. It be cool though
Great tutorial! Really happy seeing this in Node.js on top of all the Python tuts out there on scraping.
I'd love to see a series of this too - maybe covering topics like how to do pagination, scraping web pages that are using AJAX, etc. Thank for sharing!
Thanks Alex
Great idea. I can imagine the pagination being kind of easy (though manually changing the page urls). It would involve chaining
axiospromises/calls and refactoring the same code to keep it DRY.Scraping Ajax pages, I want to say it can't be done but I have no idea, I'll have to research it. It be cool though
AJAX pagination is actually pretty simple. You don't need Cheerio then, since the API already responding in JSON 😂