DEV Community

Discussion on: Building a cloud-native web scraper using 8 different AWS services

Collapse
 
kayis profile image
K

Interesting stack!

Could a Lambda replace the Fargate part? I read they now can run 15 minutes.

Collapse
 
n1try profile image
Ferdinand Mütsch

Not sure, since you would have to run the Firefox binary within the Lambda. I don't know if that's possible.

Collapse
 
kayis profile image
K

I just found Scraper, a Rust scraping library powered by Servo tech. A bit like a Firefox light

docs.rs/scraper/0.8.2/scraper/

Collapse
 
kayis profile image
K

Ah yes, I had the same problem with Puppeteer/Chrome and switched to Cheerio.