DEV Community

Bye Bye 403 - Building a Filter Resistant Web Crawler Part III: User Agents

kaelscion on March 07, 2019

So we’ve covered what web scraping is. We’ve also covered how to cycle proxy information to disguise our IP Address. But there is another step in...
Collapse
 
mjbf0748 profile image
Methuen Jelani Bell-Isaac

Hey Jake, Love this thread! Any chance you posted part 4?

Collapse
 
kaelscion profile image
kaelscion

I'm so glad you like the series! I did post part 4! It is in the form of a video! You can find it here: dev.to/kaelscion/bye-bye-403-build...

Admittedly, I've not been able to blog much lately because I now work at a startup converting a legacy PHP app to serverless. But I'm gunning for part 5 as soon as I can!