DEV Community

Discussion on: How to Create a Web Crawler From Scratch in Python

Collapse
 
fprime profile image
Frankie

Since there has been a lot of confusion about the curl issue I have updated the post to address the reason and possible workarounds.

Collapse
 
hossain000 profile image
Hossain000

That code was awesome. In this code you have extracted meta description, can you show how to extract <div class , PLEASE

Some comments have been hidden by the post's author - find out more