I love how you broke down everything in this article from html, colly and python. One thing that I surely relate to is the popups! Sites like netnaija have a lot of them and I'm glad you pointed this out. Good writeup Diretnan! Keep scribbling...
For popups or any other dynamic element on webpages you can use Selenium and a headless browser to get the information.
Some comments have been hidden by the post's author - find out more
Are you sure you want to hide this comment? It will become hidden in your post, but will still be visible via the comment's permalink.
Hide child comments as well
Confirm
For further actions, you may consider blocking this person and/or reporting abuse
We're a place where coders share, stay up-to-date and grow their careers.
I love how you broke down everything in this article from html, colly and python.
One thing that I surely relate to is the popups! Sites like netnaija have a lot of them and I'm glad you pointed this out.
Good writeup Diretnan!
Keep scribbling...
For popups or any other dynamic element on webpages you can use Selenium and a headless browser to get the information.