This is my 71th day of #100daysofcode and #python learning. Like daily today also learned from Datacamp regarding to the topic web scraping. Today I learned about simple xpath, slasher double feature, (At)tribute, content with contains, extracting data from a selector list, inspecting the HTML.
Here is python code to extract data from selector list.
# Import a scrapy Selector from scrapy import Selector # Import requests import requests # Create the string html containing the HTML source html = requests.get( url ).content # Create the Selector object sel from html sel = Selector( text = html ) # Print out the number of elements in the HTML document print( "There are 1020 elements in the HTML document.") print( "You have found: ", len( sel.xpath('//*') ) )