Selenium is library that can be useful when scraping the web. Unlike the other libraries, Selenium wasn’t originally designed for web scraping. First and foremost, Selenium is a web driver designed to render web pages like your web browser would for the purpose of automated testing of web applications.
pip install selenium
from selenium import webdriver
# Chrome: chrome_driver = webdriver.Chrome(“Chrome Driver Path”) # Firefox: firefox_driver = webdriver.Firefox(“Firefox Driver Path”) # Opera: opera_driver = webdriver.Opera(“Opera Driver Path”) # Edge: edge_driver = webdriver.Edge(“Edge Driver Path”) # Safari safari_driver = webdriver.Safari() # The SafariDeriver is integrated in Safari.
url = "https://www.example.com" driver.get(url)
For many resources on Selenium or anything else on Python, check out Github: