DEV Community

Mohan Ganesan
Mohan Ganesan

Posted on • Originally published at proxiesapi.com

Web Scraping Google Scholar Results Using Python and Beautiful Soup

Google Scholar is a tremendous resource for academic resources from across the worldwide web. Today let's see how we can scrape Google Scholar results for the search “Web scraping.”

We will use BeautifulSoup to help us extract information, and we will use the Python Requests module to fetch the data.

https://youtu.be/XiJWHdnVibY

Discussion (1)

Collapse
deepeshsagar profile image
deepeshsagar

Hi, this is very useful article. Definitely reduces the time. I'm planning to get all articles within the last month. Can you tell me how to do that.
Below two actions.
1) default display of search is sort by " by relevance". how to set it to "sort by date"
2) there is information on number of days before article published. how to get it?