DEV Community

shuyueW1991
shuyueW1991

Posted on

install scrapy via venv

I read the installation of scrapy. For the ubuntu platform I am using, it says that after:

sudo apt update
Enter fullscreen mode Exit fullscreen mode

The preparation is thus done. However, the following command line:

pip install scrapy
Enter fullscreen mode Exit fullscreen mode

does not work for I see that :

ERROR: Could not install packages due to an EnvironmentError: Missing dependencies for SOCKS support.

I checked that it is not the problem of sources of ubuntu, neither is that of missing prep packages.

Then, I realize that, since I am coding inside a venv, the complete error msg may not have been exposed, which misleads my thought.

For example, the problem aroused by permission issue is not shown directly, which I later fixed by typing:

sudo pip install scrapy
Enter fullscreen mode Exit fullscreen mode

Discussion (0)