DEV Community

Mohan Ganesan
Mohan Ganesan

Posted on • Originally published at

Top 8 Ways Web Servers Can Tell Your Web Crawler Apart From Human

Mostly CAPTCHAs are made to appear after the webserver has some way of counting down the number of times a particular user has accessed the service.

In our own experience with hundreds of clients at Proxies API, we have found this to be true if you impersonate multiple humans in other areas than in solving CAPTCHAs.

Discussion (0)