When you want to use js/ts to obtain a large amount of network data, you may want to try x-crawl
A Step-by-Step Guide to Building a Scalable Distributed Crawler for Scraping Millions of Top TikTok Profiles
Crawler Web dev.to using Colly when learning Golang
The Difference Between Web Scraping vs Web Crawling
Build A Web Crawler To Find Any Broken Links on Your Site with Python & BeautifulSoup
15 Best Website Downloaders & Website Copier – Save website locally to read offline
[Beginner] How to build Youtube video crawler web application with Rails 6, Devise, Nokogiri and Bootstrap 4?
Broken links checker with Python and Scrapy webcrawler