DEV Community

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
LinkedIn Scraping with Python: Profiles, Jobs & Company Pages

LinkedIn Scraping with Python: Profiles, Jobs & Company Pages

Comments
9 min read
When scraping orchestration is the wrong abstraction for LLM workflows

When scraping orchestration is the wrong abstraction for LLM workflows

Comments
4 min read
Generating scraper logic at runtime instead of writing it per site

Generating scraper logic at runtime instead of writing it per site

Comments
3 min read
Twitch Chat Scraper: export any VOD's full chat replay for $1.05/1K

Twitch Chat Scraper: export any VOD's full chat replay for $1.05/1K

Comments
7 min read
Threads Reply Scraper: export the full conversation tree of any public post

Threads Reply Scraper: export the full conversation tree of any public post

Comments
8 min read
Steam Regional Price Data: fetch 60 regions in one run for $1.05/1K

Steam Regional Price Data: fetch 60 regions in one run for $1.05/1K

Comments
8 min read
Stack Overflow Scraper: export any tag or query to JSON for $1.50/1K

Stack Overflow Scraper: export any tag or query to JSON for $1.50/1K

Comments
8 min read
Web Scraping Kenyan Data Sources: What's Available, What Fights Back, and the Patterns That Keep Pipelines Running

Web Scraping Kenyan Data Sources: What's Available, What Fights Back, and the Patterns That Keep Pipelines Running

1
Comments
12 min read
How to scrape Recruitee jobs data (with salary) in Python — no API key

How to scrape Recruitee jobs data (with salary) in Python — no API key

Comments
3 min read
AI agents don't always need browsers to read the web

AI agents don't always need browsers to read the web

Comments
4 min read
Reverb Scraper: pull historical sold prices for any musical gear

Reverb Scraper: pull historical sold prices for any musical gear

Comments
7 min read
LLM API pricing comparison: one schema across all 7 providers for $5.05/1K

LLM API pricing comparison: one schema across all 7 providers for $5.05/1K

Comments
8 min read
How to scrape Apple App Store data with Python (no API key needed)

How to scrape Apple App Store data with Python (no API key needed)

Comments
4 min read
Lemmy Scraper: export posts and comments from any Fediverse community

Lemmy Scraper: export posts and comments from any Fediverse community

1
Comments
9 min read
3 Reasons Your Web Scraper Breaks in Production (and How to Fix Each)

3 Reasons Your Web Scraper Breaks in Production (and How to Fix Each)

Comments
2 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.