DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Why Regional Pricing Checks Need Stable Residential Proxy Context
conal_garrett_9ec4e0517ed profile

Why Regional Pricing Checks Need Stable Residential Proxy Context

#webscraping #proxy #testing #dataquality
Comments
2 min read
I scraped live betting odds from 9 countries and never once hit a real anti-bot wall
0xgollum profile

I scraped live betting odds from 9 countries and never once hit a real anti-bot wall

#webscraping #python #api #buildinpublic
Comments
3 min read
How to Scrape Shopify App Store Reviews (and Track Competitor Churn) in 2026
ethan_teague profile

How to Scrape Shopify App Store Reviews (and Track Competitor Churn) in 2026

#webscraping #shopify #api #saas
Comments
2 min read
North Data Alternative (2026): German Company Data via API, pay-as-you-go
ayyoubaha profile

North Data Alternative (2026): German Company Data via API, pay-as-you-go

#api #webscraping #germany #saas
Comments
2 min read
Why Proxy Workflows Need Session Boundaries Before Retry Logic
conal_garrett_9ec4e0517ed profile

Why Proxy Workflows Need Session Boundaries Before Retry Logic

#proxy #webscraping #testing #api
Comments
4 min read
How to Scrape Bluesky Data in 2026 (Posts, Profiles, and Search)
ethan_teague profile

How to Scrape Bluesky Data in 2026 (Posts, Profiles, and Search)

#webscraping #api #python #socialmedia
Comments
2 min read
Cloudflare wasn't blocking our IP. It was blocking our browser.
deadlockv2 profile

Cloudflare wasn't blocking our IP. It was blocking our browser.

#webdev #cloudflarechallenge #webscraping #devops
Comments
3 min read
How to Build a Crawl Budget That Keeps AI Agents Fast and Predictable
kun_shen_eedb57cc827955f5 profile

How to Build a Crawl Budget That Keeps AI Agents Fast and Predictable

#agents #ai #performance #webscraping
Comments
4 min read
I got tired of "remote" meaning "remote, US only", so I counted 2,798 companies
elon_zuckerman_bc59ff99f3 profile

I got tired of "remote" meaning "remote, US only", so I counted 2,798 companies

#remote #webscraping #career #data
Comments
5 min read
Scrape Any Site in 20 Lines with Residential Proxies (Node.js & Python)
aethyn_team profile

Scrape Any Site in 20 Lines with Residential Proxies (Node.js & Python)

#node #python #tutorial #webscraping
2
Comments
3 min read
How to Scrape Ashby Job Listings (With Salary Ranges) to JSON
ratiotech profile

How to Scrape Ashby Job Listings (With Salary Ranges) to JSON

#webscraping #python #api #career
Comments
4 min read
Investor Database API: Filter 10,469 VC, Angel, and PE Firms as JSON in 2026
trufflepig profile

Investor Database API: Filter 10,469 VC, Angel, and PE Firms as JSON in 2026

#webscraping #python #api #fintech
Comments
5 min read
Why AI Browser Agents Survive Site Redesigns (and Scripts Don't)
paulcrinigan profile

Why AI Browser Agents Survive Site Redesigns (and Scripts Don't)

#ai #automation #webscraping #webdev
Comments
1 min read
Yandex Search API: How to Scrape Yandex SERPs as Structured JSON in 2026
trufflepig profile

Yandex Search API: How to Scrape Yandex SERPs as Structured JSON in 2026

#webscraping #python #api #seo
Comments
5 min read
Playwright + Proxies: Sticky Sessions, Rotation, and the SOCKS5 Trap
roamproxy profile

Playwright + Proxies: Sticky Sessions, Rotation, and the SOCKS5 Trap

#webscraping #playwright #python #tutorial
Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.