web-scraping (jamditis)

Pulls data off web pages that don't hand it over cleanly — cascading through fallback fetch strategies and coping with 403s, CAPTCHAs, and rate limits, while validating every URL and treating whatever comes back as untrusted. It is a disciplined way to ACQUIRE raw data from the live web, not a tool for analyzing, charting, or synthesizing what you collect.

A situation it fits

You need a current list of all product pages and prices from a dozen competitor storefronts that don’t offer an API, and some storefronts block automated requests.
web-scraping (jamditis). web-scraping is the skill for obtaining live content from websites that don’t provide structured feeds, especially when you must work around blocking measures and multiple fetch strategies. The other skills handle analysis, visualization, or broad research rather than robustly acquiring live site content.

5 scenarios in the bank answer to web-scraping (jamditis). The rest are in the game.

Skills it gets confused with

These share a family with web-scraping (jamditis), which is another way of saying they are the ones you might reach for by mistake.

Knowing what web-scraping (jamditis) does is the easy half. Telling it apart from the others under time pressure is the game.

Today's session

web-scraping (jamditis) is part of jamditis/claude-skills-journalism. Licence: MIT. The description above was written for this game, not taken from the skill.

← All skills