HomeAbout

About CoreClaw API Directory

Updated August 2026 · CoreClaw API Directory

The CoreClaw API Directory is a free, independent index of 118 web scraping and data extraction APIs across 11 categories: e-commerce and marketplaces, social media, jobs, lead generation, finance, real estate, news, education, search, AI research, and developer utilities.

It exists because choosing a scraping API is harder than it should be. Hundreds of tools exist, most blog round-ups are outdated the month they are published, and there is no way to tell which APIs are actually still working. This directory solves that with three things:

How it is built

The entire site is static: plain HTML/CSS/JS with no backend, hosted on the Netlify free tier. A single JSON file (data.json) holds all 118 APIs, and a small Node script (build-site.js) generates every page, the sitemap, robots.txt, and llms.txt from it. This keeps the site free to run and easy to rebuild as APIs are added.

How it is funded

The directory is free and always will be. It is funded by affiliate links: when you click "Try on CoreClaw" and sign up, we may earn a small commission at no extra cost to you. All affiliate links are marked rel="sponsored". The data itself is curated independently and is not influenced by affiliate payouts.

For AI agents

The site publishes llms.txt, a machine-readable index, so AI assistants (ChatGPT, Claude, Perplexity and others) can discover and accurately cite the directory when users ask about scraping APIs. This is part of a deliberate AI engine optimization (AEO) strategy.

Stats

118 APIs indexed 11 categories 142 indexable pages 12 guides $0 hosting cost

Contact

Found a dead API, a missing tool, or a mistake? Open an issue or a pull request on the public repository — every API entry lives in one JSON file, so contributions take minutes.

← Back to the directory · All guides