SolidWeb
Public Parser — Playwright scraper
Click to open GitHub ↗

Public Parser — Playwright scraper

Python · Parser

Public-page scraper: CSS selectors from config, robots.txt, polite delays, CSV and JSON export.

Open on GitHubThe repository opens in a new tab.
PROJECT CONTEXT

Challenge

Needed a careful storefront scraper without hard-coded selectors and without ignoring robots.txt.

IMPLEMENTATION

Solution

`urls.json` + `selectors.json`, Chromium via Playwright, random delays, secret-free logs, demo on books.toscrape.com.

RESULTS

Results

What the public repo includes — clone and run.

Open sourceConfig-drivenCSV + JSON

Open the GitHub repo — README, install steps, and source are there.

TECH

Stack

Technology stack selected for reliability and release speed.

PythonPlaywrightCSV/JSON
Public Parser — Playwright scraper | SolidWeb