tutorial
9 guides
How to Scrape the Python Docs Module Index with Python
Build a searchable dataset from the Python docs module index using Python and BeautifulSoup.
How to Scrape MDN Docs Pages with Python
Extract headings and table-of-contents structure from MDN docs pages with Python and BeautifulSoup.
How to Scrape PyPI Project Pages with Python
Fetch PyPI project pages and extract package metadata like version, description, and classifiers with Python and BeautifulSoup.
How to Scrape npm Package Pages with Python
Scrape npm package pages to extract version, description, and package metadata with Python and BeautifulSoup.
How to Scrape GitHub Trending with Python (and Export to CSV/JSON)
A practical GitHub Trending scraper: fetch the Trending page, extract repo names + language + stars, and export a clean dataset.
How to Scrape GitHub Releases with Python (Versions + Notes + Diffs)
Scrape a GitHub Releases page, extract versions and release notes, and store structured data so you can alert on changes.
Scrape a WordPress Site via sitemap_index.xml (Python): Crawl, Extract, Dedupe, Export
A production-grade, sitemap-first WordPress scraper in Python (no guessed selectors): crawl sitemaps, fetch posts, extract clean text + metadata, and export to CSV/JSON.
Scrape Stack Overflow Questions by Tag with Python (No API): Titles, Votes, Answers
A practical Stack Overflow scraper that collects questions from a tag page (e.g. web-scraping), follows pagination, extracts key fields, and exports to CSV/JSON.
How to Scrape Hacker News (HN) with Python: Stories + Pagination + Comments
A production-grade Hacker News scraper: parse the real HTML, crawl multiple pages, extract stories and comment threads, and export clean JSON. Includes terminal-style runs and selector rationale.