#news
4 guides
Scrape BBC News Topic Pages and Headlines with Python
Build a BBC News topic-page scraper that collects headlines, article URLs, relative timestamps, and topic metadata from real topic hubs.
Scrape News Headlines from Google News
Collect headline text, sources, timestamps, and links from Google News topic feeds with Python, XML parsing, and a ProxiesAPI-ready fetch layer.
Scrape BBC News Headlines and Article URLs with Python (Sections + Deduping)
Scrape BBC News section pages to collect headlines and article URLs with Python + BeautifulSoup. Includes a simple dedupe store (JSON), multiple sections, and a ProxiesAPI fetch wrapper for stability.
Scrape BBC News Headlines & Article URLs (Python + ProxiesAPI)
Fetch BBC News pages via ProxiesAPI, extract headline text + canonical URLs + section labels, and export to JSONL. Includes selector rationale and a screenshot.