Question 1

What websites can I scrape with this tool?

Accepted Answer

You can scrape data from 10+ sources including Reddit threads, Hacker News discussions, GitHub issues and pull requests, Stack Overflow questions and answers, Wikipedia articles, Medium blog posts, Substack newsletters, YouTube videos, XML sitemaps, and general web pages.

Question 2

Is this web scraper free to use?

Accepted Answer

Yes, this web scraper is completely free with no signup required. You can extract data from multiple sources and export to JSON, CSV, Markdown, or PDF formats at no cost.

Question 3

What export formats are supported?

Accepted Answer

The web scraper supports four export formats: JSON for developers and APIs, CSV for spreadsheets and data analysis, Markdown for documentation, and PDF for reading and sharing. All formats preserve the extracted data including comments and metadata.

Question 4

Can I extract comments and replies?

Accepted Answer

Yes, the web scraper can extract comment threads and nested replies from Reddit, Hacker News, GitHub issues, and Stack Overflow. You can configure the comment depth to control how many levels of replies to include.

Question 5

Do I need API keys or authentication?

Accepted Answer

No authentication is required for most sources. The tool works without API keys for Reddit, Hacker News, Wikipedia, and general web scraping. GitHub and Stack Overflow have rate limits without authentication but still work for reasonable usage.

Web Scraper

Supported Data Sources

Reddit

Hacker News

GitHub

Stack Overflow

Wikipedia

Medium

Substack

YouTube

General Web