Reddit will block the Internet Archive
Reddit is blocking the Wayback Machine from crawling post detail pages, comments, and profiles, citing AI companies that scraped its data via the archive in violation of platform policies. Starting today, only the Reddit homepage will be archived. Reddit says it informed the Internet Archive in advance and will lift restrictions if IA enforces privacy and content-deletion rules. This move follows recent API changes and paid data deals with Google and OpenAI, plus a lawsuit against Anthropic for excessive bot access.