Reddit has just made a decisive move and it is one that will reshape how the platform’s history is preserved online.
Starting 12 August 2025, Reddit will block the Internet Archive’s Wayback Machine from indexing most of its content, citing concerns that AI companies have been scraping archived Reddit pages to train their models.
That is right, the Wayback Machine, a tool that has been quietly archiving billions of web pages for decades, will now only be able to see Reddit’s homepage.
No post detail pages, no comment threads and no user profiles. The rest of the Reddit universe? Off-limits.
This is about control over data, the fight against unauthorized AI training and the changing rules of what “public internet” really means.
Why Reddit Is Taking This Step Now
Reddit’s spokesperson Tim Rathschmidt explained the reasoning in a statement to The Verge:
“Internet Archive provides a service to the open web, but we’ve been made aware of instances where AI companies violate platform policies, including ours and scrape data from the Wayback Machine.”
The key here is policy violation.
Reddit is not saying that archiving in itself is bad.
In fact, the company acknowledges the Wayback Machine’s value as a historical resource.
But Reddit insists that until the Internet Archive can better defend its site from AI scrapers and ensure compliance with things like user privacy and the deletion of removed content the platform is limiting access “to protect redditors.”
What Changes Are Actually Happening?
The block is not a total shutdown, but it is close.
Before: The Wayback Machine could crawl Reddit’s post pages, comments and user profiles, meaning you could look back at discussions from years ago even if the original post was deleted.
After: It will only be able to index the Reddit.com homepage. Practically speaking, that means the Archive will only capture snapshots of trending posts and headlines from a given day but not the full conversations or individual user contributions behind them.
The new limits will “ramp up” starting today, and according to Rathschmidt, Reddit informed the Internet Archive in advance before they took effect.
This Isn’t Reddit’s First Data Access Crackdown
If this feels familiar, it is because Reddit has been tightening its control over data for a while and AI companies have been at the center of that story.
- 2023 API Protests: Reddit announced controversial API changes that priced many third-party app developers out, leading to mass subreddit blackouts in protest. Reddit’s defense? Too many were using its API to train AI models without permission.
- Google Deal: Early last year, Reddit struck a deal with Google, granting it access to Reddit data for both Search and AI training for a price.
- AI Partnerships and Lawsuits: Reddit later struck a similar deal with OpenAI, but in June 2025, it sued Anthropic, alleging that the company continued scraping Reddit even after promising to stop.
So when we look at this Wayback Machine block, it is part of a broader pay-to-play approach Reddit is adopting with data access. If companies want to use Reddit for AI, they are going to have to cut a check.
The Internet Archive’s Perspective
The Internet Archive has not responded with outrage, at least not publicly. Mark Graham, director of the Wayback Machine, told The Verge:
“We have a longstanding relationship with Reddit and continue to have ongoing discussions about this matter.”
It’s a diplomatic response, but I can not help wondering how much this changes the Archive’s mission.
The Internet Archive exists to preserve the open web but what happens when major sites like Reddit start redefining “open” to exclude anything AI companies could use?
The Bigger Picture: AI Scraping and Platform Control
This move highlights a growing trend: big platforms no longer see public web content as “free” for anyone to collect and repurpose.
In the past, crawling public web pages was the norm, search engines did it, archives did it, and researchers relied on it.
But AI training has changed the stakes. Training a large language model (LLM) requires massive datasets and platforms like Reddit are treasure troves of human conversation, opinions and cultural moments.
The problem? AI companies can scrape it once and use it forever without compensating the source.
From Reddit’s point of view, that is both a loss of control and a missed revenue opportunity.
Privacy and Authenticity Concerns
There is also the privacy angle.
When a post is deleted on Reddit, users often expect it to disappear completely. But the Wayback Machine’s snapshots can preserve it and sometimes indefinitely.
From Reddit’s perspective, limiting the Archive’s access helps enforce those expectations.
And from a user trust standpoint, that makes sense. Imagine venting about a personal crisis on Reddit, deleting it later and finding that the post still lives in the Archive years down the line and is now available for an AI model to study.
Examples of How This Could Impact the Web
- Researchers: Academics studying internet culture have long used Reddit’s archived pages to track trends and analyze public discourse. With this block, their historical datasets could shrink dramatically.
- Journalists: Reporters who use the Wayback Machine to verify deleted Reddit posts in breaking news situations will lose that tool for post-level verification.
- Casual Users: People who revisit old Reddit threads for nostalgia or reference will find fewer preserved discussions.
The irony?
AI companies with the resources to pay for direct Reddit access like Google and OpenAI will still be able to train on the data. The restriction primarily impacts free archival access, not corporate AI partnerships.
Could This Start a Chain Reaction?
It is worth asking that will other major platforms follow Reddit’s lead?
We have already seen X limit API access, LinkedIn sue data scrapers and news publishers start licensing deals with AI firms. If Reddit’s strategy works, charging AI companies while tightening free archival access, others might adopt the same model.
That could fundamentally change the nature of digital preservation. The Wayback Machine thrives on openness.
If site after site blocks it in the name of AI control, the historical record of the internet could become increasingly fragmented.
Where This Leaves Users and the Open Web
From a “let’s see” perspective, I think this is a defining moment.
On one hand, Reddit’s move makes sense to protect user privacy, stop unauthorized AI training, and control how data is monetized.
It chips away at the principle that the internet’s public spaces should be preserved for future generations.
The tension between platform control and open access is not going away.
And as AI companies push harder for more training data, these battles will likely become more common.
For now, the reality is simple: If you want to see an old Reddit post, you will need to hope it is still live on Reddit because the Wayback Machine probably won’t have it.
Dileep Thekkethil
AuthorDileep Thekkethil is the Director of Marketing at Stan Ventures, where he applies over 15 years of SEO and digital marketing expertise to drive growth and authority. A former journalist with six years of experience, he combines strategic storytelling with technical know-how to help brands navigate the shift toward AI-driven search and generative engines. Dileep is a strong advocate for Google’s EEAT standards, regularly sharing real-world use cases and scenarios to demystify complex marketing trends. He is an avid gardener of tropical fruits, a motor enthusiast, and a dedicated caretaker of his pair of cockatiels.