Contact Us About Us
Log In
7 min read

Google Pressured Publishers to Let AI Use Their Content or Risk Losing Visibility

View as Markdown

What happens when the world’s biggest search engine quietly redraws the rules of the internet and tells publishers they can either play along or vanish? That’s the reality exposed in court documents from the ongoing U.S. antitrust trial against Google.Β 

Google Pressured Publishers to Let AI Use Their Content or Risk Losing Visibility

The documents show that Google could have allowed news outlets to block its AI systems from using their content without affecting their visibility in search, but deliberately chose not to.

Instead, Google locked visibility to participation. If publishers wanted to appear in search results, they had to allow their content to be absorbed by Google’s artificial intelligence tools.Β 

If they didn’t, they risked becoming invisible to billions of users who rely on Google to find information.

Behind closed doors, Google called it a “hard red line.” In other words, non-negotiable.

Β 

The Decision Google Didn’t Want Public

The internal presentation was prepared by Chetna Bindra, a senior director of product management at Google, in April 2023.Β 

It outlined several approaches the company could take as it prepared to roll out AI Overviews, its AI-generated summaries on search result pages.

Among the options was a simple solution to let publishers opt out of AI use while still appearing in Google Search. That would mean a publisher’s content could remain visible to readers without being scraped to train or inform Google’s generative AI models.Β 

But this option was dismissed inside the company. It would set a precedent Google wasn’t willing to risk, especially in what it viewed as a major new revenue channel.

Instead, the company moved forward with a set of changes that tied standard web indexing to AI. Publishers could still block their content from being used if they were willing to remove themselves from search entirely.

A Choice That Isn’t One

Google suggested that publishers who didn’t want their material to appear in AI Overviews could use technical tools like the NOSNIPPET tag to reduce visibility. But these tools were meant to stop Google from displaying excerpts in regular search results. And they certainly didn’t stop Google’s systems from reading and learning from the content behind the scenes.

Opting out of AI completely would require blocking Googlebot, the crawler that indexes sites for all of Search. Doing that effectively erases a website from the internet’s largest discovery engine.

As Matt Rogerson of the Financial Times put it, publishers were handed an β€œunenviable choice”: either give Google permission to use their content to power AI features that generate no revenue for them, or become invisible to over 90% of UK users who rely on Google to access news and information.

The documents revealed that Google had run experiments with limiting snippets back in 2019. Even minor restrictions on how content appeared in search led to steep drops in traffic, up to 45% in some cases. Users simply went elsewhere.

Google knew the risks. And it knew publishers couldn’t afford them.

AI Was Always Part of the Plan

As legal scrutiny deepens, Google has tried to frame its AI integration as an extension of Search itself. During the remedies phase of the antitrust trial, a Justice Department lawyer questioned a senior Google AI executive about this very issue.

Eli Collins, a vice president at Google DeepMind, confirmed that even when publishers opt out of training Google’s AI models like Gemini, their content can still be used by AI Overviews as long as it comes through Search.

That one answer confirmed everything publishers feared. Opting out doesn’t actually mean opting out. If your site is indexed in Google Search, then it’s fair game for AI features. This blur between search indexing and AI ingestion wasn’t accidental. It’s how the system was built.

And Google had no intention of explaining the details publicly. The internal slide deck made it clear: roll out the changes with β€œno public announcement.”

Why Google’s Move Matters

Google controls the gateway to information. When it decides how that gateway works, publishers are left with almost no negotiating room. And now, as AI becomes central to how Google delivers information, the rules are being rewritten again, without a real chance for publishers to say no.

It’s not hard to see why this worries regulators.

In August, a U.S. judge ruled that Google’s dominance in search violates antitrust laws. The current phase of the trial focuses on what to do about it.Β 

One remedy under consideration is forcing Google to divest the Chrome browser or separate its search business from other arms of the company. Meanwhile, the UK’s Competition and Markets Authority has launched its own investigation into Google’s practices.

At the center of it all is the big question: Can a company that controls how people access the web also dictate how that information gets reused and monetized, without the original creators having any say?

What Publishers Can Still Control

Even in this tilted environment, there are a few levers publishers can still pull:

  • Use NOSNIPPET and DATA-NOSNIPPET: These limit what content Google can show in both AI Overviews and traditional snippets. Not a perfect solution, but one of the few available.
  • Block Google-Extended: This stops Gemini and Vertex from scraping your content, though it won’t stop AI Overviews tied to search.
  • Watch your server logs: Monitor how and when Google’s bots access your content. Transparency is the first step toward control.
  • Push for licensing deals: Join collective efforts to negotiate compensation frameworks with tech platforms for the use of journalistic content.
  • Support regulatory reform: Stay engaged with global antitrust and media policy discussions. The louder publishers are now, the better chance they have of influencing what comes next.

The Future of Visibility

This fight is about more than fair use. It’s about whether news organizations and original content creators have a place in an internet increasingly dominated by AI summaries and algorithmic shortcuts.

If users never click through to an article (because an AI tells them everything they need to know at the top of the page) then traffic collapses, advertising revenue dries up, and the financial model for journalism erodes even further.

To stay relevant, publishers need to be on Google. But to stay sustainable, they need to keep Google from using their content without consent or compensation.

Right now, they can’t have both.

Key Takeaways

  • Google could have let publishers stay in search without being used for AI. It chose not to.
  • Blocking Googlebot removes your site from all search visibility, not just AI features.
  • Google knew traffic to news sites would plummet if they restricted content in search.
  • Even when publishers opt out of AI training, Google still uses their content in AI Overviews.
  • Regulators in the U.S. and the UK are now investigating how Google uses its market power.
Zulekha

Zulekha

Author

Zulekha is an emerging leader in the content marketing industry from India. She began her career in 2019 as a freelancer and, with over five years of experience, has made a significant impact in content writing. Recognized for her innovative approaches, deep knowledge of SEO, and exceptional storytelling skills, she continues to set new standards in the field. Her keen interest in news and current events, which started during an internship with The New Indian Express, further enriches her content. As an author and continuous learner, she has transformed numerous websites and digital marketing companies with customized content writing and marketing strategies.

Keep Reading

Related Articles

Link Building Vendor Scorecard
Built from auditing 40+ vendors
⏸️

Wait. You're This Close to Your Score.

You've answered several out of 20 questions. Just a few more and you'll see your full vendor scorecard.

If you leave now, you won't see how your vendor stacks up against industry standards, where your biggest risk gaps are, or what your peers are doing differently. Finish the last few questions to unlock your complete report.