Companies that develop and generative always make it a point to say that they include links to websites in the answers that their Chatbots generates for users. But Cloudflare’s CEO, Matthew Prince Axios that search traffic references continue to fall. Publishers face an existential threat, he said, because people do not click through these chat links and are increasingly based on AI summaries without excavating deeper.
The prince said Axios Ten years ago, Google sent a publisher a visitor for every two pages that had been dragged. Six months ago, the proportion was a visitor for every six pages, and now it is one for every 18. Openai sent a visitor to a publisher for every 250 pages that was dragged on six months ago, while Anthropic sent a visitor for every 6,000 pages. These days, Openai sends a visitor to a publisher per 1,500 pages, while Anthropic sends a visitor for every 60,000 pages.
People have come to trust the Chatbots more in recent months. The problem for publishers is that they do not earn advertising if people do not click on links to their websites, which is why Prince encourages them to take action to ensure that they are quite compensated. Prince said that Cloudflare is currently working on a tool to block bots that scratch content for large language models, even if a web page already has a “no trace” instruction. If you remember, several points of sale had reported by 2024 that the AI companies have been Ignoring the robot exclusion protocol from websiteso Robots.txt, files and take their content anyway to form their technologies.
Cloudflare has been looking for ways to block scrapers Since last year. But it was only in March when Cloudflare officially introduced Ai labyrinthIt uses Ai content to “ slow down, confuse and waste the resources of AI tracers and other boats that do not respect “ crawl ” guidelines. It works by linking an unauthorized trawler a series of pages generated by AI that are convincing enough, but they really do not have the contents of the site the tool that protects. In this way, the tracker ends up losing time and resources.
“I go to war every day with the Chinese government, the Russian government, the Iranians, the North -Coreans, probably the North -Americans, the Israeli, all who are trying to hack in our clients,” Prince said. “And you are telling me, can’t I stop a little Nerd with a corporation C a Palo Alto?”
