Cloudflare will now prevent artificial intelligence crawls by default

The main internet engineering provider will now prevent the online crawl on the Internet to prevent them from “accessing content without permission or compensation,” according to Tuesday’s announcement. With the change, Cloudflare will start asking the owners of the new fields if they want to allow artificial intelligence sections, and some publishers will allow the implementation of “payment fees for each crawl”.

The payment program for each phase will allow the publishers to set a price for the artificial intelligence detector to reach their content. Artificial intelligence companies can then offer price and choose the registration for “payment for each crawl” fee or move away. This is only available for “a group of some of the main publishers and content creators at the present time, but Cloudflare says it will guarantee” artificial intelligence companies that can use quality content in the right way – with permission and compensation. “

Cloudflare helps domains fight AI Crawles for a while now. The company started to leave web sites Block crawling artificial intelligence In 2023, it only applies to the one you adhere to Robots.txt file for the siteThe implemented agreement that indicates whether it can get rid of robots from its content. Cloudflare started Allow websites to ban “AI BOTS” last year – whether they respect the Robots.txt file for the site or not – and now this setting is enabled virtual for new Cloudflare customers. (The company determines the disciplines to prohibit it by comparing it to the well -known Amnesty International robot list.) Which sends robots on the Internet In “Amnesty International’s maze” to deter them from the scraping of sites without permission.

Many major publishers and online platforms, including Associated Pressfor Atlantic Oceanfor luckOn the SCOCK Overflow, and Quora, on board with the new Cloudflare restrictions from AI, where web sites are compatible with a future where more people find information through Chatbots Amnesty International, instead of search engines. “People trust artificial intelligence more during the past six months, which means that they do not read the original content,” Matthew, CEO of Cloudflare. He said during the Axios Live event last week.

In addition, Cloudflare says it works with artificial intelligence companies to help check their crawl and allow them to “clearly mention”, such as whether to use training, inference or research content. Website owners can review this information and determine any crawl to allow entry.

“The original content is what makes the Internet one of the greatest inventions in the last century, and we must meet to protect it,” Prince said in the press statement. “Artificial intelligence crawls the content without limits. Our goal is to restore power in the hands of creators, while artificial intelligence companies still help innovation.”