Bitcoin reached a new all-time high of $118,900 on Friday, surpassing its previous record of $113,822 set on Thursday. As Read more
Selling software to companies can be a daunting task, especially when it comes to meeting security requirements. Chas Ballew, founder Read more
Earlier this week, San Diego startup Gallant announced $18 million in funding to bring the first FDA-approved ready-to-use stem cell Read more
The world’s richest man buys out one of the most popular social media platforms and uses it as a propaganda Read more
Cloudflare, a major player in cloud infrastructure serving 20% of the web, has unveiled a new marketplace that aims to redefine the relationship between website owners and AI companies. This marketplace is designed to provide publishers with more control over their content, a move that could potentially reshape the digital landscape.
A New Era of Collaboration
Over the past year, Cloudflare has introduced tools to help publishers manage the influx of AI crawlers, offering solutions to block these bots with a single click and providing insights into their activities on websites. In a recent interview, Cloudflare CEO Matthew Prince hinted at a new marketplace where publishers can share their content with AI companies and receive compensation for it.
Introducing Pay per Crawl
This innovative marketplace, known as Pay per Crawl, is being launched as an “experiment” in private beta. Website owners participating in the trial can choose to allow AI crawlers to access their site for a fee per crawl, opt for free access, or block them entirely. Cloudflare’s tools enable website owners to monitor how crawlers are utilizing their content, whether for AI training data, search responses, or other purposes.
A Potential Business Model for Publishers
Cloudflare’s marketplace holds the promise of offering publishers a sustainable business model in the age of AI. By providing a platform where publishers can set their own prices and terms, Cloudflare aims to empower content creators and ensure fair compensation for their work. As traditional revenue streams for online publishers face challenges, this marketplace could pave the way for a new era of collaboration between publishers and AI companies.
Cloudflare’s Vision for the Future of Online Content
Cloudflare spokesperson Ripley Park informed TechCrunch that there are currently no stablecoins or cryptocurrency involved in Pay per Crawl. Despite suggestions that digital currency would be a perfect fit for such a system, it is not part of the current setup.
During a recent appearance on the TBPN show, Cloudflare CEO Prince mentioned that the company is exploring the possibility of creating its own stablecoin for transactions within the marketplace. They are also considering collaboration with other stablecoin providers.
Cloudflare’s marketplace represents a bold vision for the future, but it hinges on widespread participation from publishers and AI companies. The challenge lies in ensuring that publishers receive fair compensation, especially when AI firms are accustomed to scraping content for free. Nevertheless, Cloudflare appears to be one of the few companies capable of bringing this innovative marketplace to life.
(Update: This article has been revised to include comments from the Cloudflare CEO regarding stablecoins and to provide accurate information on OpenAI’s crawl-to-referral ratio in June, as reported by Cloudflare).
