Close Menu
  • Home
  • Technology
  • Devices
  • Business
  • Science
  • Gadgets
  • Startups
Ayaksız
  • Home
  • Technology

    Lucid and Bolt Plan 25,000 Robotaxis for Europe

    Eylül 18, 2026

    AMD Gives PC Builders More Choice With New Ryzen 5 Desktop Chips

    Eylül 11, 2026

    Apple Expands Device Protection With a $49.99 Family Plan

    Eylül 11, 2026

    Snapdragon 8 Elite Extreme Gen 6 Reportedly Beats MediaTek’s Next Flagship Chipset

    Eylül 11, 2026

    Pinterest CFO Julia Donnelly to Step Down in October

    Ağustos 30, 2026
  • Devices

    Projector Setup: Separate Placement, Lens Shift, Zoom, and Keystone

    Kasım 18, 2026

    Router Mode or Access Point Mode? Give Each Network Device a Clear Job

    Kasım 18, 2026

    Scanner Feeder or Glass? Choose According to the Original

    Kasım 13, 2026

    Borderless Printing: Why the Edges of Your Photo Can Disappear

    Kasım 12, 2026

    Camera AE Lock: Recompose a Scene Without Letting Exposure Drift

    Kasım 11, 2026
  • Business

    Google Pixel 11 Pro Leaked Renders Indicate It Might Sport Thinner Bezels Than the Pixel 10 Pro

    Mart 30, 2026

    Motorola Edge 70 Debuts With Snapdragon 7 Gen 4, Ultra-Slim 5.99mm Body

    Kasım 5, 2025

    Samsung Galaxy S26 Series Could See Price Increase Amid Rising Component Costs: Report

    Kasım 4, 2025

    Amazon’s AWS Partners with NBA to Power New AI Basketball Platform

    Ekim 4, 2025

    Billionaire-Backed Bitcoin Firm OranjeBTC to List on Brazil’s B3 Exchange

    Ekim 4, 2025
  • Science

    Double Rainbows: Why the Outer Arc Reverses Its Colors

    Kasım 18, 2026

    Why Ice Floats—and Why Water Behaves Differently Near Freezing

    Kasım 13, 2026

    Air Pressure and Altitude: Why Two Weather Readings May Not Be Comparable

    Kasım 12, 2026

    A Light-Year Measures Distance: Understanding the Scale Behind Space Headlines

    Kasım 11, 2026

    Why the Sky Is Blue—and Why the Same Atmosphere Produces Red Sunsets

    Kasım 10, 2026
  • Gadgets

    Tripod Center Columns: Extra Height Comes with a Stability Tradeoff

    Kasım 18, 2026

    E Ink Ghosting: Match the Refresh Mode to the Task

    Kasım 13, 2026

    Camera Lens Hoods: Choose the Right Shape and Check the Whole Frame

    Kasım 12, 2026

    Pop Filters and Windscreens: Match Microphone Protection to the Noise

    Kasım 12, 2026

    USB Hub Power: Check Where Your Connected Devices Get Their Energy

    Kasım 11, 2026
  • Startups

    Cache-Control for Startups: No-Cache and No-Store Solve Different Problems

    Kasım 18, 2026

    Dead-Letter Queues: Investigate Before Replaying Failed Messages

    Kasım 13, 2026

    Database Connection Pools: Budget Across Every Application Replica

    Kasım 13, 2026

    Startup Staging Sites: Separate Search Visibility from Access Control

    Kasım 12, 2026

    API Idempotency Keys: Keep a Retry Connected to the Original Operation

    Kasım 11, 2026
Ayaksız
Anasayfa » Blog » Cloudflare Introduces Pay-Per-Crawl Tool to Help Websites Monetize AI Bot Access
Tech

Cloudflare Introduces Pay-Per-Crawl Tool to Help Websites Monetize AI Bot Access

By ayaksızTemmuz 12, 2025Yorum yapılmamış2 Mins Read
Facebook Twitter Pinterest LinkedIn Tumblr Email
Share
Facebook Twitter LinkedIn Pinterest Email

Cloudflare has unveiled a new tool designed to give website owners greater control over AI bot crawlers accessing their content, allowing them to block unauthorized scraping or set fees for access. The move aims to help publishers and content creators monetize the use of their material by artificial intelligence companies, which increasingly crawl websites to train AI models without sending traffic back or providing compensation.

The tool enables site owners to choose which AI crawlers can access their content and implement a “pay per crawl” pricing model, helping creators control how their work is used and ensure fair payment. This innovation comes amid declining referral traffic from search engines, which historically drove ad revenue to websites.

Major publishers like Condé Nast, the Associated Press, and social platforms including Reddit and Pinterest back the initiative. Cloudflare’s Chief Strategy Officer, Stephanie Cohen, explained that the tool is designed to establish a sustainable ecosystem for content creators and AI companies alike. She highlighted that rapid changes in traffic patterns demand new approaches, calling this tool “the beginning of a new model for the internet.”

Data from Cloudflare shows that Google’s ratio of crawls to visitor referrals has dropped from 6:1 to 18:1 in six months, suggesting users increasingly get answers directly from Google search results or AI features rather than visiting original sites. However, Google’s crawl-to-visit ratio remains far lower than AI firms like OpenAI, which have ratios around 1,500:1, reflecting heavy content scraping without referral traffic.

For decades, traditional search engines indexed web content and drove users to publishers, rewarding them for their work. But AI crawlers disrupt this model by harvesting data without sending visitors back, aggregating content in chatbots like ChatGPT, and reducing creators’ revenue and recognition.

Many AI companies bypass common publisher tools used to block scraping and argue their data collection is legal and fair use. This has led some publishers, including the New York Times, to sue AI firms for copyright infringement. Others have negotiated licensing agreements to protect their content and monetize usage.

Reddit, notably, has sued AI startup Anthropic for scraping user comments but also signed a licensing deal with Google, illustrating the complex responses from content owners seeking to protect their assets in the AI era.

AI bots AI training data Cloudflare content licensing content monetization Copyright digital rights online publishing pay-per-crawl web scraping
Share. Facebook Twitter Pinterest LinkedIn Tumblr Email
ayaksız
  • Website

Related Posts

Lucid and Bolt Plan 25,000 Robotaxis for Europe

Eylül 18, 2026

AMD Gives PC Builders More Choice With New Ryzen 5 Desktop Chips

Eylül 11, 2026

Apple Expands Device Protection With a $49.99 Family Plan

Eylül 11, 2026
Add A Comment

Comments are closed.

Recent Posts
  • Projector Setup: Separate Placement, Lens Shift, Zoom, and Keystone
  • Cache-Control for Startups: No-Cache and No-Store Solve Different Problems
  • Tripod Center Columns: Extra Height Comes with a Stability Tradeoff
  • Double Rainbows: Why the Outer Arc Reverses Its Colors
  • Router Mode or Access Point Mode? Give Each Network Device a Clear Job
Tags
AI AI Chips AI Infrastructure Amazon Android Apple Artificial Intelligence Bitcoin ChatGPT China Cryptocurrency Cybersecurity data centers DeepSeek Donald Trump Electric Vehicles Elon Musk Ether Generative AI Google Huawei India Investment Iphone Meta Microsoft NASA National Security Nvidia OnePlus OpenAI Oppo Realme Samsung semiconductor industry Social media Sony SpaceX Technology Tesla Tether TikTok Vivo WhatsApp Xiaomi
Ayaksız
Instagram
© 2026 Ayaksız.

Type above and press Enter to search. Press Esc to cancel.