
blog.cloudflare.com/ai-search-crawl-refer-ratio-on-radar
Preview meta tags from the blog.cloudflare.com website.
Linked Hostnames
23- 58 links toblog.cloudflare.com
- 47 links towww.cloudflare.com
- 8 links toradar.cloudflare.com
- 6 links todevelopers.cloudflare.com
- 4 links tox.com
- 2 links todeveloper.mozilla.org
- 1 link tocloudflare.net
- 1 link tocloudflare.tv
Thumbnail

Search Engine Appearance
The crawl before the fall… of referrals: understanding AI’s impact on content providers
Cloudflare Radar now shows how often a given AI model sends traffic to a site relative to how often it crawls that site. This information can help site owners make decisions about which AI bots to allow or block, and enables users to understand how AI usage in aggregate impacts Internet traffic.
Bing
The crawl before the fall… of referrals: understanding AI’s impact on content providers
Cloudflare Radar now shows how often a given AI model sends traffic to a site relative to how often it crawls that site. This information can help site owners make decisions about which AI bots to allow or block, and enables users to understand how AI usage in aggregate impacts Internet traffic.
DuckDuckGo

The crawl before the fall… of referrals: understanding AI’s impact on content providers
Cloudflare Radar now shows how often a given AI model sends traffic to a site relative to how often it crawls that site. This information can help site owners make decisions about which AI bots to allow or block, and enables users to understand how AI usage in aggregate impacts Internet traffic.
General Meta Tags
22- titleThe crawl before the fall… of referrals: understanding AI’s impact on content providers
- HandheldFriendlyTrue
- viewportwidth=device-width,minimum-scale=1,initial-scale=1
- X-UA-CompatibleIE=edge
- baidu-site-verificationKeThzeyMOr
Open Graph Meta Tags
8- og:site_nameThe Cloudflare Blog
- og:typearticle
- og:titleThe crawl before the fall… of referrals: understanding AI’s impact on content providers
- og:descriptionCloudflare Radar now shows how often a given AI model sends traffic to a site relative to how often it crawls that site. This information can help site owners make decisions about which AI bots to allow or block, and enables users to understand how AI usage in aggregate impacts Internet traffic.
- og:urlhttps://blog.cloudflare.com/ai-search-crawl-refer-ratio-on-radar/
Twitter Meta Tags
11- twitter:titleThe crawl before the fall… of referrals: understanding AI’s impact on content providers
- twitter:descriptionCloudflare Radar now shows how often a given AI model sends traffic to a site relative to how often it crawls that site. This information can help site owners make decisions about which AI bots to allow or block, and enables users to understand how AI usage in aggregate impacts Internet traffic.
- twitter:urlhttps://blog.cloudflare.com/ai-search-crawl-refer-ratio-on-radar/
- twitter:cardsummary_large_image
- twitter:label1Written by
Link Tags
9- apple-touch-icon/images/favicon-32x32.png
- canonicalhttps://blog.cloudflare.com/ai-search-crawl-refer-ratio-on-radar/
- icon/images/favicon-32x32.png
- icon/images/favicon-32x32.png
- mask-icon/images/favicon-32x32.png
Website Locales
9de-de
https://blog.cloudflare.com/de-de/ai-search-crawl-refer-ratio-on-radar/en-us
https://blog.cloudflare.com/ai-search-crawl-refer-ratio-on-radar/es-es
https://blog.cloudflare.com/es-es/ai-search-crawl-refer-ratio-on-radar/fr-fr
https://blog.cloudflare.com/fr-fr/ai-search-crawl-refer-ratio-on-radar/ja-jp
https://blog.cloudflare.com/ja-jp/ai-search-crawl-refer-ratio-on-radar/
Links
142- https://blog.cloudflare.com
- https://blog.cloudflare.com/an-ai-index-for-all-our-customers
- https://blog.cloudflare.com/author/anni
- https://blog.cloudflare.com/author/bryton
- https://blog.cloudflare.com/author/celso