AI Crawl Control Analytics Enhancements

Cloudflare has released several improvements to the AI Crawl Control analytics dashboard to provide better visibility into AI crawler activity and its impact on your infrastructure.

Path Pattern Grouping

The Metrics tab now includes a Patterns view that automatically groups requests by URI patterns (e.g., /blog/*, /api/v1/*, /docs/*). This aggregated view helps you quickly identify which site areas are being targeted most heavily by AI crawlers without needing to parse individual URLs.

Enhanced Referral Analytics

• Destination patterns now show which site areas receive AI-driven referral traffic
• A new Referrals over time chart in the Metrics tab displays trends broken down by operator or source, allowing you to track traffic patterns over time

Data Transfer Visibility

Two new metrics help you understand bandwidth impact:

• Toggle Bytes in the Allowed requests over time chart to visualize bandwidth consumption alongside request volume
• A new Bytes Transferred column in the Crawlers tab shows per-crawler bandwidth usage

Image Exports

You can now export charts and tables as images, simplifying the creation of reports and presentations for stakeholders.

For detailed guidance on using these features, refer to the analyzing AI traffic documentation.