← Back
Cloudflare
Cloudflare Radar adds content type insights for AI bot traffic via new API dimension
Cloudflare · featureapiplatform · developers.cloudflare.com ↗

New Content Type Dimension for AI Bot Traffic

Cloudflare Radar now provides detailed insights into what types of content AI bots and crawlers are accessing across your properties. A new content_type dimension allows developers and security teams to understand the distribution of content served to AI crawlers, grouped by 16 MIME type categories.

API Endpoints and Availability

The feature is accessible through two new endpoints:

  • /ai/bots/summary/content_type - Get aggregated content type summaries
  • /ai/bots/timeseries_groups/content_type - Track content type distribution over time

Beyond the API, individual bot information pages in the Radar dashboard now display content type distribution charts, enabling at-a-glance analysis of crawler behavior for both Verified Bots and AI Bots datasets.

Content Type Categories

The dimension groups traffic into 16 categories including HTML, images, JSON, JavaScript, CSS, plain text, fonts, XML, YAML, video, audio, markdown, documents (PDF/Office), binary files (archives/executables), serialization formats (protobuf/gRPC), and a catch-all "Other" category. This granular classification helps identify what content types AI crawlers prioritize.

Getting Started

Explore the data via the AI Insights page in Cloudflare Radar or integrate the new API endpoints into your analytics workflows.