← Back
Cloudflare
Cloudflare Radar adds content type dimension for AI bot traffic analysis
Cloudflare · featureapiplatform · developers.cloudflare.com ↗

New Content Type Dimension for AI Bots

Cloudflare Radar has introduced a new content_type dimension and filter that provides detailed insights into the types of content being accessed by AI bot and crawler traffic. This addition helps developers and site operators understand the composition of requests from AI crawlers across their infrastructure.

API Endpoints and Data Access

The feature is available through two new API endpoints:

  • /ai/bots/summary/content_type - Returns aggregated content type distribution for AI bot traffic
  • /ai/bots/timeseries_groups/content_type - Provides time-series data grouped by content type

These endpoints allow developers to programmatically retrieve detailed analytics about what content types AI crawlers are consuming, enabling more granular traffic analysis and optimization.

Content Type Categories

The data is organized into 16 distinct content type categories, including:

  • Web content: HTML, Images, JavaScript, CSS, Fonts
  • Data formats: JSON, XML, YAML, Plain Text, Markdown
  • Media: Video, Audio
  • Documents: PDFs, Office documents, ePub, CSV
  • Technical formats: Binary executables, archives, WebAssembly, Protobuf, gRPC, MessagePack
  • Other: Catch-all for remaining content types

Dashboard Integration

Beyond the API, individual bot information pages in the Cloudflare Radar interface now display content type distribution charts for verified AI crawlers. The AI Insights page includes a dedicated section to explore this data, making it easy for users to understand crawler behavior without API calls.