CCBot

by Common Crawl

About this crawler

Common Crawl crawler that builds open web crawl datasets.

Usually means: A crawler is collecting this page's public content, which may be used to train or improve AI models.

User agent

CCBot

Reignat matches these as user-agent tokens, not full browser strings. Providers may add surrounding version or product text.

IP verification

Verified when user agent and IP range both match

Reignat first matches the crawler user-agent token, then compares the request IP with published ranges from Common Crawl.

1

User agent

Request user agent contains CCBot.

2

Request IP

Server-side tracking forwards the crawler IP seen by your backend.

3

Range check

The IP is compared with published CIDR ranges from the JSON range endpoint.

Sample IP ranges

2600:1f28:365:8000::/563.41.188.32/2918.97.9.168/2918.97.14.80/2918.97.14.88/3098.85.178.216/32

Showing up to 10 ranges from the published official source.