Cloudflare Introduces Continuous Accountability for Verified Bots
Cloudflare has launched an internal system to continuously evaluate how Verified bots honor site preferences like robots.txt and HTTP 429 responses, moving beyond identity verification to sustained trust. The system will inform trust bands that site owners can eventually use to manage bot traffic more transparently and safely.
What changed?
Cloudflare has introduced a system to evaluate and report when Verified bots deviate from responsible behavior as defined by website preferences (such as robots.txt and responses like HTTP 429). This system translates observations of bot compliance into an explainable trust band, showing how consistently a bot respects site preferences over time and the factors contributing to its trust level. Initially deployed internally, Cloudflare plans to make this evaluation available to all Cloudflare customers, and publicly share trust scores on its Radar platform.
Why does it matter to an everyday developer?
Previously, Verified bots were authenticated by their identity, but this did not ensure ongoing compliance with site rules or responsible operation. Bots could still ignore preferences or misbehave due to bugs or misconfiguration. The new system evaluates bots over time, helping developers understand whether automated traffic is following their published rules. This provides ongoing transparency and allows developers to make more informed decisions about which bots to trust and what traffic to allow, bolstering site integrity and performance.
What can the developer do now?
At present, Cloudflare customers can continue to use Bot Management and Bot Preference Sync to declare and manage site preferences. While the continuous accountability system is not yet available for direct customer use, developers should monitor Cloudflare’s future releases for the availability of trust metrics and controls. This will enable them to use trust thresholds to determine how Verified bot traffic is handled, further aligning bot access with site policy. Developers can also review trends and bot populations on Cloudflare Radar for broader insights.
