ppc.land

Cloudflare Launches Bot Preference Sync to Align robots.txt with AI Policies

Cloudflare logoCloudflare
Sig2.60Sen+2.20Env0.00Soc+1.80Gov+3.40

Cloudflare published Bot Preference Sync on August 21, 2026, a feature that rewrites a site’s robots.txt to match AI crawler training policies set in its dashboard. It also adds disclosure conditions and relies on an enforcement layer (firewall rules, bot management and edge blocks) so crawler access can be permitted or blocked regardless of what robots.txt claims to honor.

Coverage (1)

ABOUT

What is Fimmer?

Most feeds treat all company headlines the same. An executive interview, an office closure, stock analysis, and a data breach can sit side by side with no sense of scale. Fimmer ranks coverage by what matters, so important events stand out and signals are prioritised over noise. We cluster related company news and score each story using a range of metrics, so you see the most crucial stories first.

SCORING

What do the scores mean?

Significance (0–10) measures the scale of the real-world impact. Sentiment and ESG (−10 to +10) indicate the tone of the coverage and whether the change relates to environmental, social, or governance factors. Together, these scores help distinguish meaningful developments from routine company news. More information about our scoring methodology can be found on our About page.

DISCOVERY

Explore more on Fimmer

Search more than 10,000 public companies, browse the company index, explore their scores, and read the coverage behind them, with our core features available to everyone for free.

For more advanced features, Pro gives you access to dynamic feeds, custom sorting, and more ways to track the companies that matter to you.

More with Pro