If you’re not registered as a verified bot, there’s a good chance some Cloudflare sites may block you. I've experienced this firsthand with a friend's popular site, where Kagi search was randomly blocked. I noticed this because the universal summarizer and the favicon/icon didn’t work for that site within Kagi search.
Benefits of Registering as a Cloudflare Verified Bot
- Improved Access: Being a verified bot ensures you are less likely to be blocked by sites using Cloudflare, improving your access and functionality.
- Enhanced Performance: Registration can lead to better performance and fewer interruptions, ensuring smoother operation of your services.
- Credibility and Trust: Verification signals to website owners that your bot is legitimate, increasing trust and reducing the likelihood of being flagged or blocked.
- Better User Experience: For services relying on bots, such as summarisers or data fetchers, verification can enhance the user experience by ensuring consistent functionality.
Current list of verified bots:
https://radar.cloudflare.com/traffic/verified-bots
Please note that you can also request your bot to be added via the url above.
