Search
Search engines and search APIs for agents, and the crawlers and site rules that decide what they can reach.
-
Cloudflare Web Search API: pricing, providers and when to use it
News / Search
Cloudflare's new endpoint sells Ceramic, Exa and Linkup searches at list price. What differs is the account, the logs and a 5% fee on credits.
· 5 min read
-
Which AI crawlers should your site allow for agent search?
Explainer / Search
Choose AI crawler rules by purpose: keep agent search open, decide on training, and understand what robots.txt can control across four vendors.
· 5 min read
