hylobates@jlai.lu to Selfhosted@lemmy.worldEnglish · 7 days agoBased on this graph, and this graph alone, guess at what time I completely blocked OpenAI crawlersjlai.luimagemessage-square79linkfedilinkarrow-up1589arrow-down17file-text
arrow-up1582arrow-down1imageBased on this graph, and this graph alone, guess at what time I completely blocked OpenAI crawlersjlai.luhylobates@jlai.lu to Selfhosted@lemmy.worldEnglish · 7 days agomessage-square79linkfedilinkfile-text
minus-squarepoVoq@slrpnk.netlinkfedilinkEnglisharrow-up6arrow-down2·6 days agoThis is not how things work on the modern web. Did you just wake up from a 20 year coma?
minus-squareFreedomAdvocate@lemmy.net.aulinkfedilinkEnglisharrow-up1·edit-27 hours agoWhenever you’re browsing even a semi popular website these days there’s probably a 98% chance you’re hitting a cloudflare cached version of it. Have you been asleep the last 10 years?
minus-squarepoVoq@slrpnk.netlinkfedilinkEnglisharrow-up1·7 hours agoFor static sites, yes. To actually protect dynamic sites against AI crawlers, Cloudflare has to do much more than just caching. And besides that, Cloudflare is a huge single point of failure and highly privacy invasive.
This is not how things work on the modern web. Did you just wake up from a 20 year coma?
Whenever you’re browsing even a semi popular website these days there’s probably a 98% chance you’re hitting a cloudflare cached version of it. Have you been asleep the last 10 years?
For static sites, yes. To actually protect dynamic sites against AI crawlers, Cloudflare has to do much more than just caching.
And besides that, Cloudflare is a huge single point of failure and highly privacy invasive.