Amoxtli@thelemmy.club to Technology@lemmy.zipEnglish · 2 days agoCloudflare Has Blocked 416 Billion AI Bot Requests Since July 1www.wired.comexternal-linkmessage-square2linkfedilinkarrow-up150arrow-down13
arrow-up147arrow-down1external-linkCloudflare Has Blocked 416 Billion AI Bot Requests Since July 1www.wired.comAmoxtli@thelemmy.club to Technology@lemmy.zipEnglish · 2 days agomessage-square2linkfedilink
minus-squareArcanine@piefed.chrisco.melinkfedilinkEnglisharrow-up3·edit-21 day agoI had to set up fail2ban + bot detection just to block the suckers. Its mostly amazon and openai for me and my small sites. Google/bing look at robots.txt and respect it. Openai in particular slams any site to the ground quick…
I had to set up fail2ban + bot detection just to block the suckers. Its mostly amazon and openai for me and my small sites. Google/bing look at robots.txt and respect it. Openai in particular slams any site to the ground quick…