hylobates@jlai.lu to Selfhosted@lemmy.worldEnglish · 22 days agoBased on this graph, and this graph alone, guess at what time I completely blocked OpenAI crawlersjlai.luexternal-linkmessage-square80fedilinkarrow-up1575arrow-down17file-text
arrow-up1568arrow-down1external-linkBased on this graph, and this graph alone, guess at what time I completely blocked OpenAI crawlersjlai.luhylobates@jlai.lu to Selfhosted@lemmy.worldEnglish · 22 days agomessage-square80fedilinkfile-text
minus-squaretomjuggler@lemmy.worldlinkfedilinkEnglisharrow-up7·20 days agoYes, CloudFlare blocks agents completely if they ignore it’s restrictions. The key is scale - CloudFlare has a birds eye view of traffic patterns across millions of sites and can do statistical analysis to determine who is a bot. I hate the necessity but it works
Yes, CloudFlare blocks agents completely if they ignore it’s restrictions. The key is scale - CloudFlare has a birds eye view of traffic patterns across millions of sites and can do statistical analysis to determine who is a bot.
I hate the necessity but it works