hylobates@jlai.lu to Selfhosted@lemmy.worldEnglish · 1 day agoBased on this graph, and this graph alone, guess at what time I completely blocked OpenAI crawlersjlai.luimagemessage-square61fedilinkarrow-up1494arrow-down16file-text
arrow-up1488arrow-down1imageBased on this graph, and this graph alone, guess at what time I completely blocked OpenAI crawlersjlai.luhylobates@jlai.lu to Selfhosted@lemmy.worldEnglish · 1 day agomessage-square61fedilinkfile-text
minus-squarezr0@lemmy.dbzer0.comlinkfedilinkEnglisharrow-up1·2 hours agoThat’s very interesting, as if only certain types of content get crawled. May I know what kind of software you used and if you had a reverse proxy in front of it?
That’s very interesting, as if only certain types of content get crawled. May I know what kind of software you used and if you had a reverse proxy in front of it?