Cynicus Rex@lemmy.ml to Privacy@lemmy.mlEnglish · 1 month agoHow to block AI Crawler Bots using robots.txt filewww.cyberciti.bizexternal-linkmessage-square64fedilinkarrow-up1111arrow-down132
arrow-up179arrow-down1external-linkHow to block AI Crawler Bots using robots.txt filewww.cyberciti.bizCynicus Rex@lemmy.ml to Privacy@lemmy.mlEnglish · 1 month agomessage-square64fedilink
minus-squarespookedintownsville@lemmy.worldlinkfedilinkEnglisharrow-up2·27 days agoCan this be done without fail2ban?
minus-squarespookedintownsville@lemmy.worldlinkfedilinkEnglisharrow-up2·27 days agoHow did you do it? Looking to do this on my own site.
minus-squareɐɥO@lemmy.ohaa.xyzlinkfedilinkEnglisharrow-up3·26 days agoMy websites Backend is written in flask so it was pretty easy to add
minus-squareMangoPenguin@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up1·26 days agoShould be able to do it with Crowdsec
Can this be done without fail2ban?
probably. never used it tho
How did you do it? Looking to do this on my own site.
My websites Backend is written in flask so it was pretty easy to add
Should be able to do it with Crowdsec