Da Bald Eagul@feddit.nltoPrivacy@lemmy.ml•How to block AI Crawler Bots using robots.txt file
37·
1 month agoThat is what they meant, yes. The title promises a block, completely preventing crawlers from accessing the site. That is not what is delivered.
Maybe Google Docs style online collaboration in a document? So if you limit access to certain folks only, they don’t necessarily have to be on the same instance as you.