Because of the recent pushback against AI bots, I’ve added a help page to Micro.blog with details about how to block crawling of your blog.
Chris Grayson thanks for this! answers something I’ve been wondering about but hadn’t gotten around to asking yet
Elliot Clowes Thanks Manton. I was literally thinking an hour ago that I really should look into stopping AI bots on my blog. 👍
Pablo Sanchez Bosch that’s great, thank you! Do you know if it’ll be enough to stop perplexity.ai? According to MacStories and Wired, it seems Perplexity uses sneaky tactics to evade the usual server-side rules against robots.
Manton Reece @iPabloSB My understanding on Perplexity is that it will be enough to stop the model training, but not for the web page requests that Perplexity does on demand to get info. I’m expecting Perplexity to update this since there has been so much negative press about it.