Hi, I’m building a personal website and I don’t want it to be used to train AI. In my robots.txt file I blocked:
- ChatGPT-User
- GPTBot
- Google-Extended
- FacebookBot
What bots should I also add? Are there any other ways to block AI bots?
IMPORTANT: I don’t want to block search engine crawlers, only bots that are used to train AI.
You must log in or register to comment.
A place to discuss privacy and freedom in the digital world.
Privacy has become a very important issue in modern society, with companies and governments constantly abusing their power, more and more people are waking up to the importance of digital privacy.
In this community everyone is welcome to post links and discuss topics related to privacy.
Some Rules
- Posting a link to a website containing tracking isn’t great, if contents of the website are behind a paywall maybe copy them into the post
- Don’t promote proprietary software
- Try to keep things on topic
- If you have a question, please try searching for previous discussions, maybe it has already been answered
- Reposts are fine, but should have at least a couple of weeks in between so that the post can reach a new audience
- Be nice :)
Related communities
Chat rooms
-
[Matrix/Element]Dead
much thanks to @gary_host_laptop for the logo design :)
- 0 users online
- 57 users / day
- 383 users / week
- 1.5K users / month
- 5.7K users / 6 months
- 1 subscriber
- 3K Posts
- 75.4K Comments
- Modlog
I have a personal site.
It isn’t great. Don’t even have a domain name. My robots.txt is here
https://bbbhltz.codeberg.page/robots.txt
Why bother? I just don’t agree with AI.
Nice, thats what I am looking for!
I don’t remember what all of those are for so you might want to look them up.
I did, most of them are used for AI or business search engines. I copied everything except Yandex.
Specifically what about AI don’t you agree with?
I was about to ask the same question. It’s one thing to think of the potential impacts of AI technology, but to be “against AI” in the most general sense is, to me, a weird concept, especially considering AI is so many things.
Mostly the hype and because artists and creators are being hurt by its existence.
I feel as though using AI is a cop-out. If I want to do something good, I also want to be proud of it. So I would rather not take that away from myself by doing it with AI. However, progress marches on, and I am neither an expert nor an authority on the subject. Asking someone like myself that question is nearly a trap. If I tell you that Generative AI is a bubble, like cryptocurrency and the Metaverse, that is just my gut feeling.
How about a bubble like the internet? 90% of dotcoms failed in the 90s but the internet is alive and strong today. AI is just a tool, and from my experience an extremely useful one.
I get that argument. Perhaps the fact that I’m a professor influences my thinking. And, since we are in a privacy community, something like ChatGPT and privacy don’t mix.
Meredith Whittaker (Signal) says[1]:
(I do keep on eye on their progress because it is interesting https://benchmarks.llmonitor.com/)
https://time.com/collection/time100-ai/6309018/meredith-whittaker/ ↩︎
Agreed that privacy can be a concern. Ideally it will be possible to run LLMs locally in the near future, but we’ll see.