No Robots(.txt): How to Ask ChatGPT and Google Bard to Not Use Your Website for Training

The Electronic Frontier Foundation (EFF) has you covered if you’d like to opt out of being indexed into tools like Open AI’s ChatGPT and Google’s Gemini. Just add these to your robots.txt file:

User-agent: GPTBot
Disallow: /

User-agent: Google-Extended
Disallow: /

Building on this, you could exclude specific directories (e.g., where you keep your images):

User-agent: GPTBot
Disallow: /i/

User-agent: Google-Extended
Disallow: /i/

I’ve decided to (for now at least) allow my text content to be indexed, but I may change my mind in the future.