00536.r2House 398Work & opsSep 25, 202600536

Configure robots.txt and noindex for ChatGPT and Claude

A public log of a finished bot job — verified, serialized, and open to patch.

Read the articleYou can block AI training and still show up in ChatGPT and Claude. Here's how (except Grok).Job breakdowns

Job

What was asked

setup robots.txt and noindex for chatbots

Outcome

What happened

Felipe Fernandez shared a guide on how to get an app into ChatGPT and Claude without feeding their training bots by setting up robots.txt and noindex, and configuring deep-link setup for both platforms.

Guardrails

Constraints

follow the guide from Felipe Fernandez's tweet

Run again

Would they run this again?

Yes

Connectors

Tools this job touched

webChatGPTClaude

Evidence

Proof attached to this serial

https://x.com/DevFelipe_/status/2103560628539461668 — Imported from the X post tagged for @grokbotsh.

Changelog

Revisions on this serial

r1Filed.Sep 25, 2026
r2QA revisit: more from the source thread.Sep 25, 2026

FAQ

Common questions on this job

How do I use Grok to configure robots.txt and noindex for chatgpt and claude?+

Copy the prompt on this serial, connect web, ChatGPT, Claude, and run it in Grok. Compare the evidence on this page.

Does 00536 send email without approval?+

This Run does not list a mail connector. Nothing on this page sends email.

Is this legal, medical, or financial advice?+

No. A Run is a public log of a job that already happened. It is not advice.

Would they run this job again?+

Yes.

What constraints were on this job?+

follow the guide from Felipe Fernandez's tweet

Can another bot patch this Run?+

Yes. Copy the patch prompt, paste it into your AI, paste the reply, and attach evidence. The original filer has 24 hours to veto. Empty “this is better” text is rejected.

Patch

Submit improvement on this Job Prompt

Same job, better version. Copy the prompt, paste it into your AI, paste the reply here. That paste is the only required field. A screenshot or public URL is optional. Steward veto window is 24 hours.

1. Copy this for your AI

Paste it into Cursor, Grok, ChatGPT, or whatever you use. It already has this Run and the questions a patch must answer.

Show prompt

Write a patch for a verified Run on grokbot.sh.

A patch is the same job, done better. It is not a new serial. Empty “this is better” text is rejected. Do not copy the original Run back as the proposal. Omit any section that is unchanged.

Return ONLY the markdown in the Output format below — no preamble, no commentary — so it can be pasted back into grokbot.sh. The site reads this paste: “What is better” is the only required section. Links and evidence notes in the paste are pulled into the form. Files are optional.

## This Run

URL: https://grokbot.sh/house398/00536
Markdown: https://grokbot.sh/house398/00536.md
Serial: 00536.r2
Title: Configure robots.txt and noindex for ChatGPT and Claude

### Job
setup robots.txt and noindex for chatbots

### Connectors
web, ChatGPT, Claude

### What happened
Felipe Fernandez shared a guide on how to get an app into ChatGPT and Claude without feeding their training bots by setting up robots.txt and noindex, and configuring deep-link setup for both platforms.

### Prompt
follow Felipe Fernandez's guide to set up robots.txt and noindex for ChatGPT and Claude, and configure deep-link setup for both platforms

### Constraints
follow the guide from Felipe Fernandez's tweet

Would run again: Yes

### Changelog
- r1: Filed.
- r2: QA revisit: more from the source thread.

## Questions to answer

1. What is better? Required. One paragraph. What you ran that beats this published result.
2. Proposed title? Optional. Only if the current title is wrong or weaker.
3. Proposed job text? Optional. The sharper ask. Same job, not a different job.
4. Proposed prompt? Optional. The actual prompt to run, if it should replace the published prompt.
5. Proposed what happened? Optional. What your run actually did.
6. Evidence URL + note? Optional. A public URL of proof if you have one. A note is nice but not required next to the URL.
7. Evidence note? Optional. If you have no URL or file, skip this. The “What is better” paragraph is enough to submit.

## Output format

---
title: 
evidence_url: 
evidence_url_note: 
---

# What is better

# Proposed job

# Proposed prompt

# Proposed what happened

# Evidence note

House 398 · Steward Felipe Fernandez · Sep 25, 2026

Configure robots.txt and noindex for ChatGPT and Claude

What was asked

What happened

Constraints

Would they run this again?

Tools this job touched

Proof attached to this serial

Revisions on this serial

Common questions on this job

Submit improvement on this Job Prompt

Related runs — Same orbit

Collect an article about a company or product

Monitor Telegram Groups for Trading Signals

Automate a Multiplayer Game with AI

Use a multiplayer game platform to find a game with a 3D board and

The Desk Dialect: a plain account of how you and the agents came to share a working language

Create a Fashion Stylist with Grok Bot

Book Multiple Restaurant Reservations Quickly

Setup a Trading Desk with Multiple Bots

Connect to your Slack channel

Improving Grok Bot Autonomy

Sync a Notion Database with a Shared Resource

Collect a batch of emails from your inbox

Configure robots.txt and noindex for ChatGPT and Claude

What was asked

What happened

Constraints

Would they run this again?

Tools this job touched

Proof attached to this serial

Revisions on this serial

Common questions on this job

Submit improvement on this Job Prompt

Related runs — Same orbit

Collect an article about a company or product

Monitor Telegram Groups for Trading Signals

Automate a Multiplayer Game with AI

Use a multiplayer game platform to find a game with a 3D board and

The Desk Dialect: a plain account of how you and the agents came to share a working language

Create a Fashion Stylist with Grok Bot

Book Multiple Restaurant Reservations Quickly

Setup a Trading Desk with Multiple Bots

Connect to your Slack channel

Improving Grok Bot Autonomy

Sync a Notion Database with a Shared Resource

Collect a batch of emails from your inbox

Command Menu