Skip to content
Skill Authoring
Skill

/robots-txt

Sub-skill de agent-ready-cloudflare: Implement robots.txt

BOOST
@fabricioctellesfabricioctelles@fabricioctelles
From plugin
fabricioctelles-skills
12047 skills
Install
$ npx -y skills add fabricioctelles/skills --skill robots-txt --agent claude-code

How it fires

How this skill gets triggered: by you, by Claude, or both.

  • Fires itselfAuto-invocation. Claude auto-loads it when your prompt matches the work.Auto-invocation is when the right skill fires by itself at the right moment, driven by a FLOW.md router and a hook, instead of you invoking it by name. It is the difference between a skill being installed and a skill actually getting used.Read the full definition →
  • You can call itInvoke it directly when you want it.
  • Slash command/robots-txt

Context preview

The summary Claude sees to decide when to auto-load this skill.

Sub-skill de agent-ready-cloudflare: Implement robots.txt

SKILL.md

robots-txt.SKILL.md
name: agent-ready-robots-txt
description: >
  Sub-skill de agent-ready-cloudflare: Implement robots.txt

Implement robots.txt

Publish a valid robots.txt at your site root per [RFC 9309](https://www.rfc-editor.org/rfc/rfc9309).

Requirements

  • Serve `/robots.txt` as `text/plain` with HTTP 200
  • Include `User-agent` directives with `Allow`/`Disallow` rules
  • Reference your sitemap if one exists: `Sitemap: https://example.com/sitemap.xml`

Cloudflare

[AI Crawl Control](https://developers.cloudflare.com/ai-crawl-control/) can manage your robots.txt from the dashboard, including AI-specific bot rules.

Validate

POST https://isitagentready.com/api/scan
Content-Type: application/json

{"url": "https://YOUR-SITE.com"}

Check that `checks.discoverability.robotsTxt.status` is `"pass"`.

Read it on GitHub ↗
Ships withfabricioctelles-skills

26 production-ready skills for AI coding agents. Install with one command, use across Claude Code, Cursor, Kiro, Windsurf, and OpenCode.

Get the whole plugin
Stats
AstroHTMLBashDockerCloudflare
+7 tags
VercelGitHubMarkdownAnthropicOpenAIMCPFigma
121
Stars
11
Forks
Active
Maintenance
Python
Language
Apache-2.0
License
3d ago
Last commit
8mo ago
Created
6h ago
Added

Repo: fabricioctelles/skills

In this plugin
47 skills
See everything inside

Other skills on fabricioctelles-skills.

See all 47 skills in fabricioctelles-skills