Block AI Training Crawlers in robots.txt
Adds rules to your virtual robots.txt that ask AI training bots such as GPTBot, ClaudeBot, CCBot and Google-Extended not to crawl your site.
Snippet Library
Snippets for search engine basics: meta descriptions, Open Graph tags, structured data, noindex rules and robots.txt changes. Lightweight options for sites that do not run a full SEO plugin, or need one specific fix.
Adds rules to your virtual robots.txt that ask AI training bots such as GPTBot, ClaudeBot, CCBot and Google-Extended not to crawl your site.
Adds an [html_sitemap] shortcode that lists all your pages and your posts grouped by category, giving visitors and crawlers one page that links to everything.
Sends a Last-Modified header with each post's update time and answers repeat visits from crawlers and browsers with "304 Not Modified", saving bandwidth and crawl budget.
Serves any post or page as clean Markdown when .md is added to its address (or ?format=markdown), and publishes an /llms.txt index of your pages and recent posts for AI tools.
Adds noindex to pages opened with sorting or filter parameters (such as ?orderby= or ?filter_color=), so crawlers do not index endless variations of the same list.
Stops comment reply links from creating ?replytocom= URLs that crawlers treat as duplicate pages, and redirects any such URL to the clean post address.
Adds rel prev and next link tags to paginated blog, category and archive pages, which Bing and other crawlers use to understand page series.