Add Rules to the Virtual robots.txt
Adds Disallow rules for internal search result URLs to the robots.txt file that WordPress generates.
Snippet Library
SEO snippets for WordPress
Snippets for search engine basics: meta descriptions, Open Graph tags, structured data, noindex rules and robots.txt changes. Lightweight options for sites that do not run a full SEO plugin, or need one specific fix.
Allow Full Text and Video Previews in Search Results
Adds max-snippet:-1 and max-video-preview:-1 to the robots meta tag, letting search engines show longer text snippets and video previews for your pages.
Block AI Training Crawlers in robots.txt
Adds rules to your virtual robots.txt that ask AI training bots such as GPTBot, ClaudeBot, CCBot and Google-Extended not to crawl your site.
Noindex Posts in Selected Categories
Keeps posts from the categories you choose, such as internal news or short announcements, out of search engine results.
Noindex Selected Posts and Pages
Asks search engines not to index the posts and pages you list, such as thank-you, login or internal pages, while still following their links.
Noindex Staging and Development Sites
Adds noindex, nofollow to every page when WP_ENVIRONMENT_TYPE is not production, so staging copies never end up in search results.
Noindex Thin Archive Pages
Adds noindex, follow to date archives, attachment pages and page 2+ of archives, so search engines focus on your real content.