Halloween Sale 15% off Ends in See the plans
PHP

Add Rules to the Virtual robots.txt

Adds Disallow rules for internal search result URLs to the robots.txt file that WordPress generates.

Don’t have WPIDE yet? Install it on your site

Code

add_filter( 'robots_txt', function ( $output, $public ) {
    if ( ! $public ) {
        return $output;
    }

    $rules = "Disallow: /?s=\nDisallow: /search/\n";

    if ( false !== strpos( $output, "User-agent: *\n" ) ) {
        return preg_replace( '/User-agent: \*\n/', "User-agent: *\n" . $rules, $output, 1 );
    }

    return "User-agent: *\n" . $rules . "\n" . $output;
}, 10, 2 );

Notes

Only works when there is no physical robots.txt file in the site root.

How to add this snippet

  1. Install WPIDE on your WordPress site (it is free) and open Code Snippets.
  2. Use snippet above adds it from the library in one click. Or copy the code into a new snippet with the same code type.
  3. It is added inactive: review the code and settings, then switch it on.

All 71 SEO snippets

Have a snippet worth sharing?

Publish it to the library from WPIDE or right here. Sign in with any WordPress site that runs WPIDE, free or Pro. Public snippets are reviewed by the WPIDE team before they appear.

Share a snippet About WPIDE snippets

Which site should get this snippet?

Enter the address of your WordPress site. WPIDE opens there in a new tab with the snippet ready to review and save.

Remembered in this browser only, so you are asked once.

Report this snippet

Tell the WPIDE team what is wrong: broken code, something harmful, spam or copied work.