Contoh Setting robot txt WordPress

Saran 1 isi dari robot.txt untuk CMS WordPress adalah :

 

User-agent: *
Disallow: /*?
Disallow: /*.php$
Disallow: /*.inc$
Disallow: /*.css$
Disallow: /wp-login.php
Disallow: /wp-login.php?*
Disallow: */trackback/
Disallow: /comments
Disallow: */comments
Disallow: /cgi-bin/
Disallow: /cgi-bin/*
Disallow: /cgi-bin/goto.cgi?*
Disallow: /wp-admin/
Disallow: /wp-content/plugins/
Disallow: /wp-content/cache/
Disallow: /wp-content/themes/
Disallow: /wp-content/bps-backup/
Disallow: /wp-content/upgrade/
Disallow: /wp-includes/
Disallow: /cgi-bin/

User-agent: Mediapartners-Google
Disallow:
Allow: /*

User-agent: Mediapartners
Disallow:
Allow: /*

Saran 2

User-agent: *
Allow: /
Disallow: /wp-
Disallow: /feed/$
Disallow: /*/feed/rss/$
Disallow: /*/trackback/$
Disallow: /*/feed/$
Disallow: /*/*/feed/$
Disallow: /*/*/feed/rss/$
Disallow: /*/*/trackback/$
Disallow: /*/*/*/feed/$
Disallow: /*/*/*/feed/rss/$
Disallow: /*/*/*/trackback/$
Disallow: /feed/
Disallow: /trackback/
Disallow: /rss/
Disallow: /comments/
Disallow: /cgi-bin/
Disallow: /*/comment-page
Disallow: /*?s=
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /search/
Disallow: /tags/
Contoh Setting robot txt WordPress original info

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s