16 posts
  • Has been part of the Envato Community for over 5 years
  • Has collected 1+ items on Envato Market
  • Located in Netherlands
jojobetty says

Hi,

Can you tell me if this is good robot txt:

User-agent: * Disallow: /wp-content/ Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp- Disallow: /feed/ Disallow: /trackback/ Disallow: /cgi-bin/ Allow: /wp-content/uploads/ User-agent: Googlebot Disallow: /.pdf$ Disallow: /.php$ Disallow: /.js$ Disallow: /.cgi$ Disallow: /.xhtml$ Disallow: /.php* Disallow: /.inc$ Disallow: /.css$ Disallow: /.txt$ Disallow: /?* Disallow: /wp-* Disallow: /feed/ Disallow: */trackback/ Disallow: /cgi-bin/ Disallow: /go/ Allow: /wp-content/uploads/

User-agent: Googlebot-Image Allow: /

Thank you!

16 posts
  • Has been part of the Envato Community for over 5 years
  • Has collected 1+ items on Envato Market
  • Located in Netherlands
jojobetty says

Nobody can help me?

Please tell me what a good Robot txt is.

Thank you!

2023 posts Review Manager
  • Has referred 10+ members
  • Has sold $5,000+ on Envato Market
  • Has collected 100+ items on Envato Market
  • Member of the Envato Team
+12 more
jremick Envato team says

A good robot txt will just depend on your needs and your situation. You would probably find more information about best practices, etc. by doing some Google searching. You might also want to look into .htaccess stuff to prevent certain user agents or block certain directories, etc.

Helpful Information

  • Please read our community guidelines. Self promotion and discussion of piracy is not allowed.
  • Open a support ticket if you would like specific help with your account, deposits or purchases.
  • Item Support by authors is optional and may vary. Please see the Support tab on each item page.

Most of all, enjoy your time here. Thank you for being a valued Envato community member.

Post Reply

Format your entry with some basic HTML. Read the Full Details, or here is a refresher:

<strong></strong> to make things bold
<em></em> to emphasize
<ul><li> or <ol><li> to make lists
<h3> or <h4> to make headings
<pre></pre> for code blocks
<code></code> for a few words of code
<a></a> for links
<img> to paste in an image (it'll need to be hosted somewhere else though)
<blockquote></blockquote> to quote somebody

:grin: :shocked: :cry: Complete List of Smiley Codes

by
by
by
by
by
by