16 posts
  • 6 Years of Membership
  • Collector Level 1
  • Netherlands
jojobetty
says

Hi,

Can you tell me if this is good robot txt:

User-agent: * Disallow: /wp-content/ Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp- Disallow: /feed/ Disallow: /trackback/ Disallow: /cgi-bin/ Allow: /wp-content/uploads/ User-agent: Googlebot Disallow: /.pdf$ Disallow: /.php$ Disallow: /.js$ Disallow: /.cgi$ Disallow: /.xhtml$ Disallow: /.php* Disallow: /.inc$ Disallow: /.css$ Disallow: /.txt$ Disallow: /?* Disallow: /wp-* Disallow: /feed/ Disallow: */trackback/ Disallow: /cgi-bin/ Disallow: /go/ Allow: /wp-content/uploads/

User-agent: Googlebot-Image Allow: /

Thank you!

16 posts
  • 6 Years of Membership
  • Collector Level 1
  • Netherlands
jojobetty
says

Nobody can help me?

Please tell me what a good Robot txt is.

Thank you!

2036 posts Quality Manager
  • Affiliate Level 2
  • Author Level 4
  • Collector Level 4
  • Envato Team
+14 more
jremick
Envato team
says

A good robot txt will just depend on your needs and your situation. You would probably find more information about best practices, etc. by doing some Google searching. You might also want to look into .htaccess stuff to prevent certain user agents or block certain directories, etc.

by
by
by
by
by
by