Page 1 of 1

robots.txt

Posted: Sat Jan 30, 2016 9:29 am
by adminvz
how to set robots.txt?

User-agent: *
Disallow:
Disallow: /backups/
Disallow: /bl-kernel/
Disallow: /bl-plugins/
Disallow: /bl-themes/

Re: robots.txt

Posted: Sat Jan 30, 2016 8:37 pm
by diego
Hi, I think you can do this

Code: Select all

User-agent: *
Disallow: /bl-content/
Disallow: /bl-kernel/
Disallow: /bl-languages/
Disallow: /bl-plugins/
Disallow: /bl-themes/

Re: robots.txt

Posted: Sun Jan 31, 2016 7:17 am
by adminvz
hello, but is to be closed in the indexing folder
Disallow: / by-content /
I also need to all articles and pages in the search results indesirovalis