robots.txt

Post Reply
adminvz
Ssr. Bludit
Posts: 27
Joined: Sun Jan 24, 2016 1:06 pm

Sat Jan 30, 2016 9:29 am

how to set robots.txt?

User-agent: *
Disallow:
Disallow: /backups/
Disallow: /bl-kernel/
Disallow: /bl-plugins/
Disallow: /bl-themes/
User avatar
diego
Site Admin
Posts: 713
Joined: Sat May 16, 2015 2:53 pm
Contact:

Sat Jan 30, 2016 8:37 pm

Hi, I think you can do this

Code: Select all

User-agent: *
Disallow: /bl-content/
Disallow: /bl-kernel/
Disallow: /bl-languages/
Disallow: /bl-plugins/
Disallow: /bl-themes/
adminvz
Ssr. Bludit
Posts: 27
Joined: Sun Jan 24, 2016 1:06 pm

Sun Jan 31, 2016 7:17 am

hello, but is to be closed in the indexing folder
Disallow: / by-content /
I also need to all articles and pages in the search results indesirovalis
Post Reply