robots.txt

Post Reply
adminvz
Ssr. Bludit
Posts: 27
Joined: Sun Jan 24, 2016 1:06 pm

how to set robots.txt?

User-agent: *
Disallow:
Disallow: /backups/
Disallow: /bl-kernel/
Disallow: /bl-plugins/
Disallow: /bl-themes/
User avatar
diego
Site Admin
Posts: 773
Joined: Sat May 16, 2015 2:53 pm
Been thanked: 1 time
Contact:

Hi, I think you can do this

Code: Select all

User-agent: *
Disallow: /bl-content/
Disallow: /bl-kernel/
Disallow: /bl-languages/
Disallow: /bl-plugins/
Disallow: /bl-themes/
adminvz
Ssr. Bludit
Posts: 27
Joined: Sun Jan 24, 2016 1:06 pm

hello, but is to be closed in the indexing folder
Disallow: / by-content /
I also need to all articles and pages in the search results indesirovalis
Post Reply