Page 1 of 1
Do i need to disallow plugin folder in robot.txt
Posted: Wed Oct 04, 2006 5:11 pm
by jumanjisama
Hi all,
i just wanna ask your guys for opinions, do i need to disallow plugins folder in the robot.txt, or it doesn't actually matters if i disallow it or not. I am just kinda curious about the things in s9y that i need to block in the robot.txt . Any suggestions is appreciated, thanks in advance
Re: Do i need to disallow plugin folder in robot.txt
Posted: Wed Oct 04, 2006 5:17 pm
by garvinhicking
Hi!
The "/plugins/" folders are often not called via HTTP, so you don't really need to block them.
Why do you want to do that? You should not actually need any robots.txt at all.
Best regards,
Garvin
Posted: Wed Oct 04, 2006 5:34 pm
by jumanjisama
I just wanna block the robot from indexing personal files such as the images and stuffs.
Plus in the previous weblog software i used, they have included a robot.txt file with a list of folders and files that shouldn't be allowed to be indexed, for security reasons.
Thats why i asked, i just wanna make sure if it is safe to let the plugins folder to be indexed
.
But what i understand from what you wrote,there is no danger in doing that, right??
Posted: Wed Oct 04, 2006 5:46 pm
by garvinhicking
Hi!
Okay; in that case I would simply forbid 'uploads' within robots.txt?
Best regards,
Garvin
Posted: Wed Oct 04, 2006 5:55 pm
by jumanjisama
thanks mate, both for the quick reply and explaination. now i know what need to be done. thanks again