Do i need to disallow plugin folder in robot.txt

jumanjisama · Post by **jumanjisama** » Wed Oct 04, 2006 5:11 pm

Hi all,

i just wanna ask your guys for opinions, do i need to disallow plugins folder in the robot.txt, or it doesn't actually matters if i disallow it or not. I am just kinda curious about the things in s9y that i need to block in the robot.txt . Any suggestions is appreciated, thanks in advance

Post by **garvinhicking** » Wed Oct 04, 2006 5:17 pm

Hi!

The "/plugins/" folders are often not called via HTTP, so you don't really need to block them.

Why do you want to do that? You should not actually need any robots.txt at all.

Best regards,
Garvin

jumanjisama · Post by **jumanjisama** » Wed Oct 04, 2006 5:34 pm

I just wanna block the robot from indexing personal files such as the images and stuffs.

Plus in the previous weblog software i used, they have included a robot.txt file with a list of folders and files that shouldn't be allowed to be indexed, for security reasons.

Thats why i asked, i just wanna make sure if it is safe to let the plugins folder to be indexed

.

But what i understand from what you wrote,there is no danger in doing that, right??

Post by **garvinhicking** » Wed Oct 04, 2006 5:46 pm

Hi!

Okay; in that case I would simply forbid 'uploads' within robots.txt?

Best regards,
Garvin

jumanjisama · Post by **jumanjisama** » Wed Oct 04, 2006 5:55 pm

thanks mate, both for the quick reply and explaination. now i know what need to be done. thanks again

Do i need to disallow plugin folder in robot.txt

Do i need to disallow plugin folder in robot.txt

Re: Do i need to disallow plugin folder in robot.txt