Google indexation

Random stuff about serendipity. Discussion, Questions, Paraphernalia.
Post Reply
Fabien
Regular
Posts: 204
Joined: Wed Mar 15, 2006 1:02 pm
Location: Paris (France)
Contact:

Google indexation

Post by Fabien »

Hello !

I would like to have Google index my entries and only my entries ! Not the category pages, the author pages, the month pages, etc., because this cause the same text to appear several times when doing a google search.

Is there an easy way to do that.

Thanks, Fabien
Fabien Chabreuil (blog)
bernd_d
Regular
Posts: 468
Joined: Thu Jun 03, 2010 9:28 am
Contact:

Re: Google indexation

Post by bernd_d »

Create a robots.txt and exclude pages, you don't want to be indexed. :)

For example, this is the one i use for my weblog. (could be that's the one, which is default)

Code: Select all

Sitemap: http://bernd.distler.ws/sitemap.xml.gz
User-agent: *
Disallow: /feeds/
Disallow: /bundled-libs/
Disallow: /deployment/
Disallow: /docs/
Disallow: /htmlarea/
Disallow: /include/
Disallow: /lang/
Disallow: /plugins/
Disallow: /sql/
Disallow: /templates_c/
Disallow: /*.php$
Disallow: /*.js$
Disallow: /*.inc$
Disallow: /*.tar$
Disallow: /*.tgz$
Disallow: /*.sh$
Disallow: /*.zip$
Disallow: /*.tpl$
Fabien
Regular
Posts: 204
Joined: Wed Mar 15, 2006 1:02 pm
Location: Paris (France)
Contact:

Re: Google indexation

Post by Fabien »

Thank you Bernd for your answer. So I have to write something like

Disallow: /myblog/authors/
Disallow: /myblog/categories/
Disallow: /myblog/archives/2014/ (one line by year)

Is this correct?

Thanks, Fabien
Fabien Chabreuil (blog)
bernd_d
Regular
Posts: 468
Joined: Thu Jun 03, 2010 9:28 am
Contact:

Re: Google indexation

Post by bernd_d »

I am not a robots-expert, but i think this extensions are right.

What you have to ensure: robots.txt has to be in root of your domain, so it could be that you have to change the pathes of my example if you have s9y in a subfolder /weblog/.
Post Reply