i want to disallow the ”search” and the ”user name” urls,what should i write in robots.txt?

Thanks.

[@greitas-kreditas Member 13 years, 6 months ago]

Hey,

it should look something like this:

User-agent: *

Disallow: /user-name/

Disallow: /search/

[@greitas-kreditas Member 13 years, 6 months ago]

Hey,

it should look something like this:

User-agent: *

Disallow: /user-name/

Disallow: /search/

[@amber-11 Member 13 years, 6 months ago]

There is one new method, which is mostly used for SEO:

<meta name=”robots” content=“noindex, follow”/>

You should put this to all the pages you don’t want to get to SE’s index.

Your pages won’t be indexed, but still will pass link juice.

[@amber-11 Member 13 years, 6 months ago]

There is one new method, which is mostly used for SEO:

<meta name=”robots” content=“noindex, follow”/>

You should put this to all the pages you don’t want to get to SE’s index.

Your pages won’t be indexed, but still will pass link juice.

[@voayge Member 13 years, 5 months ago]

Do I need to remove “Disallow” from robots file then? How should this file look after I updated my pages with this code <meta name=”robots” content=“noindex, follow”/>?

[@voayge Member 13 years, 5 months ago]

Do I need to remove “Disallow” from robots file then? How should this file look after I updated my pages with this code <meta name=”robots” content=“noindex, follow”/>?

[@atlieku-surinkimas Member 13 years, 3 months ago]

Yes, you can leave only:

User-agent: *

Disallow:

Then it should work just fine.

[@atlieku-surinkimas Member 13 years, 3 months ago]

Yes, you can leave only:

User-agent: *

Disallow:

Then it should work just fine.