How To Remove ::: ?items_Per_Page=12

Hello Gurus,



Though I use SEO addon, google indexing “www.dominname.com/category.html?items_per_page=12 .

Is there anyway exclude these URL “?items_per_page=12” From Indexing ?





Thanks in advance.

Disallow: /*?



in robots.txt stops them being crawled,



John

Thank you John. I am using cs-cart 4.2.2 version. Now my robots.txt is looks as below.



Anyone suggest anything wrong in it?



User-agent:

[b][color=#b22222]Disallow: /
?[/color][/b]

Disallow: /images/thumbnails/

Disallow: /app/

Disallow: /design/

Disallow: /js/

Disallow: /var/

Disallow: /store_closed.html

looks Ok, though you will probably add more to it as you go. have you just added [color=#B22222]Disallow: /*? or did you put that in at the start[/color]



John

Hello john,

I just added after your suggested.



Thank you for your help!

Anyone know how to stop URLs like this to be picked up by Google:



[color=#212121][font=Arial, sans-serif][size=3][left]…something?subcats=Y&features_hash=V5890.V5882.V5872.V5879.V5895.V5873[/left][/size][/font][/color]

[quote name='Onkel_Sid' timestamp='1413369577' post='194232']

Anyone know how to stop URLs like this to be picked up by Google:



[color=#212121][font=Arial, sans-serif][size=3][/color]

[left]…something?subcats=Y&features_hash=V5890.V5882.V5872.V5879.V5895.V5873[/left]

[/size][/font]

[/quote]



Disallow: /*? will prevent crawlers from indexing anything that has ? in the url.

Aha. Nice!

4.2.3 robots files seems a little bit poor? what do you think? maybe some security issue

You shouldn't be getting any ?items_per_page=12 unless you have a link for the page index that does NOT have the attribute of 'nofollow'. Standard cs-cart has 'nofollow' attribute set for page index links as well as links to things like login that would end up nowhere for a robot.

[quote name='tbirnseth' timestamp='1415140680' post='196053']

You shouldn't be getting any ?items_per_page=12 unless you have a link for the page index that does NOT have the attribute of 'nofollow'. Standard cs-cart has 'nofollow' attribute set for page index links as well as links to things like login that would end up nowhere for a robot.

[/quote]



so you are saying this issue is solved with nofollow for categories with ? ,login,wishlist,checkout and so… ??

But adding [color=#000000]Disallow: /*? to robots.txt can't harm or ?[/color]

I'm saying you shouldn't have any of those parameters for URL's that come from a robot crawling your site.

You can apply bandaids to symptoms all you want. But finding the root cause solves the problem permanently.

i had this problem in other version… i don’t think that issue exisist in 4.2.2.



after some thinking about this line [color=#000000][font=arial, verdana, tahoma, sans-serif]Disallow: /? i’m not sure does it have to be formated like this… dos logic from here is ignore everthing what ends with ? should this be [/font][/color][color=#000000][font=arial, verdana, tahoma, sans-serif]Disallow: /?[/font][/color]



[color=#000000][font=arial, verdana, tahoma, sans-serif] my suggestion leave it to cs cart :D[/font][/color]

[quote name='tbirnseth' timestamp='1415140680' post='196053']

Standard cs-cart has 'nofollow' attribute set for page index links as well as links to things like login that would end up nowhere for a robot.

[/quote]



What does the “'nofollow' attribute set for page index links” look like? Is it int he Robots.txt file or the .htaccess file?



Jack

Jack, ‘nofollow’ is an value of the ‘rel’ attribute of the anchor tag. I.e.

<br />
<ul class="ty-account-info"><br />
    <li class="ty-account-info__item ty-dropdown-box__item"><a class="ty-account-info__a underlined" href="http://cart4.ez-ms.com/index.php?dispatch=orders.search" rel="nofollow">Orders</a></li><br />
    <li class="ty-account-info__item ty-dropdown-box__item"><a class="ty-account-info__a underlined" href="http://cart4.ez-ms.com/index.php?dispatch=product_features.compare" rel="nofollow">View compare list</a></li>	    <br />
    <li class="ty-account-info__item ty-dropdown-box__item"><a class="ty-account-info__a" href="http://cart4.ez-ms.com/index.php?dispatch=wishlist.view" rel="nofollow">Wish list</a></li><br />
</ul><br />

```<br />
Which is pulled directly off the V4 homepage and tells a robot "don't bother going here, this is not something useful to you".<br />
<br />
You can lookup the 'rel' attribute if you want to know it's ugly and gory details that make no sense to most people.... <img src="upload://b6iczyK1ETUUqRUc4PAkX83GF2O.gif" class="bbc_emoticon" alt=":-)">

I not convinced that is a good ideea to [color=#b22222]Disallow: /*?[/color]



[color=#b22222]what happen with these links bellow that need to be indexed?[/color]



?dispatch=sitemap.view - this is for sitemap

index.php?dispatch=categories.catalog - for categories etc…

?dispatch=categories.catalog

?dispatch=categories.view&category_id=206

?dispatch=products.view&product_id=30946

Hey people support and vote that you want seo improvements

import product's seo field with 301-redirection history





http://cscart.uservoice.com/forums/134344-cs-cart/suggestions/6545286-import-product-s-seo-field-with-301-redirection-hi