No, it's not.Is this supposed to represent some widespread disregard for the meta tag?
|
Posted 28 March 2010 - 07:00 PM #21
No, it's not.Is this supposed to represent some widespread disregard for the meta tag?
Posted 28 March 2010 - 10:28 PM #22
Posted 29 March 2010 - 09:37 AM #23
Yes, right.should i
Disallow: /index.php?target=gift_certificates&mode=free_products&search_products=Y&page=
??
Posted 31 March 2010 - 03:19 PM #24
Posted 31 March 2010 - 03:42 PM #25
You can still add it to the file, there is nothing wrong. The only thing are the "wildcards" [ * ]. Not all bots support those.Avoid duplicate content?
Disallow: /*.html?subcats=Y
Disallow: /*.php?subcats=Y
Posted 14 May 2010 - 01:04 PM #27
Posted 14 May 2010 - 01:09 PM #28
Custom printed hi visibility clothing sale the UK's online hivis safety shop
v4.5.2
Posted 14 May 2010 - 01:38 PM #29
You can use something like that:Is it possible to prevent the generation of dynamic links for cs-cart? That way, the sitemap won't index any?
Thanks!
Disallow: /index.php?dispatch=It depends, which links do you want to disallow. The example above will disallow indexing of all URLs which contain '/index.php?dispatch=' in the URL.
Posted 17 June 2010 - 04:52 PM #30
You can use something like that:
Disallow: /index.php?dispatch=It depends, which links do you want to disallow. The example above will disallow indexing of all URLs which contain '/index.php?dispatch=' in the URL.
CS-CART: version 4.6.1
Posted 17 June 2010 - 05:11 PM #31
What do you mean with 'duplication'?Is it ok to use Disallow actual URL instead to prevent the duplication.
Disallow: /display-cabinets.html?subcats=Y
Disallow: /display-cabinets/corner-display-cabinets.html?sort_by=
Disallow: /display-cabinets/corner-display-cabinets.html?subcats=Y
Thank you.
Posted 17 June 2010 - 05:19 PM #32
What do you mean with 'duplication'?
CS-CART: version 4.6.1
Posted 17 June 2010 - 06:55 PM #33
And what the filter begin the string with?I should have said, prevent crawling for Filters and Sorting features.
Because I use extensive filtering, and google is crawling all of my pages and I am scare to be spammed.
I thought to use actual path to prevent them to be crawled.
I know u are expert, and I used suggested robot.txt sample.
Is that correct or I should take it out.
Thank you.
Posted 18 June 2010 - 10:44 AM #35
Hi you can try this one:Something like:
http://domain.com/fl...ures_hash=V1275
Disallow: features_hash Disallow: /index.php?type=extended&search_performed Disallow: /index.php?subcats=YThis should disallow all URLs which contain the word 'features_hash'
Posted 18 June 2010 - 03:04 PM #36
Hi you can try this one:
Disallow: features_hash Disallow: /index.php?type=extended&search_performed Disallow: /index.php?subcats=YThis should disallow all URLs which contain the word 'features_hash'
CS-CART: version 4.6.1
Posted 18 June 2010 - 06:25 PM #37
You're welcome... of course I added the two other lines to the code just to disallow some searching strings...Thank you.
Posted 21 June 2010 - 04:19 PM #38
Posted 21 June 2010 - 04:30 PM #39
this one... and how to disallow the following strings:
.html?sort_by=position&sort_order=asc
.html?sort_by=popularity&sort_order=desc&layout=products_multicolumns
.html?sort_by=product&sort_order=asc
by adding:
Disallow: ?sort_by=
or
Disallow: /?sort_by=
or
Disallow: position&sort_order
Disallow: popularity&sort_order
Disallow: product&sort_order
or...?
Disallow: /?sort_by=
Posted 10 May 2011 - 11:00 AM #40