Need Help For Robots.txt

Store Builder Questions
1

Hello all,



I upgraed my cart version one month ago and I have noticed that my robots.txt is :

User-agent: *

Disallow: /app/

Disallow: /store_closed.html



My actual version is 4.2.4, could tell me what I have to write on the robots.txt please?



Thanks in advance.



Corinne

2

hi Corinne,



this is the default content of “robots.txt” so you should modify it only for particular cases.



best regards,

WSA team

3

[quote name=‘Damir (WSA-team)’ timestamp=‘1430826740’ post=‘213454’]

hi Corinne,



this is the default content of “robots.txt” so you should modify it only for particular cases.



best regards,

WSA team

[/quote]



Thank you for your answer :)



Have a great day.

Corinne

4

You can add certain pages or rules to it, mine is below which is a little overkill but I am paranoid…so thats fine, I think, I hope, im not sure…or am I …ahh this paranoia is doing me in :shock:

he he


<br />
User-agent: *<br />
Disallow: /images/thumbnails/<br />
Disallow: /app/<br />
Disallow: /design/<br />
Disallow: /js/<br />
Disallow: /var/<br />
Disallow: /store_closed.html<br />
Disallow: /pd<br />
Disallow: /terms-and-conditions.html<br />
Disallow: /jord<br />
Disallow: /accessories/<br />
Disallow: /footwear/<br />
Disallow: /poloshirt.php<br />
Disallow: /index.php?dispatch=checkout.cart<br />
Disallow: /index.php?dispatch=tags.summary<br />
Disallow: /index.php?dispatch=profiles.add<br />
Disallow: /index.php?dispatch=orders.search<br />
Disallow: /index.php?dispatch=auth.login_form&return_url=<br />
Disallow: /index.php?dispatch=auth.recover_password<br />
Disallow: /*?<br />
Disallow: /terms-and-conditions.html<br />
Disallow: /?mobile_skin<br />
Disallow: /?features_hash<br />
Disallow: /Corporate_Social_Responsibility.pdf<br />
Disallow: /Employee_Health_Safety_&_Env_Policy.pdf<br />
Disallow: /Quality_Statement.pdf<br />
Disallow: /Security_Policy.pdf<br />
Disallow: /cookie-policy.html<br />
Disallow: /data-protection.html<br />
Disallow: /Vision%20Statement.pdf<br />
Disallow: /Training_Policy.pdf<br />
Disallow: /returns-policy.html<br />
Sitemap: [url="https://www.hivis.co.uk/sitemap.xml"]https://www.hivis.co.uk/sitemap.xml[/url]<br />
User-agent: googlebot
5

[quote name=‘johnbol1’ timestamp=‘1430827349’ post=‘213456’]

You can add certain pages or rules to it, mine is below which is a little overkill but I am paranoid…so thats fine, I think, I hope, im not sure…or am I …ahh this paranoia is doing me in :shock:

he he


<br />
User-agent: *<br />
Disallow: /images/thumbnails/<br />
Disallow: /app/<br />
Disallow: /design/<br />
Disallow: /js/<br />
Disallow: /var/<br />
Disallow: /store_closed.html<br />
Disallow: /pd<br />
Disallow: /terms-and-conditions.html<br />
Disallow: /jord<br />
Disallow: /accessories/<br />
Disallow: /footwear/<br />
Disallow: /poloshirt.php<br />
Disallow: /index.php?dispatch=checkout.cart<br />
Disallow: /index.php?dispatch=tags.summary<br />
Disallow: /index.php?dispatch=profiles.add<br />
Disallow: /index.php?dispatch=orders.search<br />
Disallow: /index.php?dispatch=auth.login_form&return_url=<br />
Disallow: /index.php?dispatch=auth.recover_password<br />
Disallow: /*?<br />
Disallow: /terms-and-conditions.html<br />
Disallow: /?mobile_skin<br />
Disallow: /?features_hash<br />
Disallow: /Corporate_Social_Responsibility.pdf<br />
Disallow: /Employee_Health_Safety_&_Env_Policy.pdf<br />
Disallow: /Quality_Statement.pdf<br />
Disallow: /Security_Policy.pdf<br />
Disallow: /cookie-policy.html<br />
Disallow: /data-protection.html<br />
Disallow: /Vision%20Statement.pdf<br />
Disallow: /Training_Policy.pdf<br />
Disallow: /returns-policy.html<br />
Sitemap: [url="https://www.hivis.co.uk/sitemap.xml"]https://www.hivis.co.uk/sitemap.xml[/url]<br />
User-agent: googlebot
```<br />
[/quote]<br />
<br />
Thank you for your reply <img src="upload://rA9Qa8gnUPZzRZRdI8kt3dpjkrs.png" class="bbc_emoticon" alt=":)"><br />
Very nice website <img src="upload://ssa1U17ndImgNZSdwFNmOF2yUgM.png" class="bbc_emoticon" alt=";)"><br />
Regards.<br />
Corinne