Hey
since few weeks ago, my store www.e27.ro disappear from google search
https://www.google.ro/search?client=opera&q=e27.ro&sourceid=opera&ie=UTF-8&oe=UTF-8#q=www.e27.ro
Could anyone help me?
Hey
since few weeks ago, my store www.e27.ro disappear from google search
https://www.google.ro/search?client=opera&q=e27.ro&sourceid=opera&ie=UTF-8&oe=UTF-8#q=www.e27.ro
Could anyone help me?
User-agent: *
Disallow: /
you have blocked all content in the robots.txt...
check the date of robots.txt ...check permissions of the file... maybe someone changed this...and modify robots.txt to allow search enginges indexing ...
i belive you can find some hints on the forum for robots.txt
User-agent: *
Disallow: /
you have blocked all content in the robots.txt...
check the date of robots.txt ...check permissions of the file... maybe someone changed this...and modify robots.txt to allow search enginges indexing ...
i belive you can find some hints on the forum for robots.txt
thanks for quick answer; where can edit that file?
It is located in the root of your store
It is located in the root of your store
Yes I found it
its OK to write?:
User-agent: *
Disallow: /addons/
Disallow: /cgi-bin/
Disallow: /controllers/
Disallow: /core/
#Disallow: /images/
Disallow: /js/
Disallow: /lib/
Disallow: /payments/
Disallow: /schemas/
Disallow: /shippings/
Disallow: /skins/
Disallow: /var/
Disallow: /admin.php
Disallow: /config.php
Disallow: /config.local.php
Disallow: /init.php
Disallow: /prepare.php
Disallow: /store_closed.html
Disallow: /?currency=
Disallow: /index.php?dispatch=
Sitemap: http://www.e27.ro/sitemap.xml
Overkill. Remember this is a robot that is traversing html pages, not something that is looking at the directory structure of your site.
What version of cs-cart are you running? Do you have the corresponding archive? If so, just use the distributed robots.txt file from your distribution.
For V2/V3 you should probably use something like:
User-agent: * Disallow: /images/thumbnails/ Disallow: /skins/ Disallow: /payments/ Disallow: /store_closed.html Disallow: /core/ Disallow: /lib/ Disallow: /install/ Disallow: /js/ Disallow: /schemas/
Depending on how old a version you are running, you might also want to ensure that links to login page, currency setting, searches, etc. all have the attribute 'rel="nofollow"' set.
I'm on 4.3.1
4.3.1 /robots.txt
User-agent: * Disallow: /app/ Disallow: /store_closed.html
done
Thanks CS-Cart
i don't think there was overkill...
with this configuration google will index thousand of unwanted pages,filters,keywords and this can cause server overload, database failure....etc...
you can use built in robots.txt editor in cs cart and search the forum about robots.txt
User-agent: *
Disallow: /app/
Disallow: /store_closed.html
this configuration is used in cs cart demo and is not for production websites....
it can be that the update modifes robots.txt...seems like a bug
@demeldoo, - Almost all of his folders don't exist in 4.x. And yes, it is overkill in that a robot would never be accessing most of those references from the html of his store (even it was the appropriate structure for his release). If he has a malicious robot, then it might try to access some of those files/directories. But then it wouldn't pay any attention to robots.txt.
User-agent: *
Disallow: /app/
Disallow: /store_closed.html
this configuration is used in cs cart demo and is not for production websites....
Huh? That is what's distributed with the product. What is your suggestion for a proper robots.txt?
It is completely adequate for the skins distributed with cs-cart.
And how long it takes google to index thats changes? I saw my website still hiden after almost 24 hours
And how long it takes google to index thats changes?
Have no idea what this means...
Try to submit robots.txt to Google Webmaster:
and your using v4.2.4 not 4.31 on
www.e27.ro
and your using v4.2.4 not 4.31 on
www.e27.ro
i have mentioned filters.... subpages... dispatches which can generate thousand of unwanted pages....
i have not mentioned folders...css or other related files
as you mentioned most of suggested folders are not present in cs cart 4 and above and the install folder is removed by default
also putting admin.php name in the robots.txt is not smart idea
here is something i think what is removing all unwanted stuff from indexation, but this can be different on other websites... it's not recommendation
User-agent: *
# Private pages
Disallow: /*&status=
Disallow: /*&pshort=
Disallow: /*&pfull=
Disallow: /*&pname=
Disallow: /*&pkeywords=
Disallow: /*&search_performed=
Disallow: /*?lang=
Disallow: /*&bid=
Disallow: /*&sid=
Disallow: /*&category_id=
Disallow: /*&product_id=
Disallow: /*&cookies_accepted=
Disallow: /index2.php
Disallow: /*&sort_order=
Disallow: /*&sort_by=
Disallow: /*&features_hash=
Disallow: /*&subcats=
Disallow: /*page-
Disallow: /*.html$
Disallow: /*?subcats=
Disallow: /?option=
Disallow: /index.php
Disallow: /*?dispatch=
Disallow: /*?product_id=
Disallow: /*?page=
Disallow: /*?return_url=
Disallow: /*?features_hash=
Disallow: /*?items_per_page=
Disallow: /*?action=
Disallow: /*?currency=
Disallow: /*?sort_by=
Disallow: /*?layout=
Disallow: /*?filter_id=
Disallow: /*?cookies_accepted=
Disallow: /*?keyword=
Disallow: /*?pop=
Disallow: /najdi-izdelek/
Disallow: /prijava/
Disallow: /darilni-boni/
Disallow: /primerjava/
Disallow: /darilni-boni/
Disallow: /seznam-zelja/
Disallow: /registracija-clanov/
Disallow: /contact-us/
Disallow: /kseznamu-primerjav/
Disallow: /tags-summary/
Sitemap: https://www.demel.si/sitemap.xml
All the filters, searches, login, etc. (as I stated above) should be handled using the rel="nofollow" attribute rather than bogging down robots.txt. If you use above, you'll never get products indexed by category.
I'd like to see an example where Google walked a site using default robots.txt and had unwanted content. But again, those addon links should have rel="nofollow" attributes.
Try to submit robots.txt to Google Webmaster:
Submitted to google last night. Just few minutes later, site has been indexed
Submitted to google last night. Just few minutes later, site has been indexed
We are glad to hear that!