site not loading because of too big database

runing Debian x64 Apache/2.2.14 (Unix) PHP/5.3.1



server : 2x quad xeon @ 2ghz - 12gb Ram.



40 main categories - Each category diferent number of subcategories and sub sub categories … and so on … and so on

total categories Total: 949125



the site will be with auto parts.

number of products so far about 1000…





what to to make site work normal











(ps. site is working because i made Pages from Content module instead of showing the main categories because site freezes)













there are some other people with post like mine … but nobody is as complex as mine and nothing helped me to make it work normal conditions

  1. I have heard CSCart doesn’t work very well with PHP 5.3


  2. There are problems with Emenu so use Dynamic instead for now.


  3. Clear your cache.


  4. Repair/optimize your database.



    I don’t exactly how many but I have quite a few categories and subcategories with over 19,000 products with no issues of freezing.

Hello! You can change this setting define in config.php



The default settings is on 48m:

```php @ini_set(‘memory_limit’, ‘48M’); ```



It improves for me. :wink:

[quote name=‘Tool Outfitters’]1. I have heard CSCart doesn’t work very well with PHP 5.3



2. There are problems with Emenu so use Dynamic instead for now.



3. Clear your cache.



4. Repair/optimize your database.



I don’t exactly how many but I have quite a few categories and subcategories with over 19,000 products with no issues of freezing.[/QUOTE]



upgraded php to 5.3.1. working a little bit better …

some subcategories have 290 subcategories … i just cand put 290 subcategories in dynamic menu …site looks like ****… sorry for expresion



my solution will html pages from banner menu works so far so good:))







---------------------------------------------------------------------------------------------





and … how much memory should add? …that is 48m ? …1024 will be ok?

modified memory limit to 2048 mb … verry small diffrence



dynamic menu works okei but it doesen’t look good when i have this many categories





tried diffrent servers/apache configs



same stuff .

after adding about 1600 products some root categories don’t even load in the normal menu











keep you posted …working on solution





maybe somebody knows a diffrent server config then my own.





changed os and apache . new config

[url]http://piese-auto-fan.ro/info.php[/url]

It is also possible that mysql can be the problem. See its run time variables if they show there might be access-connection or index problems, try to optimise the tables. Try to export everything and then import. If you restart the server does it help for some time?

[quote name=‘TexasGuy’]It is also possible that mysql can be the problem. See its run time variables if they show there might be access-connection or index problems, try to optimise the tables. Try to export everything and then import. If you restart the server does it help for some time?[/QUOTE]



mysql is not the problem





when site load categories apache goes in 100%





i am looking to test diffrent apache configs … i’m out of ideas … how should i make apache?





or does the site support a diffrent webserver like lighttpd ?

100% CPU utilization?

[quote name=‘TexasGuy’]100% CPU utilization?[/QUOTE]



about 30 % total cpu usage ( I’M USING two quad xeon procesors … @ 2ghz … with HT … thats 16 cores )



and apache process goes in 100% sometimes 150% and crashes





i tested the folowing thing … and i got data loss because of apache freeze





clicked on a category with massive number of subcategories . and somebody else clicked to save a product … … product description not saved because apache was too loaded .





no apache eror

no site error … it just can’t handle it.

Disable all your categories and try again.

CS-Cart isn’t designed to hold that many categories


[quote name=‘kaisa’]about 30 % total cpu usage ( I’M USING two quad xeon procesors … @ 2ghz … with HT … thats 16 cores )



and apache process goes in 100% sometimes 150% and crashes





i tested the folowing thing … and i got data loss because of apache freeze





clicked on a category with massive number of subcategories . and somebody else clicked to save a product … … product description not saved because apache was too loaded .





no apache eror

no site error … it just can’t handle it.[/quote]

Although this has little to do with your issue and I cannot read what is written on your site, I did notice that you have the Generation of the Accord years wrong.



1998-2002 should be Gen 6

2003-2007 should be Gen 7

2008-2010 should be Gen 8

I had the same problem on my box. Reconfigured Apache with PHP 5.2.13 and all sorted. Hate 5.3






[quote name=‘Tool Outfitters’]1. I have heard CSCart doesn’t work very well with PHP 5.3



2. There are problems with Emenu so use Dynamic instead for now.



3. Clear your cache.



4. Repair/optimize your database.



I don’t exactly how many but I have quite a few categories and subcategories with over 19,000 products with no issues of freezing.[/QUOTE]

[quote name=‘Noman’]I had the same problem on my box. Reconfigured Apache with PHP 5.2.13 and all sorted. Hate 5.3[/QUOTE]





tested that on diffrent server but same specs

load time for original category menu is a little bit better but still +15 - 20 seconds





but on php 5.2.13 products add harder and y have 1gb for php scripts

VPS Xeon CPU, 512RAM [only!], SATA RAID1, well configured.



More than 15 thousands categories and 6000 products. To list all of them via Search takes less than 5sec. The website is fast.



Do you have GZIP enabled and Smartoptimizer installed?

updated website with smartoptimizer .

loadtime a little better.











P.S. you got 15.k categories i got more than 700.k

[quote name=‘kaisa’]i got more than 700.k[/QUOTE]



Sounds like a U53|2 error to me… :confused:

updated site. with gzip. and smartoptimizer



now working on making nginx frontend . and apache backend …





will keep you posted on the development .



site still has problems . with gzip and smartopt.



product adding is verry dificult




[quote name=‘GuruWebDev’]Sounds like a U53|2 error to me… :confused:[/QUOTE]





what is a u53|2 error? i never heard of that

http://piese-auto-fan.ro





check it out





cs-cart with Total: 597592 categories.



working on nginx + apache :smiley:



fixed problems with updating products . and browsing.



problem was because of proabably corupted files when i uploaded cs-cart files to the server.





no optimization needed. it is a basic cs-cart with no optimizations .

i just copied from another cs-cart all the files exept my skin and images …and config