Jump to content

  • You cannot start a new topic
  • You cannot reply to this topic

Multi-Vendor - Common Products For Vendors Performance Rate Topic   - - - - -

 
  • VerDan
  • Member
  • Trial users
  • Join Date: 13-Nov 18
  • 25 posts

Posted 30 November 2018 - 12:49 AM #1

We are using Version 4.9.1 of Multi-Vendor, and have 80 vendors, with 30,000 total products.

When we enable "Common Products for Vendors[Beta]" addon that comes with the platform we notice an immediate 5x to 10x performance degradation at the user interface as we do a variety of things like switching between categories or trying to open any vendor's store. If we disable the addon, the performance returns to normal.

 

Has anyone else noticed a performance hit with this?   Is there a fix or something we can do to address this?

 

We are working with a 12 Core, 32GB dedicated host.    Our concern is we are getting ready to add about 1M products and we are already having issues.

 

Thanks!



 
  • eComLabs
  • CS-Cart Expert
  • Authorized Reseller
  • Join Date: 27-Jan 14
  • 19833 posts

Posted 30 November 2018 - 02:11 PM #2

Try to contact CS-Cart support team with this issue. Looks like they did not test this module with real catalog and it is great opportunity for them to examine the issue and optimize the code


GET A FREE QUOTE | CS-Cart Add-ons | CS-Cart Licenses | CS-Cart Development | CS-Cart Design | Server Configuration | UniTheme and YOUPI
CS-Cart                USD 345     Multi-Vendor              USD 1250    CS-Cart RU                         24500 руб.
CS-Cart Ultimate  USD 775     CS-Cart + YOUPI      USD 545      CS-Cart RU + UniTheme    36000 руб.


 
  • imago
  • Senior Member
  • Members
  • Join Date: 18-Oct 18
  • 461 posts

Posted 30 December 2018 - 12:37 PM #3

We are using Version 4.9.1 of Multi-Vendor, and have 80 vendors, with 30,000 total products.

When we enable "Common Products for Vendors[Beta]" addon that comes with the platform we notice an immediate 5x to 10x performance degradation at the user interface

You have 30000 common products for 80 vendors, or 80 vendors with 30000 products and 0 common products?

 

Did CS-Cart solve the issue or it was server-based?

 

* * *

As the title of this thread is generic, I'd like to use it for all questions related to the new module which is BETA by definition

 

1. How to mass import 1M common products?

2. Can we convert a regular product into common one?

3. Can common products be displayed as catalog products in the front-end with a link prompting any potential vendor to sell the same product?



 
  • VerDan
  • Member
  • Trial users
  • Join Date: 13-Nov 18
  • 25 posts

Posted 05 January 2019 - 01:42 PM #4

So things have actually changed.  We now have ~ 1.3M common products for roughly 80 vendors, plus additional vendors with their own private products.

 

This performance issue has been resolved ( an option to update "counters" was added to allow the counters to be updated at the end of the bulk import as opposed to after every insert.  This was a huge performance improvement in that it removed the full table scan after every insert. ); however, we do have some lag with a few of the queries that we see on the platform.   Once we get things stabilized from the import and identify some of the harder hitting queries based on our configuration, i will provide them.

 

Looking at your #1 above, we just went through the pain of doing this import.  It is not a fast process and we essentially had to break the import down into batches of 25K.   When going higher than that we had issues with PHP running out of memory (we had to kick the memory limit up to 3072M).   By keeping the batches at 25K, we were able to keep the memory consumption of the thread at just under ~ 1.2M  (all viewed via 'top', atop or other apps).     We were able to run 6 to 8 threads but the bottleneck was really at the DB level with the table locking.

 

There were several queries that really hammered and tended to have the biggest impact on the blocking.   

This first one was pretty bad for whatever reason.   One of the bad items (not shown below) is the categories.category_id IN clause -- we have 7800 categories, so every category was actually listed out in the IN clause as opposed to a correlated sub query.

  • SELECT products_categories.category_id as variant_id, products_categories.category_id as variant FROM cscart_products  as products 

The next also tended to have an impact and be pretty expensive

  • SELECT SQL_CALC_FOUND_ROWS products.product_id, descr1.product as product, companies.company as company_name

Lots more going on with essentially a simple multi-vendor implementation.   We have a lot of tuning to go.



 
  • ValiD
  • Newbie
  • Trial users
  • Join Date: 25-Jul 19
  • 9 posts

Posted 28 July 2019 - 08:27 PM #5

Hello, do you have any idea if you've made any progress with this add-on? I want to buy the cs-cart multivendor plus, so I have included this add-on, but this add-on is still in the beta version and seems unfinished.
 
I hope that in the near future, this module can also be used very easily for products that a vendor has to buy, to associate with other sellers.
 
It is easier for some sellers to associate with such products than to create new products, especially as creating a new product is not very friendly.
 
An important change would be that the product, say that it is sold by 3 sellers, appears in categories, under the image (3 available offers), and displayed the lowest price.
 
I still expect the changes to happen.