Hi, has anyone experienced this? We opened our stroefront and it made it impossible to open the website. We have been searching forever until we found out it has to do with opening to public. One of our admins mentioned something about Yandex reaching out to our websites similar to a Dos Attack or something.
We really have no idea but it makes our marketplace very useless. We want to launch in 2 days.
Any recommendations would be highly appreciated.
You can contact hosting support and block Yandex bot on the server side
You can register at Yandex.Webmaster and control site crawl rate on the Indexing → Crawl rate page
You can ask your hosting support / server administrators to add Yandex user agent to the block list on the web-server’s side.
Please check this thread for the details:
The list linked in your post doesn’t mention Yandex. Any thoughts on the correct way to add it to htaccess? (my server support didn’t have a view).
I found
In this thread there was a discussion and instructions on how to block bots in general, and the list of definitely malicious bots.
I can assume that Yandex is not malicious, as it is a global search engine, but blocking its crawlers may not affect your SEO if you don’t rely on customers using this search engine.
I see that you are using the LiteSpeed web server, which is compatible with an Apache-like configuration. In this case, I can recommend that you read the following article, which I mentioned in that thread, the part for Apache: