Googlebot , Amazonbot keep trying to access and keep generating warming

This topic has 12 replies, 4 voices, and was last updated 9 months, 2 weeks ago ago by Andrew Mitchell

  • Avatar: Den
    Den
    Participant
    February 28, 2025 at 10:26

    Hi Team

    My website has launched 2 weeks ago. Recently, my web server apache always crashed due to high CPU loading. From the logs, I can see googlebot and amazonbot keep visit and generatiing the below warming log.

    I found those ip addresses are from googlebot , amazonbot…etc. Can you advice how we can solve and clear those warming message? Thanks

    Please find the attached log file for your reference.

    Dennis

    11 Answers
    Avatar: Rose Tyler
    Rose Tyler
    Support staff
    February 28, 2025 at 11:01

    Hello, Den,

    Thank you for reaching out to us.

    Could you provide some screenshots or analytics of CPU usage?

    Additionally, we are unable to see the warnings you mentioned—please share them with us for further review.

    Please read the conversation on this topic – https://www.8theme.com/topic/high-usage-cpu/ and follow the recommendations from there first.

    Best regards,
    8Theme’s Team

    Avatar: Den
    Den
    Participant
    February 28, 2025 at 12:15

    Hi, I attached the CPU loading chart for your reference. When CPU hit 100% , most of high loading process is “php-fpm” . It seems like crawler scan my website and causing php-fpm high loading on CPU. Is there any setting on the theme can help in this case? Thanks!

    Avatar: Den
    Den
    Participant
    February 28, 2025 at 12:16

    here is the CPU chart

    Files is visible for topic creator and
    support staff only.
    Avatar: Rose Tyler
    Rose Tyler
    Support staff
    February 28, 2025 at 12:52

    Hello,

    We appreciate your prompt response.

    Could you please provide temporary wp-admin and FTP access? We will check what can be done to help you.
    To grant WP-Admin access, please proceed to create a new user account with an administrator role through your WordPress Dashboard. Once the account is established, you may securely transmit the username and password to us via the Private Content section designated for this purpose.

    For FTP access, we require the following details: FTP host, FTP username, FTP password, FTP port, and FTP encryption type. If you need assistance in creating these credentials, please reach out to your hosting provider who will guide you through the process.

    Best Regards,
    8Theme’s Team

    Avatar: Den
    Den
    Participant
    February 28, 2025 at 13:04

    Thanks, please find the below login. We don’t have ftp server setup. However, I think your support has installed WP File Manager plugin before during last time support

    Please contact administrator
    for this information.
    Avatar: Jack Richardson
    Jack Richardson
    Support staff
    March 1, 2025 at 15:56

    Hello @Den,

    We attempted to install a plugin to monitor CPU usage; however, it appears that your website is not loading correctly. This issue may be due to a low memory limit or an insufficient Max Execution Time value.

    Could you kindly review your server configuration and increase these values accordingly? This should help ensure proper functionality.

    Also, did you read the topic we previously send ? What steps did you follow ?

    Please let us know once this has been adjusted or if you need any further assistance.

    Best regards,
    Jack Richardson
    8Theme Team

    Avatar: Den
    Den
    Participant
    March 2, 2025 at 08:26

    Hi .. I have increased Max_execution_time to 300 and I guess you would like to run “Code Profiler Pro”? .

    I’ve ran the report and attached for your reference.

    Currently , I have installed “Booter – Bots & Crawlers Manager” which looks better to control bots/crawlers connection and release high usage of pool www processes by stopping crash the server.

    However, I don’t think this is best solution. From the previous advice topic to resolve high CPU issue, I am not quiet clear the the solution as it’s in hidden message. Please have look and see any advice I can do . Thanks!

    Files is visible for topic creator and
    support staff only.
    Avatar: Jack Richardson
    Jack Richardson
    Support staff
    March 3, 2025 at 08:51

    Dear @Den,

    Thank you for conducting your own tests. Based on the screenshot titled *2025-03-02_898952_plugins.png*, it appears that the Elementor plugin is the most likely source of your CPU usage. Therefore, we kindly recommend reaching out to their support team for further assistance, as our support is limited to our own projects.

    Additionally, you may find it beneficial to keep using the *Booter – Bots & Crawlers Manager* plugin you previously installed. If it helps improve your website’s performance, you are welcome to continue using it.

    Please let us know if you need any further assistance.

    Best regards,
    Jack Richardson
    8Theme Team

    Avatar: Den
    Den
    Participant
    March 5, 2025 at 12:08

    Hi Support

    I think I can say the issue has identified which because web crawler with heavy request and causing php-fpm overloading , then crash the server.

    Just wondering, with xstore theme, is there any setting can block bad bot ?

    Avatar: Jack Richardson
    Jack Richardson
    Support staff
    March 5, 2025 at 16:11

    Hello @Den,

    For such requirements, we recommend using a separate plugin with advanced configuration options, as our theme does not include these specific settings. This functionality falls outside the scope of our theme’s features.

    Thank you for your understanding!

    Best regards,
    Jack Richardson
    8Theme Team

    Avatar: Andrew Mitchell
    Andrew Mitchell
    Support staff
    March 9, 2025 at 03:13

    Dear Den,

    In the spirit of gratitude, we want to express our appreciation for your trust in our products. As a valued customer, your experience matters greatly. Would you consider sharing it by giving our theme a deserving 5-star rating on ThemeForest?

    Click here to share your thoughts: https://themeforest.net/downloads

    Being part of our community means a lot, and your feedback contributes immensely.

    Best Regards,
    The 8Theme Team

  • Viewing 12 results - 1 through 12 (of 12 total)

The issue related to '‘Googlebot , Amazonbot keep trying to access and keep generating warming’' has been successfully resolved, and the topic is now closed for further responses

We're using our own and third-party cookies to improve your experience and our website. Keep on browsing to accept our cookie policy.