Googlebot Error

Avatar
  • Answered
I've gotten a message from Google that "Googlebot can't access your site". The first one was for 5/13 with an error rate of 100%. Second one 5/14 with error rate of 42.9%.

The only thing I might have done to change anything is update my sitemap.xml yesterday before I knew about this problem.
Avatar
justinvictoria
May be be you din't followed the procedure or your URL is wrong submitted so please cross check .
Avatar
Arn
Hello AngelElegance, You may not have been aware, but the ecommerce software that you are using (PrestaShop) automatically generates a ROBOTS.TXT file. This file is used to limit access from bots (like Googlebot). The file is located in your PUBLIC_HTML folder. You can edit it using the cPanel File Manager. In some cases, this using the ROBOTS.TXT file is necessary and a good thing. It just depends on how you want to set it. If you want learn more about how to use the Robots.txt file, go to Stop Search Engines from Crawling your website, or you may want to review this web page from Robotstxt.org for much more indepth usage of the ROBOTS.TXT file . The advantage of allowing something like googlebot is that it can help with search engine issues. The downside is that multiple bots like googlebot can have a marked effect on the performance of your website. Please review the documentation on Robots.txt and then decide how you want to use those settings. If you have any further questions, please contact technical support available 24 hours a day / 7 days a week. Arnel C. InMotion Hosting Community Support Team