I will continue to work with our Ops team to see if there was another, additional issue that would have cause this additional spike.
This is not an additional spike. It's the same problem. There are no "spikes" in any of the screen shots other than the first one. While they are tapering off, the rate is a lot slower than we've been told to expect.
I will continue to work with our Ops team to see if there was another, additional issue that would have cause this additional spike.
This isn't an additional spike - the errors started on March 30th, increased over the next several days, then dropped to around 3700 and stayed there. There has been no improvement (on my site) after the initial drop; the errors have stayed constant for the last 10 days.
Sorry, I have nothing new to add but I did want to bring this back into the conversation. The errors are from Google sending SmugMug too much bot traffic. The errors are from bots, not humans. You can verify your site is working properly by checking the post below.
Mine went through the roof on March 29 also. From 0 to 1300 and I just got another report, April 22, 2013. Has been steady at about 1200 for the last month!
Mine went through the roof on March 29 also. From 0 to 1300 and I just got another report, April 22, 2013. Has been steady at about 1200 for the last month!
Understood...but as Zach mentions above, we are not doing anything differently. This is 100% due to to the increase of bot traffic and the way that Google is applying that information to your webmaster tools. There really is nothing we can do about it. We have fully verified that there is nothing to do on our end to correct this. We still expect the Google reported bot errors to go down in your Webmaster tools.
Understood...but as Zach mentions above, we are not doing anything differently. This is 100% due to to the increase of bot traffic and the way that Google is applying that information to your webmaster tools. There really is nothing we can do about it. We have fully verified that there is nothing to do on our end to correct this. We still expect the Google reported bot errors to go down in your Webmaster tools.
I apologize for the inconvenience.
Michael
I have gotten four emails from google bots and was actually told by Sean in a web based Webinar that you guys if I came with a outline of the problem would be able to fix the problem. So now you are telling us that SmugMug has done everything they can do and can't fix the problem? So may I ask which is it?
I have gotten four emails from google bots and was actually told by Sean in a web based Webinar that you guys if I came with a outline of the problem would be able to fix the problem. So now you are telling us that SmugMug has done everything they can do and can't fix the problem? So may I ask which is it?
If there was something we could fix, I assure you we would. But we cannot control Google bots or the way they display errors in the Webmaster tools. As much as we wish we could, we simply cannot. We have changed nothing on our end, and there are no errors that have any impact on your site. These are simply generated by Google sending way to many bots. As we have mentioned, they have fixed their problem with the crawl bots, but they also apparently haven't been able to submit all of the errors through Google WebMaster tools in a timely manner.
Your sites are still being crawled and have good SEO, and your customers are not seeing 503 errors.
Google should correct this behaviour, but that may take them some time. In the meantime, you'll see from the other "Health" pages in Webmaster Tools that your site is otherwise healthy.
Sean most likely didn't know the situation that we have investigated, and thought this was something that we could correct.
Understood...but as Zach mentions above, we are not doing anything differently. This is 100% due to to the increase of bot traffic and the way that Google is applying that information to your webmaster tools. There really is nothing we can do about it. We have fully verified that there is nothing to do on our end to correct this. We still expect the Google reported bot errors to go down in your Webmaster tools.
If there was something we could fix, I assure you we would. But we cannot control Google bots or the way they display errors in the Webmaster tools. As much as we wish we could, we simply cannot. We have changed nothing on our end, and there are no errors that have any impact on your site. These are simply generated by Google sending way to many bots. As we have mentioned, they have fixed their problem with the crawl bots, but they also apparently haven't been able to submit all of the errors through Google WebMaster tools in a timely manner.
Your sites are still being crawled and have good SEO, and your customers are not seeing 503 errors.
Google should correct this behaviour, but that may take them some time. In the meantime, you'll see from the other "Health" pages in Webmaster Tools that your site is otherwise healthy.
Sean most likely didn't know the situation that we have investigated, and thought this was something that we could correct.
I apologize for the inconvenience.
Michael
Michael,
Thank you for your answer thats all I wanted I firm and clear answer on yes or no you can or can't. SmugMug is a great service and has been very good to me over the years. I know that if you could you would fix it so I will trust that this is the truth and move forward from here. Again thank you for you reply and I wish you and SmugMug the best in going forward with any other issues that may come up.
I'm getting a HTTP 503 error when I try to add my sitemap with google webmaster tools. Seems they can't fetch the robots.txt file and hence decide not to try to fetch the sitemap either.
Could Smugmug allow Google to fetch these key resources even though Google has exceeded whatever Smugmug considers acceptable amount of traffic for generally crawling the site?
Speaking of this: It's been almost two months since the first increase in errors, and I still have 402 crawl errors... It is slowly decreasing (I started with 729) but it's still alarmingly high...
The wisest men follow their own direction - Euripides
We are still not sending errors to Google. This is still entirely on Googles side, unfortunately. I will reiterate again, this has zero effect on actual users seeing your site, or your Google search rank.
Comments
This is not an additional spike. It's the same problem. There are no "spikes" in any of the screen shots other than the first one. While they are tapering off, the rate is a lot slower than we've been told to expect.
You can see the pattern on my site in the image I added to my post from yesterday.
--- Denise
Musings & ramblings at https://denisegoldberg.blogspot.com
Thanks
Langford Photography
http://www.langfordphotography.com
james@langfordphotography.com
I got another missive from Google dated April 15th, same problem.....
Cheers
gspep.smugmug.com & steendorp.smugmug.com
FB: www.facebook.com/peter.perdaen - Youtube: www.youtube.com/user/1150GSPEP/videos
Screen Shot 2013-04-17 at 6.56.16 AM.jpg
My Website
Facebook | Twitter | | VSCOgrid | Instagram |
Support Hero
Understood...but as Zach mentions above, we are not doing anything differently. This is 100% due to to the increase of bot traffic and the way that Google is applying that information to your webmaster tools. There really is nothing we can do about it. We have fully verified that there is nothing to do on our end to correct this. We still expect the Google reported bot errors to go down in your Webmaster tools.
I apologize for the inconvenience.
Michael
Facebook
Google+
Twitter
Photo Blog
www.carolineshipsey.co.uk - Follow me on G+
[/URL]
Jason Scott Photography | Blog | FB | Twitter | Google+ | Tumblr | Instagram | YouTube
I have gotten four emails from google bots and was actually told by Sean in a web based Webinar that you guys if I came with a outline of the problem would be able to fix the problem. So now you are telling us that SmugMug has done everything they can do and can't fix the problem? So may I ask which is it?
http://www.k-ophotography.com/
If there was something we could fix, I assure you we would. But we cannot control Google bots or the way they display errors in the Webmaster tools. As much as we wish we could, we simply cannot. We have changed nothing on our end, and there are no errors that have any impact on your site. These are simply generated by Google sending way to many bots. As we have mentioned, they have fixed their problem with the crawl bots, but they also apparently haven't been able to submit all of the errors through Google WebMaster tools in a timely manner.
Your sites are still being crawled and have good SEO, and your customers are not seeing 503 errors.
Google should correct this behaviour, but that may take them some time. In the meantime, you'll see from the other "Health" pages in Webmaster Tools that your site is otherwise healthy.
Sean most likely didn't know the situation that we have investigated, and thought this was something that we could correct.
I apologize for the inconvenience.
Michael
Facebook
Google+
Twitter
Photo Blog
Michael,
Thank you for your answer thats all I wanted I firm and clear answer on yes or no you can or can't. SmugMug is a great service and has been very good to me over the years. I know that if you could you would fix it so I will trust that this is the truth and move forward from here. Again thank you for you reply and I wish you and SmugMug the best in going forward with any other issues that may come up.
Sincerely,
KO Photography
http://www.k-ophotography.com/
Could Smugmug allow Google to fetch these key resources even though Google has exceeded whatever Smugmug considers acceptable amount of traffic for generally crawling the site?
Thanks!
http://www.desiree-fotografie.nl
We are still not sending errors to Google. This is still entirely on Googles side, unfortunately. I will reiterate again, this has zero effect on actual users seeing your site, or your Google search rank.
Thanks!
Michael
Facebook
Google+
Twitter
Photo Blog