disallowed by robot.txt

94lincoln

I was using a third party software program (siteliner.com) to analyze my website (www.smilestogophotobooth.net) and got the following error message "The home page for this site is disallowed by robots.txt, please allow it for User-agent: Siteliner". My site setting for Discovery /visibility / google has always been yes. I am pretty sure Google is able to read my site. I have a sence maybe Bing and Yahoo can't What can I change relating to the Robot.txt to make the site more visible?

Hikin' Mike

You don't have any control about editing your robots.txt file.

Your site is indexed on Bing....using 'site:www.smilestogophotobooth.net' in Bing.

leftquark

Your robots.txt should be all setup properly, since you haven't set a sitewide password. I assume siteliner is just having issues, especially since they want you to add code to specifically call out their site. That sounds a little fishy to me. Search engines should see your site!

CHRISRIEFENBERG

Hey @leftquark i have commented under a similar topic about the robot.txt

My question is: I had a sitewide password set for two weeks or so while i was still working on my website.
So do i simply have to wait now until the robots.txt allows the Homepage Meta Description again for the google search results?

Thanks for your feedback.

My site: www.chrisriefenberg.com

leftquark

Yep - when you set a site password we set the robots.txt to disallow search engines. When you remove the site password, we allow search bots to index again. So things should update on Google once it re-indexes your site.

CHRISRIEFENBERG

Thanks a lot for the response. Thats good to know.

Best wishes

Chris