XenForo Robots.txt is not accessible or doesn't exist

J

JasonBrody

Guest
Hi All,
Though I had never checked it earlier, the concern was raised after I changed my hosting.
Recently, Google Console has not been indexing my site, and its sitemap has also not been read since the last few weeks.
I am getting robots blocked and redirection error messages too.

When I checked for robots.txt file (ex: https://yourdomain.com/robots.txt ) then found that it doesn't exist/accessible. What should I do? By default, the XenForo package doesn't provide any robots.txt...

Read more

Continue reading...