Check your ROBOTS.TXT file is not undermining SEO

joomla support cheshire manchester merseyside north west ukThe purpose of the robots.txt file is to enable you to control which parts of your website can and cannot be browsed by search engine bots.

Prior to Joomla! 3.3.0 the robots.txt file distributed with the Joomla! CMS was configured slightly differently to later versions of the Joomla! CMS.

When Joomla! 3.3.0 was released, the configuration of the robots.txt file changed to improve the performance of Joomla! websites in mobile search results.

The change resulted in search bots no longer being denied access to the following directories:

  • images,
  • media,
  • templates. 

Reason: to improve SEO

Without access to the above directories the search engine bots cannot see that your website is mobile-friendly.

Why should you check?

If your website started life using a version of the Joomla! CMs prior to Joomla! 3.3.0, you will need to manually change the robots.txt file.

Reason: the robots.txt file was not automatically updated when updating from an older version of Joomla!

How can you change the robots.txt file?

You can edit the robots.txt file via the File Manager screen of your Hosting Control Panel.


XML Site Maps and the robots.txt file

If your website has one or more XML site maps then we also recommend that you add references to them in the robots.txt file to help the search engine bots find them.

Read more: WYNCHCO SEO Guide.


PERSONAL & LOCAL Joomla! CMS Support

We coach, help and support managers with responsibility for Joomla! websites in organisations across Cheshire, Manchester, Merseyside, North West England & the UK.

Read more: WYNCHCO Joomla! CMS Support.



Whilst Wynchcote Limited can offer advice for how to improve your search engine ranking, we do not offer any guarantees that your rankings will improve as a result of this advice.