Robots TXT File
The purpose of the robots.txt file is to enable you to control which parts of your website can and cannot be browsed by search engine bots.
Prior to Joomla! 3.3.0 the robots.txt file distributed with the Joomla! CMS was configured slightly differently to later versions of the Joomla! CMS.
When Joomla! 3.3.0 was released, the configuration of the robots.txt file changed to improve the performance of Joomla! websites in mobile search results.
The change resulted in search bots no longer being denied access to the following directories:
- images,
- media,
- templates.
Why you should check your website's ROBOTS.TXT file
Without access to the above directories the search engine bots cannot see that your website is mobile-friendly.
Why should you check?
If your website started life using a version of the Joomla! CMs prior to Joomla! 3.3.0, you will need to manually change the robots.txt file.
Reason: the robots.txt file was not automatically updated when updating from an older version of Joomla!
How can you change the robots.txt file?
You can edit the robots.txt file via the File Manager screen of your Hosting Control Panel.
SUBSCRIBERS
Sign in to read complete article.
Make SEO your #1 priority after Joomla! CMS Security
Good SEO is underpinned by good website security. If your website is compromised then it will be de-listed by the search engines, undermining all your hard work!
