The purpose of the Robots TXT File is to dissuade automated search engine bots from crawling certain website directories.
In old versions of Joomla! CMS, the Robots TXT File dissuaded bots from crawling these three directories:
- images,
- media,
- templates
by inserting three lines of text in the default Robots TXT File:
- Disallow: /images/
- Disallow: /media/
- Disallow: /templates/
resulting in bots not crawling a website's media content and verifying its mobile-friendliness.
Unfortunately, the Joomla! CMS update process does not overwrite the existing Robots TXT File.
So if your website was updated from an older version of Joomla! you should check its Robots TXT File.
You can do this via the File Manager screen of your website's Hosting Control Panel.
If you see the above three lines, remove them to improve your website's visibility in search results.
Read more: Search Engine Friendly Robots TXT File.
Make SEO your #1 priority after Joomla! CMS Security
We help and support managers responsible for Joomla! CMS websites in UK business and third sector organisations across Cheshire, Greater Manchester, Merseyside and North West England.
Personal Joomla! CMS Help and Support.
Disclaimer
We do not guarantee that your website's performance in search engines will improve as a result of making any one change to your website's structure, navigation or content.
No-one can provide such a guarantee.






