# If the Joomla site is installed within a folder such as at # e.g. www.example.com/joomla/ the robots.txt file MUST be # moved to the site root at e.g. www.example.com/robots.txt # AND the joomla folder name MUST be prefixed to the disallowed # path, e.g. the Disallow rule for the /administrator/ folder # MUST be changed to read Disallow: /joomla/administrator/ # # For more information about the robots.txt standard, see: # http://www.robotstxt.org/orig.html # # For syntax checking, see: # http://tool.motoricerca.info/robots-checker.phtml # See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # This robots.txt file is not used. Please append the content below in the robots.txt file located at the root # User-agent: mauibot Disallow: /forum/ User-agent: semrushbot Disallow: /forum/ User-agent: ahrefsbot Disallow: /forum/ User-agent: blexbot Disallow: /forum/ User-agent: seo spider Disallow: /forum/ User-agent: * Disallow: /forum/admin/ Disallow: /forum/auth/ Disallow: /forum/assets/browser-update*.js Disallow: /forum/email/ Disallow: /forum/session Disallow: /forum/user-api-key Disallow: /forum/*?api_key* Disallow: /forum/*?*api_key* Disallow: /forum/badges Disallow: /forum/my Disallow: /forum/search Disallow: /forum/tag/*/l Disallow: /forum/g Disallow: /forum/t/*/*.rss Disallow: /forum/c/*.rss Disallow: /administrator/ Disallow: /bin/ allow: /cache/ Disallow: /cli/ Disallow: /components/ Disallow: /includes/ Disallow: /installation/ Disallow: /language/ Disallow: /layouts/ Disallow: /libraries/ Disallow: /logs/ Disallow: /modules/ Disallow: /plugins/ Disallow: /tmp/ User-agent: Googlebot Disallow: /forum/admin/ Disallow: /forum/auth/ Disallow: /forum/assets/browser-update*.js Disallow: /forum/email/ Disallow: /forum/session Disallow: /forum/user-api-key Disallow: /forum/*?api_key* Disallow: /forum/*?*api_key*