joomla Forgot your username? page indexed

To get to a customer’s site I Googled it and discovered the User name and Password reset pages are being indexed by Google. They show up as some of the top results.

I quickly came across the following article that lead me to the work on the Robots.txt file and disallowing these pages.

https://forum.joomla.org/viewtopic.php?t=903096

For my site I had to add the following:

Disallow: /component/users/

Then go to Google Webmaster Tools and and Fetch the site. This will inform Google you want your site crawled again.

I hope this helps someone else out there…

Follow up…

I stumbled on this article which further refines the access.

https://moz.com/community/q/robots-txt-how-to-exclude-sub-directories-correctly

His technique:

allow: /directory/$
disallow: /directory/*

Which allows this URL:

http://www.mysite.com/directory/

But doesn’t allow the following one:

http://www.mysite.com/directory/sub-directory2/…

This entry was posted in Joomla, Robots.txt, Security. Bookmark the permalink.

Leave a Reply

Your email address will not be published. Required fields are marked *