Thursday, November 15, 2018

joomla Forgot your username? page indexed

To get to a customer’s site I Googled it and discovered the User name and Password reset pages are being indexed by Google. They show up as some of the top results.

I quickly came across the following article that lead me to the work on the Robots.txt file and disallowing these pages.

https://forum.joomla.org/viewtopic.php?t=903096

For my site I had to add the following:

Disallow: /component/users/

Then go to Google Webmaster Tools and and Fetch the site. This will inform Google you want your site crawled again.

I hope this helps someone else out there…

Follow up…

I stumbled on this article which further refines the access.

https://moz.com/community/q/robots-txt-how-to-exclude-sub-directories-correctly

His technique:

allow: /directory/$
disallow: /directory/*

Which allows this URL:

http://www.mysite.com/directory/

But doesn’t allow the following one:

http://www.mysite.com/directory/sub-directory2/…

0 Comments

Leave a Reply

XHTML: You can use these tags: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>