Recent changes to 11: stop robots from indexing

#11 stop robots from indexing

TheSatinKnight — Wed, 24 Feb 2016 22:22:50 -0000

status: open --> wont-fix

#11 stop robots from indexing

TheSatinKnight — Wed, 24 Feb 2016 22:22:09 -0000

They would not have the ACCESS=??? parameter. Unless you put a link to it somewhere that is indexed. By the same token, if you put a user/password into a link (bob:god@website.com), they will index that. Avoid putting the access code in a searchable link.

Also: If you tell robots not to search it, then the "follow the rules" robots won't search it. But the bad guys will. So you'll NOT see your ACCESS code on google, but it will be "out there" invisibly. I'd prefer it be visible. Easily added by those who are security conscious.

This security system is not really meant to be used anyway: It's just a way to change a value to TRUE if access should be granted. Any other method (from LDAP to simple DB lookup or even Facebook OpenID) will work.

Sorry: Not going to add nobots as a universal thing to a page that should never be visible. If someone puts this on a public website where robotting will happen ... I have to assume they want public access for the DB link. Could be useful as a viewer.

stop robots from indexing

Andrew Ziem — Wed, 24 Feb 2016 21:23:29 -0000

Please add this HTML to stop robots from indexing the page. It seems in theory they would index it even with the secret ACCESS=XXXX parameter

<meta name=”robots” content=”noindex,nofollow”>

stop robots from indexing

Andrew Ziem — Wed, 24 Feb 2016 21:23:29 -0000

Ticket 11 has been modified: stop robots from indexing
Edited By: TheSatinKnight (williamconley)
Status updated: u'open' => u'wont-fix'