#4553 Please hide the Pulp wiki from the public
Closed: Fixed None Opened 9 years ago by rbarlow.

= bug description =
We have a very old Wiki hosted by fedorahosted.org[0]. Since the days of that wiki, we have moved all of our documentation to Read The Docs. We have also significantly altered our APIs and CLIs. Unfortunately, our old wiki is being found by users and they often are lead astray by the misinformation. We have a bug[1] about fixing this problem.

We do not wish to shut down the wiki, however, as we would like to maintain the historical information for a select few Pulp 1.0 users.

= fix recommendation =

I have two ideas for how we could fix this problem.

0) We could add a disallow rule to your robots.txt file[2]. This would stop search engines from providing old links to new users, and I believe it would effectively solve the issue while also letting us keep the old wiki public for those select few Pulp 1.0 users to reference (they can bookmark it).

1) If the first idea is too big of an ask, it may be possible to solve this problem by altering our trac instance to require authentication to read the wiki. Is that possible? We could require those select few users to have fedora accounts in order to read the wiki, and this would also stop search engines from indexing our wiki.

Of course, if you have any other ideas on how we can solve our problem, we would love to consider them as well. Thank you!

[0] https://fedorahosted.org/pulp/wiki
[1] https://bugzilla.redhat.com/show_bug.cgi?id=988522
[2] https://fedorahosted.org/robots.txt


ok. I have added it to robots.txt.

Please let us know if you need anything further or see any adjustments we need to make.

Hello! I've noticed that the robots.txt seems to be empty at https://fedorahosted.org/robots.txt. Can you restore it to how it used to be, including hiding our Pulp wiki? Thanks!

Strange. I see it there just fine.

Could it be you hit it when puppet was replacing the file or something?

You are correct, it's showing up again. I'm not sure what the explanation is, but I suppose that is possible. For what it's worth, I was able to see that it was blank (and not a 404) with Firefox and curl.

Thanks for looking!

Login to comment on this ticket.

Metadata