[keycloak-dev] robots.txt

[Stian Thorgersen]

I'm happy with doing both as I can't see any harm in adding it.

On 13 April 2016 at 10:59, Thomas Raehalme <thomas.raehalme at aitiofinland.com
> wrote:

> Yes, but then you'd need to make sure that every theme has them (including
> user-defined themes).
>
> Maybe we can do both?
>
> Best regards,
> Thomas
>
>
> On Wed, Apr 13, 2016 at 11:54 AM, Thomas Darimont <
> thomas.darimont at googlemail.com> wrote:
>
>> Another option would be to use html META-tags to control robot behaviour.
>>
>> http://www.metatags.info/meta_name_robots
>>
>> Cheers,
>> Thomas
>>
>> 2016-04-13 10:52 GMT+02:00 Stian Thorgersen <sthorger at redhat.com>:
>>
>>> Maybe it should be /robots.txt and /auth/robots.txt. The first will
>>> cover the case when Keycloak is exposed directly, while the latter when a
>>> reverse proxy is used (for example auth.example.org --> kc-ip/auth).
>>>
>>> On 13 April 2016 at 10:47, Thomas Raehalme <
>>> thomas.raehalme at aitiofinland.com> wrote:
>>>
>>>> I think it needs to be in the root folder.
>>>>
>>>> Best regards,
>>>> Thomas
>>>>
>>>> On Wed, Apr 13, 2016 at 11:41 AM, Stian Thorgersen <sthorger at redhat.com
>>>> > wrote:
>>>>
>>>>> Is it sufficient to add that to /auth/robots.txt?
>>>>>
>>>>> On 13 April 2016 at 10:17, Thomas Raehalme <
>>>>> thomas.raehalme at aitiofinland.com> wrote:
>>>>>
>>>>>> I think the user is running some Bing browser plugin or desktop
>>>>>> application which loads a page snapshot/preview of whatever links it finds
>>>>>> in user content.
>>>>>>
>>>>>> I created KEYCLOAK-2810 to add robots.txt.
>>>>>> https://issues.jboss.org/browse/KEYCLOAK-2810
>>>>>>
>>>>>> Best regards,
>>>>>> Thomas
>>>>>>
>>>>>>
>>>>>> On Wed, Apr 13, 2016 at 11:11 AM, Stian Thorgersen <
>>>>>> sthorger at redhat.com> wrote:
>>>>>>
>>>>>>> +1
>>>>>>>
>>>>>>> How did it find one-time links?
>>>>>>>
>>>>>>> On 13 April 2016 at 10:07, Thomas Raehalme <
>>>>>>> thomas.raehalme at aitiofinland.com> wrote:
>>>>>>>
>>>>>>>> Hi!
>>>>>>>>
>>>>>>>> What do you think of including robots.txt in the Keycloak
>>>>>>>> distribution to try to avoid Keycloak being indexed?
>>>>>>>>
>>>>>>>> We had a nasty issue with BingPreview trying to load URLs and
>>>>>>>> causing one-time links to be invalidated.
>>>>>>>>
>>>>>>>> Best regards,
>>>>>>>> Thomas
>>>>>>>>
>>>>>>>> _______________________________________________
>>>>>>>> keycloak-dev mailing list
>>>>>>>> keycloak-dev at lists.jboss.org
>>>>>>>> https://lists.jboss.org/mailman/listinfo/keycloak-dev
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>> _______________________________________________
>>> keycloak-dev mailing list
>>> keycloak-dev at lists.jboss.org
>>> https://lists.jboss.org/mailman/listinfo/keycloak-dev
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.jboss.org/pipermail/keycloak-dev/attachments/20160413/b7cc733c/attachment-0001.html