[Opensim-users] Googlebot trying OpenSim /agent/<uuid> ?

[Melanie]

Google is not supposed to index Opensim REST endpoints. Google's IP
should be blocked there, it's not an indexable web page.
Else, maybe Opensim should provide robots.txt with a generall "go
away" in it.

Melanie

On 18/08/2014 15:17, Trinity wrote:
> may i suggest making a agents.txt available to feed to the google monster
> 
> 
> On Mon, Aug 18, 2014 at 2:49 AM, Ai Austin <ai.ai.austin at gmail.com> wrote:
> 
>> I mentioned before that occasionally we see red "error" level messages on
>> our OpenSim.exe consoles of this format...
>>
>> [AGENT HANDLER]: method GET not supported in agent message
>> /agent/e24a9015-f5ca-452b-8c95-d32e34cb9d64/, (caller is 66.249.64.223)
>>
>> The UUID is an actual one for an avatar on our grid...
>>
>> The caller is a Google Bot...
>>
>> Name:    crawl-66-249-64-223.googlebot.com
>> Address:  66.249.64.223
>>
>> It looks like its a simple attempt by Google to index pages it find that
>> mention this string in things like OpenSim mantis issue details or
>> comments, OpenSim mailing list web page archives, etc.
>>
>> Should such things be red errors or just warnings?
>>
>> _______________________________________________
>> Opensim-users mailing list
>> Opensim-users at opensimulator.org
>> http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users
>>
> 
> 
> 
> _______________________________________________
> Opensim-users mailing list
> Opensim-users at opensimulator.org
> http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users