[Opensim-users] Need help with a serious LAG problem

Wed Mar 18 01:38:37 UTC 2015

All I can say is it *looks like* a lot of packet loss or network dropouts.
It probably could be something else but I've not seen logs like that with
properly functioning networks.

On Tue, Mar 17, 2015 at 6:16 PM, Thomas Ringate <tringate at gmail.com> wrote:

>   Just had 6 avatars on the region and when the lag hit and I could not
> move the log had a bunch of these entries.  Eventually everyone could
> finally move after several minutes.  I watched the idle time on the server
> and it never went below 95% so the server never had a busy time.  I am
> stumped.  It looks like my acks to inbound messages are not getting to the
> sending node so they send the same packets over and over again.  Just
> guessing at that.
>
>
> 2015-03-17 20:45:15,896 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #551, type RequestObjectPropertiesFamily
> from Michellie sky
> 2015-03-17 20:45:16,024 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #6717, type AgentAnimation from Sydney
> Idealist
> 2015-03-17 20:45:16,046 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #6718, type AgentAnimation from Sydney
> Idealist
> 2015-03-17 20:45:16,902 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #1491, type AgentAnimation from Rob Stone
> 2015-03-17 20:45:16,969 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #1496, type TransferRequest from Rob
> Stone
> 2015-03-17 20:45:17,079 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #1502, type
> RequestObjectPropertiesFamily from Rob Stone
> 2015-03-17 20:45:17,091 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #1503, type AvatarPropertiesRequest from
> Rob Stone
> 2015-03-17 20:45:17,121 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #1504, type GenericMessage from Rob Stone
> 2015-03-17 20:45:17,587 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #6728, type AgentAnimation from Slow
> Putzo
> 2015-03-17 20:45:17,587 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #6729, type AgentAnimation from Slow
> Putzo
> 2015-03-17 20:45:17,762 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #73, type AgentAnimation from shaun marsh
> 2015-03-17 20:45:17,763 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #74, type TransferRequest from shaun
> marsh
> 2015-03-17 20:45:17,811 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #1272, type
> RequestObjectPropertiesFamily from Rob Stone
> 2015-03-17 20:45:17,813 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #4987, type ImprovedInstantMessage from
> Jessie Campbell
> 2015-03-17 20:45:17,815 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #1280, type
> RequestObjectPropertiesFamily from Rob Stone
> 2015-03-17 20:45:17,993 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #5128, type ImprovedInstantMessage from
> Jessie Campbell
> 2015-03-17 20:45:19,275 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #1297, type AgentAnimation from Rob Stone
> 2015-03-17 20:45:19,306 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #1298, type AgentAnimation from Rob Stone
> 2015-03-17 20:45:19,425 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #625, type AgentAnimation from Michellie
> sky
> 2015-03-17 20:45:19,841 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #1301, type GenericMessage from Rob Stone
> 2015-03-17 20:45:20,657 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #571, type AgentAnimation from Michellie
> sky
> 2015-03-17 20:45:21,822 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #5157, type AgentAnimation from Jessie
> Campbell
> 2015-03-17 20:45:21,822 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #5158, type AgentAnimation from Jessie
> Campbell
> 2015-03-17 20:45:22,015 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #1631, type AgentAnimation from Rob Stone
> 2015-03-17 20:45:22,046 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #5164, type ImprovedInstantMessage from
> Jessie Campbell
> 2015-03-17 20:45:22,314 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #6870, type AgentAnimation from Slow
> Putzo
> 2015-03-17 20:45:22,315 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #6871, type ChatFromViewer from Slow
> Putzo
> 2015-03-17 20:45:22,329 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #6872, type AgentAnimation from Slow
> Putzo
> 2015-03-17 20:45:22,330 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #6873, type ChatFromViewer from Slow
> Putzo
> 2015-03-17 20:45:22,805 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #639, type AgentAnimation from Michellie
> sky
> 2015-03-17 20:45:22,847 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #1654, type
> RequestObjectPropertiesFamily from Rob Stone
> 2015-03-17 20:45:23,301 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #1672, type
> RequestObjectPropertiesFamily from Rob Stone
> 2015-03-17 20:45:23,665 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #645, type RequestObjectPropertiesFamily
> from Michellie sky
> 2015-03-17 20:45:24,064 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #1712, type
> RequestObjectPropertiesFamily from Rob Stone
> 2015-03-17 20:45:24,096 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #5188, type ImprovedInstantMessage from
> Jessie Campbell
> 2015-03-17 20:45:24,246 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #1724, type
> RequestObjectPropertiesFamily from Rob Stone
> 2015-03-17 20:45:24,547 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #6621, type AgentAnimation from Sydney
> Idealist
> 2015-03-17 20:45:24,893 DEBUG -
> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
> resend of already processed packet #6914, type ParcelPropertiesRequest from
> Slow Putzo
>
>  *From:* Dahlia Trimble <dahliatrimble at gmail.com>
> *Sent:* Tuesday, March 17, 2015 8:29 PM
> *To:* opensim-users at opensimulator.org
> *Subject:* Re: [Opensim-users] Need help with a serious LAG problem
>
>  I went there, everything loaded fairly quickly and I didn't notice any
> lag except for a breif moment when I opened the map.
>
> On Tue, Mar 17, 2015 at 5:04 PM, Thomas Ringate <tringate at gmail.com>
> wrote:
>
>>   I am at a loss for where to look for a serious LAG problem on more
>> than one of my regions.
>> I run 3 servers, each run individual instances for the regions they host.
>> Normally things run fairly good but for the past couple of weeks LAG has
>> become a real problem.
>> Today with three avatars on one region we could not move.  I rebooted the
>> server to restart all the regions on it with no help at all for the LAG
>> problem.
>> I then deleted the region,, dropped the database, and restarted it to
>> make it a bump in the ocean kind of region.
>> The three of us returned, and now we could move.  Prior to doing this I
>> turned off scripts and in fact all scripts did stop.  That had no effect on
>> the region at all.
>> I then restored the original region with a database restore and went to
>> the region alone.  Everything was just fine.  I then asked one of the
>> people to return and as soon as that avatar started to arrive with the
>> white puff of smoke I was frozen and could not move.  After about five
>> minutes, and she has rezzed, we once again could both move about.  We asked
>> the third person to come back and at that point all avatars were frozen in
>> place and it took almost 10 minutes before we could move at all.
>> Unfortunately once we started to move we could not stop.
>>
>> I decided to use the return objects function in “about land” to clear the
>> region and it took forever for that function to even display the lines
>> where you could return objects.  I finally succeeded in returning all the
>> objects, but that did not solve the lag problem.  The region now did not
>> have a single prime on it.
>>
>> It was then I decided to look at the log file and see if anything there
>> might tell me what was going on.
>>
>> I see hundreds of the following types of messages in the log file as each
>> avatar arrived.
>>
>> 2015-03-17 17:47:20,867 DEBUG -
>> OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
>> resend of already processed packet #24386, type AgentCachedTexture from
>> lila stone
>>
>> Page after page of them.  This tells me something must be going wrong
>> with my internet but what?  Everything else works just fine.  Both the
>> other things running on the servers, and the many devices we have in our
>> home using the internet.  We have Verizon FIOS 75/75 so we have plenty of
>> speed.  My opensim ran perfectly on my old roadrunner service back a few
>> years ago and that was a 3mb service.  Hard to say what speed I had on the
>> outbound packets.
>>
>> I need help looking for what is causing this problem but do not know
>> where to start.
>>
>> Other symptoms of the problem are when you type into chat and it takes
>> 20-30 seconds to appear in the chat window.  I see many timeouts with
>> communications to OSgrid as well.
>>
>> Today the LAG was not just on my regions, I went to wright plaza but
>> could never actually arrive, the viewer simply closed down as I arrived and
>> I saw a brief glimpse of the plaza.  I went to some other plaza, can’t
>> remember its name and could hardly move there either.
>>
>> Other people are not having this problem it appears, so it is focused on
>> anything that is using my internet connection I believe.  I have not
>> changed anything for over two years, no hardware, or configuration settings.
>>
>> HELP what do I look for?
>>
>> Oh yes, the servers are 8 core AMD machines with 8GB ram with only 35% of
>> memory used.  Looking at “top” they are not even loafing let alone busy.
>> Right now it says the server I have the really bad region running on is
>> 97% idle.
>>
>> If someone wants to experience it for themselves, go to Tranquil Bay, it
>> is the worst of the land regions I am running and the one we worked with
>> today.  It has around 7,000 prims on it.  That is less than most of my
>> regions.
>>
>> Tom
>>
>>
>>
>>
>> _______________________________________________
>> Opensim-users mailing list
>> Opensim-users at opensimulator.org
>> http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users
>>
>>
>
> ------------------------------
> _______________________________________________
> Opensim-users mailing list
> Opensim-users at opensimulator.org
> http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users
>
>
> _______________________________________________
> Opensim-users mailing list
> Opensim-users at opensimulator.org
> http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://opensimulator.org/pipermail/opensim-users/attachments/20150317/3b85991d/attachment-0001.html>