<div dir="ltr">All I can say is it *looks like* a lot of packet loss or network dropouts. It probably could be something else but I've not seen logs like that with properly functioning networks.<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Mar 17, 2015 at 6:16 PM, Thomas Ringate <span dir="ltr"><<a href="mailto:tringate@gmail.com" target="_blank">tringate@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">
<div dir="ltr">
<div style="FONT-SIZE:12pt;FONT-FAMILY:'Calibri';COLOR:#000000">
<div>Just had 6 avatars on the region and when the lag hit and I could not move
the log had a bunch of these entries. Eventually everyone could finally
move after several minutes. I watched the idle time on the server and it
never went below 95% so the server never had a busy time. I am
stumped. It looks like my acks to inbound messages are not getting to the
sending node so they send the same packets over and over again. Just
guessing at that.</div>
<div> </div>
<div> </div>
<div>2015-03-17 20:45:15,896 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #551, type RequestObjectPropertiesFamily from
Michellie sky</div>
<div>2015-03-17 20:45:16,024 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #6717, type AgentAnimation from Sydney
Idealist</div>
<div>2015-03-17 20:45:16,046 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #6718, type AgentAnimation from Sydney
Idealist</div>
<div>2015-03-17 20:45:16,902 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #1491, type AgentAnimation from Rob
Stone</div>
<div>2015-03-17 20:45:16,969 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #1496, type TransferRequest from Rob
Stone</div>
<div>2015-03-17 20:45:17,079 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #1502, type RequestObjectPropertiesFamily
from Rob Stone</div>
<div>2015-03-17 20:45:17,091 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #1503, type AvatarPropertiesRequest from Rob
Stone</div>
<div>2015-03-17 20:45:17,121 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #1504, type GenericMessage from Rob
Stone</div>
<div>2015-03-17 20:45:17,587 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #6728, type AgentAnimation from Slow
Putzo</div>
<div>2015-03-17 20:45:17,587 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #6729, type AgentAnimation from Slow
Putzo</div>
<div>2015-03-17 20:45:17,762 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #73, type AgentAnimation from shaun
marsh</div>
<div>2015-03-17 20:45:17,763 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #74, type TransferRequest from shaun
marsh</div>
<div>2015-03-17 20:45:17,811 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #1272, type RequestObjectPropertiesFamily
from Rob Stone</div>
<div>2015-03-17 20:45:17,813 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #4987, type ImprovedInstantMessage from
Jessie Campbell</div>
<div>2015-03-17 20:45:17,815 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #1280, type RequestObjectPropertiesFamily
from Rob Stone</div>
<div>2015-03-17 20:45:17,993 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #5128, type ImprovedInstantMessage from
Jessie Campbell</div>
<div>2015-03-17 20:45:19,275 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #1297, type AgentAnimation from Rob
Stone</div>
<div>2015-03-17 20:45:19,306 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #1298, type AgentAnimation from Rob
Stone</div>
<div>2015-03-17 20:45:19,425 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #625, type AgentAnimation from Michellie
sky</div>
<div>2015-03-17 20:45:19,841 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #1301, type GenericMessage from Rob
Stone</div>
<div>2015-03-17 20:45:20,657 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #571, type AgentAnimation from Michellie
sky</div>
<div>2015-03-17 20:45:21,822 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #5157, type AgentAnimation from Jessie
Campbell</div>
<div>2015-03-17 20:45:21,822 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #5158, type AgentAnimation from Jessie
Campbell</div>
<div>2015-03-17 20:45:22,015 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #1631, type AgentAnimation from Rob
Stone</div>
<div>2015-03-17 20:45:22,046 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #5164, type ImprovedInstantMessage from
Jessie Campbell</div>
<div>2015-03-17 20:45:22,314 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #6870, type AgentAnimation from Slow
Putzo</div>
<div>2015-03-17 20:45:22,315 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #6871, type ChatFromViewer from Slow
Putzo</div>
<div>2015-03-17 20:45:22,329 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #6872, type AgentAnimation from Slow
Putzo</div>
<div>2015-03-17 20:45:22,330 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #6873, type ChatFromViewer from Slow
Putzo</div>
<div>2015-03-17 20:45:22,805 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #639, type AgentAnimation from Michellie
sky</div>
<div>2015-03-17 20:45:22,847 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #1654, type RequestObjectPropertiesFamily
from Rob Stone</div>
<div>2015-03-17 20:45:23,301 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #1672, type RequestObjectPropertiesFamily
from Rob Stone</div>
<div>2015-03-17 20:45:23,665 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #645, type RequestObjectPropertiesFamily from
Michellie sky</div>
<div>2015-03-17 20:45:24,064 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #1712, type RequestObjectPropertiesFamily
from Rob Stone</div>
<div>2015-03-17 20:45:24,096 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #5188, type ImprovedInstantMessage from
Jessie Campbell</div>
<div>2015-03-17 20:45:24,246 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #1724, type RequestObjectPropertiesFamily
from Rob Stone</div>
<div>2015-03-17 20:45:24,547 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #6621, type AgentAnimation from Sydney
Idealist</div>
<div>2015-03-17 20:45:24,893 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #6914, type ParcelPropertiesRequest from Slow
Putzo</div><span class="">
<div style="FONT-SIZE:small;TEXT-DECORATION:none;FONT-FAMILY:"Calibri";FONT-WEIGHT:normal;COLOR:#000000;FONT-STYLE:normal;DISPLAY:inline">
<div style="FONT:10pt tahoma">
<div> </div>
<div style="BACKGROUND:#f5f5f5">
<div><b>From:</b> <a title="dahliatrimble@gmail.com" href="mailto:dahliatrimble@gmail.com" target="_blank">Dahlia Trimble</a> </div>
<div><b>Sent:</b> Tuesday, March 17, 2015 8:29 PM</div>
<div><b>To:</b> <a title="opensim-users@opensimulator.org" href="mailto:opensim-users@opensimulator.org" target="_blank">opensim-users@opensimulator.org</a>
</div>
<div><b>Subject:</b> Re: [Opensim-users] Need help with a serious LAG
problem</div></div></div>
<div> </div></div>
</span><div style="FONT-SIZE:small;TEXT-DECORATION:none;FONT-FAMILY:"Calibri";FONT-WEIGHT:normal;COLOR:#000000;FONT-STYLE:normal;DISPLAY:inline"><div><div class="h5">
<div dir="ltr">I went there, everything loaded fairly quickly and I didn't notice
any lag except for a breif moment when I opened the map. <br></div>
<div class="gmail_extra">
<div> </div>
<div class="gmail_quote">On Tue, Mar 17, 2015 at 5:04 PM, Thomas Ringate <span dir="ltr"><<a href="mailto:tringate@gmail.com" target="_blank">tringate@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="PADDING-LEFT:1ex;MARGIN:0px 0px 0px 0.8ex;BORDER-LEFT:#ccc 1px solid">
<div dir="ltr">
<div dir="ltr">
<div style="FONT-SIZE:12pt;FONT-FAMILY:'Calibri';COLOR:#000000">
<div>I am at a loss for where to look for a serious LAG problem on more than
one of my regions.</div>
<div>I run 3 servers, each run individual instances for the regions they
host.</div>
<div>Normally things run fairly good but for the past couple of weeks LAG has
become a real problem.</div>
<div>Today with three avatars on one region we could not move. I
rebooted the server to restart all the regions on it with no help at all for
the LAG problem.</div>
<div>I then deleted the region,, dropped the database, and restarted it to
make it a bump in the ocean kind of region.</div>
<div>The three of us returned, and now we could move. Prior to doing
this I turned off scripts and in fact all scripts did stop. That had no
effect on the region at all.</div>
<div>I then restored the original region with a database restore and went to
the region alone. Everything was just fine. I then asked one of
the people to return and as soon as that avatar started to arrive with the
white puff of smoke I was frozen and could not move. After about five
minutes, and she has rezzed, we once again could both move about. We
asked the third person to come back and at that point all avatars were frozen
in place and it took almost 10 minutes before we could move at all.
Unfortunately once we started to move we could not stop.</div>
<div> </div>
<div>I decided to use the return objects function in “about land” to clear the
region and it took forever for that function to even display the lines where
you could return objects. I finally succeeded in returning all the
objects, but that did not solve the lag problem. The region now did not
have a single prime on it.</div>
<div> </div>
<div>It was then I decided to look at the log file and see if anything there
might tell me what was going on.</div>
<div> </div>
<div>I see hundreds of the following types of messages in the log file as each
avatar arrived.</div>
<div> </div>
<div>2015-03-17 17:47:20,867 DEBUG -
OpenSim.Region.ClientStack.LindenUDP.LLUDPServer [LLUDPSERVER]: Received a
resend of already processed packet #24386, type AgentCachedTexture from lila
stone</div>
<div> </div>
<div>Page after page of them. This tells me something must be going
wrong with my internet but what? Everything else works just fine.
Both the other things running on the servers, and the many devices we have in
our home using the internet. We have Verizon FIOS 75/75 so we have
plenty of speed. My opensim ran perfectly on my old roadrunner service
back a few years ago and that was a 3mb service. Hard to say what speed
I had on the outbound packets.</div>
<div> </div>
<div>I need help looking for what is causing this problem but do not know
where to start.</div>
<div> </div>
<div>Other symptoms of the problem are when you type into chat and it takes
20-30 seconds to appear in the chat window. I see many timeouts with
communications to OSgrid as well.</div>
<div> </div>
<div>Today the LAG was not just on my regions, I went to wright plaza but
could never actually arrive, the viewer simply closed down as I arrived and I
saw a brief glimpse of the plaza. I went to some other plaza, can’t
remember its name and could hardly move there either.</div>
<div> </div>
<div>Other people are not having this problem it appears, so it is focused on
anything that is using my internet connection I believe. I have not
changed anything for over two years, no hardware, or configuration
settings.</div>
<div> </div>
<div>HELP what do I look for?</div>
<div> </div>
<div>Oh yes, the servers are 8 core AMD machines with 8GB ram with only 35% of
memory used. Looking at “top” they are not even loafing let alone
busy.</div>
<div>Right now it says the server I have the really bad region running on is
97% idle.</div>
<div> </div>
<div>If someone wants to experience it for themselves, go to Tranquil Bay, it
is the worst of the land regions I am running and the one we worked with
today. It has around 7,000 prims on it. That is less than most of
my regions.</div>
<div> </div>
<div>Tom</div>
<div> </div>
<div> </div>
<div> </div></div></div></div><br>_______________________________________________<br>Opensim-users
mailing list<br><a href="mailto:Opensim-users@opensimulator.org" target="_blank">Opensim-users@opensimulator.org</a><br><a href="http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users" target="_blank">http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users</a><br><br></blockquote></div>
<div> </div></div>
</div></div><p>
</p><hr><span class="">
_______________________________________________<br>Opensim-users mailing
list<br><a href="mailto:Opensim-users@opensimulator.org" target="_blank">Opensim-users@opensimulator.org</a><br><a href="http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users" target="_blank">http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users</a><br></span><p></p></div></div></div></div>
<br>_______________________________________________<br>
Opensim-users mailing list<br>
<a href="mailto:Opensim-users@opensimulator.org">Opensim-users@opensimulator.org</a><br>
<a href="http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users" target="_blank">http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users</a><br>
<br></blockquote></div><br></div>