[Opensim-users] Help with possible ISP problem

[tringate at gmail.com]

I made a change of ISP’s from “Spectrum” back to “Frontier” a week ago and ever since I have experienced slow response with OSgrid.

My set-up here in my home is near identical for both of the ISP’s and I was on Frontier 2 years ago with no issues.

I have my router connected directly to the Frontier ONT, not to their router.  I have a complete home network running nicely with several access points and all of my servers and do not want their router in the way.  There router is connected to mine as a sub net behind mine so I can still get the on screen display of “caller ID’ and the TV guide on all my TV. Their wifi is turned off and nothing is connected to their router other than the set top boxes.  It is totally isolated from my network and does not use the same class c address range.  My router is using 192.168.1.x and theirs is using 192.168.254.x

Everything works perfectly except OSgrid.

It is NOT loopback because my router supports it flawlessly and has been doing so now for several years.

It is a linksys WRT 1200 AC funning stock firmware.

I am able to login and all my residents say they do not experience any issues at all.

My logs are full of these messages and my performance is very slow for things like login and rezzing.

2018-12-10 12:57:12,329 INFO  [FORMS]: Slow request 10512 POST http://presence.osgrid.org/presence took 8142ms, 0ms writing, 8092
2018-12-10 12:57:12,369 INFO  [LOGHTTP] Slow handling of 547 POST /agent/51ea2036-6c57-817f-7716-59dd5329f7f7/   from 167.114.64.152:33676 took 8222ms
2018-12-10 12:57:23,217 INFO  [FORMS]: Slow request 10516 POST http://users.osgrid.org/accounts took 5785ms, 0ms writing, 5737
2018-12-10 12:57:23,221 INFO  [FORMS]: Slow request 10513 POST http://users.osgrid.org/accounts took 8222ms, 0ms writing, 8171
2018-12-10 12:57:23,227 INFO  [LOGHTTP] Slow handling of 560 GET /CAPS/6e16630f-eec8-43ee-919c-1815bec39592 SimulatorFeatures 51ea2036-6c57-817f-7716-59dd5329f7f7 from 192.168.1.1:61572 took 8235ms
2018-12-10 12:57:31,675 DEBUG [VivoxVoice][PROVISIONVOICE]: scene = OpenSim.Region.Framework.Scenes.Scene, agentID = 51ea2036-6c57-817f-7716-59dd5329f7f7
2018-12-10 12:57:39,870 INFO  [FORMS]: Slow request 10517 POST http://friends.osgrid.org/friends took 8192ms, 0ms writing, 8092
2018-12-10 12:57:40,011 INFO  [LOGHTTP] Slow handling of 560 POST /CAPS/626aa73c-9487-4715-80d0-49e8817cccce0108/ ProvisionVoiceAccountRequest 51ea2036-6c57-817f-7716-59dd5329f7f7 from 192.168.1.1:61571 took 22650ms
2018-12-10 12:57:40,109 DEBUG [LLUDPSERVER]: Client created, processing pending queue, 20 entries
2018-12-10 12:57:40,114 DEBUG [LLUDPSERVER]: Received a resend of already processed packet #1, type AgentFOV from Slow Putzo
2018-12-10 12:57:40,115 DEBUG [LLUDPSERVER]: Received a resend of already processed packet #2, type UseCircuitCode from Slow Putzo
2018-12-10 12:57:40,115 DEBUG [LLUDPSERVER]: Received a resend of already processed packet #2, type UseCircuitCode from Slow Putzo
2018-12-10 12:57:40,116 DEBUG [LLUDPSERVER]: Received a resend of already processed packet #1, type AgentFOV from Slow Putzo
Then thousands of these messages with normal stuff interspersed between them.
2018-12-10 12:58:39,703 WARN  [CLIENT]: Unhandled packet AgentUpdate from Slow Putzo (root ) in Sanctuary.  Ignoring.
2018-12-10 12:58:39,838 WARN  [CLIENT]: Unhandled packet AgentUpdate from Slow Putzo (root ) in Sanctuary.  Ignoring.
2018-12-10 12:58:39,987 WARN  [CLIENT]: Unhandled packet AgentUpdate from Slow Putzo (root ) in Sanctuary.  Ignoring.
2018-12-10 12:58:40,168 WARN  [CLIENT]: Unhandled packet AgentUpdate from Slow Putzo (root ) in Sanctuary.  Ignoring.
2018-12-10 12:58:40,283 WARN  [CLIENT]: Unhandled packet AgentUpdate from Slow Putzo (root ) in Sanctuary.  Ignoring.
2018-12-10 12:58:40,405 WARN  [CLIENT]: Unhandled packet AgentUpdate from Slow Putzo (root ) in Sanctuary.  Ignoring.
2018-12-10 12:58:40,538 WARN  [CLIENT]: Unhandled packet AgentUpdate from Slow Putzo (root ) in Sanctuary.  Ignoring.
2018-12-10 12:58:40,667 WARN  [CLIENT]: Unhandled packet AgentUpdate from Slow Putzo (root ) in Sanctuary.  Ignoring.
such as this:
2018-12-10 12:58:43,501 WARN  [CLIENT]: Unhandled packet AgentUpdate from Slow Putzo (root ) in Sanctuary.  Ignoring.
2018-12-10 12:58:43,623 WARN  [CLIENT]: Unhandled packet AgentUpdate from Slow Putzo (root ) in Sanctuary.  Ignoring.
2018-12-10 12:58:43,717 INFO  [FORMS]: Slow request 10528 POST http://tsim.us.to:9182/friends took 8059ms, 0ms writing, 8057
2018-12-10 12:58:43,751 WARN  [CLIENT]: Unhandled packet AgentUpdate from Slow Putzo (root ) in Sanctuary.  Ignoring.
2018-12-10 12:58:43,867 WARN  [CLIENT]: Unhandled packet AgentUpdate from Slow Putzo (root ) in Sanctuary.  Ignoring.
2018-12-10 12:58:43,887 INFO  [FORMS]: Slow request 10526 POST http://plaza11.osgrid.org:7011/friends took 8282ms, 0ms writing, 8233
2018-12-10 12:58:43,994 WARN  [CLIENT]: Unhandled packet AgentUpdate from Slow Putzo (root ) in Sanctuary.  Ignoring.
2018-12-10 12:58:44,116 WARN  [CLIENT]: Unhandled packet AgentUpdate from Slow Putzo (root ) in Sanctuary.  Ignoring.
2018-12-10 12:58:44,152 INFO  [FORMS]: Slow request 10529 POST http://mjserver.dynv6.net:9000/friends took 8440ms, 0ms writing, 8297
2018-12-10 12:58:44,233 WARN  [CLIENT]: Unhandled packet AgentUpdate from Slow Putzo (root ) in Sanctuary.  Ignoring.
2018-12-10 12:58:44,344 WARN  [CLIENT]: Unhandled packet AgentUpdate from Slow Putzo (root ) in Sanctuary.  Ignoring.
2018-12-10 12:58:44,466 WARN  [CLIENT]: Unhandled packet AgentUpdate from Slow Putzo (root ) in Sanctuary.  Ignoring.
Then my log off looks like this:
2018-12-10 13:06:07,143 WARN  [LLUDPSERVER]: No packets received from root agent of Slow Putzo for 300000ms in Sanctuary.  Disconnecting.
2018-12-10 13:06:07,649 DEBUG [CLIENT]: Close has been called for Slow Putzo attached to scene Sanctuary
2018-12-10 13:06:15,844 INFO  [FORMS]: Slow request 10716 POST http://users.osgrid.org/griduser took 8168ms, 0ms writing, 8058
2018-12-10 13:06:24,200 INFO  [FORMS]: Slow request 10717 POST http://presence.osgrid.org/presence took 8352ms, 0ms writing, 8302
2018-12-10 13:06:27,580 DEBUG [JobEngine] Stopping AsyncInUDP-51ea2036-6c57-817f-7716-59dd5329f7f7
2018-12-10 13:06:27,583 DEBUG [SCENE]: Removing root agent Slow Putzo 51ea2036-6c57-817f-7716-59dd5329f7f7 from Sanctuary
2018-12-10 13:06:27,586 DEBUG [CAPS]: Remove caps for agent 51ea2036-6c57-817f-7716-59dd5329f7f7 in region Sanctuary
2018-12-10 13:06:36,022 INFO  [FORMS]: Slow request 10719 POST http://grid.osgrid.org/grid took 8341ms, 0ms writing, 8287
2018-12-10 13:06:44,194 INFO  [FORMS]: Slow request 10721 POST http://plaza11.osgrid.org:7011/friends took 8170ms, 0ms writing, 8121
2018-12-10 13:06:44,201 INFO  [FORMS]: Slow request 10723 POST http://tsim.us.to:9182/friends took 8116ms, 0ms writing, 8114
2018-12-10 13:06:44,547 INFO  [FORMS]: Slow request 10724 POST http://mjserver.dynv6.net:9000/friends took 8420ms, 1ms writing, 8278
2018-12-10 13:07:16,943 ERROR [WATCHDOG]: Timeout detected for thread "Heartbeat-(Sanctuary)". ThreadState=WaitSleepJoin. Last tick was 6604ms ago.  
2018-12-10 13:07:18,859 DEBUG [Scene] The avatar has left the building

The only thing that changed is now I have 200Mbs up and down load speeds, and a new IP address.  Everything is lightening fast other than OSgrid connections.

I can’t see anything wrong with my configuration, and none of the address or names have changed for my servers.  No port forwarding changes needed to be made.

My standalone works perfectly both from inside my LAN and outside my LAN.

The issue only shows up when I try to connect to my regions that are on OSgrid.  I can login to other regions without any of these errors.

It sounds like the classic “loopback” problem, but it is not.  If it was not doing loopback nothing would work inside my LAN like my FTP site and the many web sites I host.  They all work perfectly as does my opensim standalone I use for development and testing.

I am sure it’s something I am just overlooking because this exact setup worked just fine on Frontier 2 years ago and worked fine on Spectrum for the past 2 years.

I’m stumped what is causing this and thought the log messages might give someone who knows the inner workings of opensim  a clue what I have setup wrong.

I do have opensim running the most recent opensim OSgrid release.

Tom