[11:09 AM] Vincent.Sylvester @hg.zetaworlds.com: Andrew
[11:11 AM] woodenbarstool1: This is a Andrew's private Chair
[11:11 AM] woodenbarstool1: This is a Andrew's private Chair
[11:11 AM] Ubit Umarov: hmm some issue getting yr inv andrew.Hellershanks
[11:12 AM] Andrew.Hellershanks @grid.kitely.com:8002: Hm... not sure how I got here. I'm not me so the chair isn't letting me have my usual seat. :P
[11:12 AM] Vincent.Sylvester @hg.zetaworlds.com: I teleported you
[11:12 AM] Andrew.Hellershanks @grid.kitely.com:8002: ok. Thanks, Vincent.
[11:12 AM] Lyr.Lobo @cc.opensimulator.org:8002: .me grins
[11:12 AM] Lyr.Lobo @vharmonyartshub.com:8002: smooth too
[11:13 AM] Lyr.Lobo @cc.opensimulator.org:8002: Hiya Cuga
[11:13 AM] Lyr.Lobo @vharmonyartshub.com:8002: setting up my research Lyr
[11:14 AM] Ubit Umarov: well about code changes during last week
[11:14 AM] Andrew.Hellershanks @grid.kitely.com:8002: If Firestorm sees you are using a different network connection it forgets all your saved login information. I was having problems trying to get logged back in directly to osgrid.
[11:14 AM] Ubit Umarov: i did revert assets store web timeout back to 30s
[11:15 AM] Ubit Umarov: also made a little change avoid store of new assets of attachments that had no change on logout
[11:16 AM] Vincent.Sylvester @hg.zetaworlds.com: Still no clue why those were taking so long that it ran into the timeout in the first place. There seems to be no indication and I got nothing in logs on the server end, so it's almost like it is some socket issue
[11:17 AM] Vincent.Sylvester @hg.zetaworlds.com: It's very warm so thinking is difficult
[11:17 AM] Ubit Umarov: you should replace you sockets at least once per year
[11:17 AM] Ubit Umarov: :p
[11:17 AM] Vincent.Sylvester @hg.zetaworlds.com: I just had one break
[11:18 AM] Vincent.Sylvester @hg.zetaworlds.com: Since the change the number has gone down though so more stuff is making it through. Still strange that it would just pop up like this
[11:18 AM] Vincent.Sylvester @hg.zetaworlds.com: There is the asset server change I did, but that was months ago and all the reports came in over the course of two weeks
[11:18 AM] Vincent.Sylvester @hg.zetaworlds.com: Something triggered it, but no clue what
[11:19 AM] Vincent.Sylvester @hg.zetaworlds.com: Even more weird is that the failures show up after a restart when the scene should be stale
[11:22 AM] Vincent.Sylvester @hg.zetaworlds.com: There is also the part that none of the store routines failing is handled farther up the code chains, so a failure results in desync which then ultimately led to bad information entered into inventory
[11:22 AM] Vincent.Sylvester @hg.zetaworlds.com: That's a bigger task though. Retry routines need care in design less they overload things
[11:22 AM] Ubit Umarov: hi pretty dino
[11:22 AM] Vincent.Sylvester @hg.zetaworlds.com: I am also not sure if some of these can even handle a failure gracefully given the response they have to provide to other things or the viewer
[11:23 AM] Vincent.Sylvester @hg.zetaworlds.com: A brain teaser for when it's less boiling
[11:24 AM] Andrew.Hellershanks @grid.kitely.com:8002: That is going to be fun to track down.
[11:25 AM] Vincent.Sylvester @hg.zetaworlds.com: Especially since I have nothing on the server end, no socket closed or anything, it's as if it fails to connect on the client side
[11:25 AM] Vincent.Sylvester @hg.zetaworlds.com: But it runs into a timeout awaiting response so it must have established something
[11:27 AM] Vincent.Sylvester @hg.zetaworlds.com: Setting up more logging and slowing the machine, get timeouts again, yeah this will be fun to figure out
[11:28 AM] Ubit Umarov: yeah fun debug :)
[11:28 AM] Vincent.Sylvester @hg.zetaworlds.com: I also still haven't gotten any further with the other requests being sent
[11:28 AM] Vincent.Sylvester @hg.zetaworlds.com: Lots of activity on assets that seems to come from nowhere
[11:28 AM] Vincent.Sylvester @hg.zetaworlds.com: Asset archeology lol
[11:30 AM] Ubit Umarov: oh we have lyr virtual sister here today :)
[11:30 AM] Jagga.Meridith @hg.zetaworlds.com: news on the documentation end
[11:30 AM] Jagga.Meridith @hg.zetaworlds.com: builit a server at osimdev.org
[11:31 AM] Jagga.Meridith @hg.zetaworlds.com: it's got a wiki acessible from the front page
[11:31 AM] Ubit Umarov: cool
[11:32 AM] Jagga.Meridith @hg.zetaworlds.com: and a grid with a region at http://osimdev.org:8002
[11:32 AM] Lyr.Lobo @cc.opensimulator.org:8002: /me chuckles
[11:32 AM] Lyr.Lobo @vharmonyartshub.com:8002: caught me organizing my inventory
[11:33 AM] Ubit Umarov: oh so the errors in seen on console may had been from you not andrew.Hellershanks
[11:33 AM] Jagga.Meridith @hg.zetaworlds.com: so far I've got an overview, the data dictionary, ...
[11:33 AM] Ubit Umarov: (possible suitcase things.. no idea )
[11:33 AM] Cuga.Rajal @rajal.org:9000: That URL is blank to me
[11:34 AM] Cuga.Rajal @rajal.org:9000: Oh thats not the documentation URL
[11:34 AM] Ubit Umarov: it is a region/grid not site
[11:34 AM] Cuga.Rajal @rajal.org:9000: ah ok
[11:34 AM] Ubit Umarov: .. the 8002
[11:34 AM] Jagga.Meridith @hg.zetaworlds.com: the connectors, services
[11:35 AM] Jagga.Meridith @hg.zetaworlds.com: more coming
[11:35 AM] Cuga.Rajal @rajal.org:9000: Got it. https://osimdev.org/wiki/index.php/Main_Page
[11:35 AM] Jagga.Meridith @hg.zetaworlds.com: the website is osimdev.org, wikiisa link
[11:35 AM] Cuga.Rajal @rajal.org:9000: thx
[11:36 AM] Jagga.Meridith @hg.zetaworlds.com: will have signup page for grid at bottom link later today
[11:37 AM] Jagga.Meridith @hg.zetaworlds.com: opensimulator.org has been up and down for me
[11:38 AM] Jagga.Meridith @hg.zetaworlds.com: building from code
[11:38 AM] Andrew.Hellershanks @grid.kitely.com:8002: os.org has been having issues again? Hm... I had changed the configuration of the web page last week. I was hoping that would make it more reliable.
[11:39 AM] Jagga.Meridith @hg.zetaworlds.com: it was good last night
[11:39 AM] Ubit Umarov: it did answer just now
[11:39 AM] Jagga.Meridith @hg.zetaworlds.com: are we using FreeSwitchService?
[11:40 AM] Ubit Umarov: no idea if anyone is using it
[11:40 AM] Ubit Umarov: should work.. but no reports
[11:40 AM] Vincent.Sylvester @hg.zetaworlds.com: Andrew, setup a cronjob, daily reboot, crowbar approach
[11:40 AM] Ubit Umarov: ofc only the great phone codec of 70's
[11:41 AM] Cuga.Rajal @rajal.org:9000: or just kill and respawn httpd
[11:42 AM] Jagga.Meridith @hg.zetaworlds.com: that;s all I;ve got, anybody need something tested? there will be two regions side by side
[11:42 AM] Ubit Umarov: :)
[11:43 AM] Vincent.Sylvester @hg.zetaworlds.com: I haven't heard anything from the postgres changes, flying mostly blind on that
[11:43 AM] Vincent.Sylvester @hg.zetaworlds.com: I don't use it outside of testing so no idea what else might be broken
[11:43 AM] Jagga.Meridith @hg.zetaworlds.com: it's just a little Beelink but good performance
[11:44 AM] Andrew.Hellershanks @grid.kitely.com:8002: Vincent, I'm considering that. I can reduce the number of standby apache servers even more if needed. RIght now things look good webserver wise. The problem now is something called saslauthd.
[11:46 AM] Vincent.Sylvester @hg.zetaworlds.com: Hm, I would suspect given it has no anti-flood that it likely is back to being spammed with those which lock it up. Needs fail2ban
[11:46 AM] Vincent.Sylvester @hg.zetaworlds.com: cat auth log and grep for ip counts, block top ten, kick the bots out
[11:47 AM] Cuga.Rajal @rajal.org:9000: should have fail2ban for ssh connections
[11:47 AM] Vincent.Sylvester @hg.zetaworlds.com: Then again apache, especially old as that is, not exactly known for handling load well
[11:47 AM] Cuga.Rajal @rajal.org:9000: I haven't had that issue with apache
[11:48 AM] Vincent.Sylvester @hg.zetaworlds.com: It doesn't because the person that set it up didn't know how to do it properly and locked themselves out their own machine, so anti-flood was just never done
[11:48 AM] Vincent.Sylvester @hg.zetaworlds.com: Gotta remember it's a machine old enough to drink in some places
[11:48 AM] Andrew.Hellershanks @grid.kitely.com:8002: :)
[11:49 AM] Cuga.Rajal @rajal.org:9000: really need a new distro for os.org
[11:50 AM] Vincent.Sylvester @hg.zetaworlds.com: I'll refrain from saying more, just makes me angry
[11:50 AM] Jagga.Meridith @hg.zetaworlds.com: Beelink $200 on Amazon
[11:51 AM] Andrew.Hellershanks @grid.kitely.com:8002: I reduced the number of apache instances that start, the maximum allowed to run, and the number of pages that can be served before a one of the apache processes terminates.
[11:53 AM] Vincent.Sylvester @hg.zetaworlds.com: Did you ever take a backup of the mantis db? And the plugins
[11:54 AM] Andrew.Hellershanks @grid.kitely.com:8002: Not yet. I will need to locate the DB password so I can attempt a backup.
[11:54 AM] Andrew.Hellershanks @grid.kitely.com:8002: /me is trying to see the monitor through the cat standing in the way.
[11:54 AM] Vincent.Sylvester @hg.zetaworlds.com: That would be good since that's much harder to mirror than the wiki and the irc plugin is not something that seems to exist anymore
[11:54 AM] Ubit Umarov: me is dino just filling all my screen
[11:54 AM] Ubit Umarov: ok did pass
[11:55 AM] Vincent.Sylvester @hg.zetaworlds.com: Configs, data and custom stuff
[11:55 AM] Vincent.Sylvester @hg.zetaworlds.com: Before the machine dies or gets forgotten about completely
[11:55 AM] Andrew.Hellershanks @grid.kitely.com:8002: That was a close call. The t-rex just missed Ubit.
[11:55 AM] Vincent.Sylvester @hg.zetaworlds.com: Which version of mantis is running on it?
[11:56 AM] Andrew.Hellershanks @grid.kitely.com:8002: We are getting close to the top of the house. Jagga, you had something.
[11:57 AM] Andrew.Hellershanks @grid.kitely.com:8002: or was the questions about FS what you wanted to talk about?
[11:57 AM] Jagga.Meridith @hg.zetaworlds.com: wiki was min
[11:58 AM] Jagga.Meridith @hg.zetaworlds.com: s/min/mine/
[12:00 PM] Lyr.Lobo @vharmonyartshub.com:8002: Thank you...
[12:03 PM] Andrew.Hellershanks @grid.kitely.com:8002: I think I just found the password for MediaWiki. I will see if that lets me backup the DB it uses.
[12:03 PM] Andrew.Hellershanks @grid.kitely.com:8002: Any other topics for today?
[12:06 PM] Andrew.Hellershanks @grid.kitely.com:8002: As I don't see anyone typing I will take that as a no.
[12:07 PM] Ubit Umarov: :)
[12:07 PM] Andrew.Hellershanks @grid.kitely.com:8002: Thank you all for coming. See you again next week.
