Thanks all for the info and thoughts, sounds like scheduling daily restarts is probably the best option. <div><br></div><div>I'm pretty sure I haven't messed with whatever the default settings are for the flotsam cache, I never copy over old config files when I upgrade, I go through and update by hand and usually just base settings to make sure the upgrade was successful and then turn on other options that we've tested. <br>
<div><br></div><div>I have to say, it's almost funny that FleepGrid, which is running Windows XP on a P4 box that was gathering dust and cat hair in the basement, 4GB of RAM, and at least 8 sims full of content and scripts isn't having that problem, but the new poweredge server running WinServer2008, tons of RAM, and only 3 or 4 sims of content is flaking out. In fact, three of the regions on the UCSIM grid are identical to the ones on FleepGrid since I ported them over as OAR files, so it can't be much of a difference in content..</div>
<div><br></div><div>Think I'll try going through the log files again, I'd sure like to know what's tipping the out of memory exception!</div><div><br></div><div>Thanks again.</div><div><br></div><div>- Chris/Fleep</div>
<div><br></div><div>Chris M. Collins (SL/OS: Fleep Tuque)</div><div>Center for Simulations & Virtual Environments Research (UCSIM)</div><div>UCIT Instructional & Research Computing</div><div>University of Cincinnati</div>
<div>406A Zimmer Hall</div><div>315 College Drive</div><div>PO BOX 210088</div><div>Cincinnati, OH 45221-0088</div><div><a href="mailto:chris.collins@uc.edu">chris.collins@uc.edu</a></div><div>(513) 556-3018</div><div><br>
</div><div><a href="http://ucsim.uc.edu">http://ucsim.uc.edu</a><br><br><div class="gmail_quote">On Tue, Feb 14, 2012 at 7:29 AM, James Stallings II <span dir="ltr"><<a href="mailto:james.stallings@gmail.com">james.stallings@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Regardless the amount of RAM on your system, the .net runtime uses a memory model of a specific size (2 GB) and cannot address more than that except under special circumstances.<div>
<br></div><div>There is a hack around, involving the use of a Visual Studio C++ utility to make a .net binary 'large memory aware', which will allow it to address 4 GB, but then only on operating systems that can address >2 GB (e.g., not 32 bit operating systems).</div>
<div><br></div><div>Note that such measures will only help if the memory exhaustion is being caused by the amount/complexity of content. If the problem is truly a memory leak, this workaround will only prolong the inevitable, as it will simply provide more memory for the leaking.</div>
<div><br></div><div>I saw this problem *very* briefly in the 0.7.3 series about a month ago. I never did have any indication of what was causing it, and it occurred day over day, without significant changes to the content. It went away just as fast as it came.</div>
<div><br></div><div><br></div><div><br></div><div>FYI this is on a 25 region megaregion with >50k prims and at least several rather complex scripts in play.</div><div><br></div><div><br></div><div>Cheers</div><div>James/Hiro</div>
<div><br></div><div><br><div class="gmail_quote"><div><div class="h5">On Mon, Feb 13, 2012 at 8:39 PM, Gary Banham <span dir="ltr"><<a href="mailto:banham1@telus.net" target="_blank">banham1@telus.net</a>></span> wrote:<br>
</div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="h5">
<div lang="EN-CA" link="blue" vlink="purple"><div><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Fleep I’m running into exactly the same problem I check the flotsam cache to make sure I wasn’t using memory <u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">My server runs windows seven but has the same amount of memory I have about 8 regions on the server some with quite a few scripts<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">I rolled back the instance to 7.1.1 to see what would happen and it worked fine there must be something different in the way 7.2 release uses the memory<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">I’m in the process of distributing the regions over a number of 7.2 instances I’m not sure if that’s going to cause other problems<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">TC<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Gary<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0cm 0cm 0cm"><p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> <a href="mailto:opensim-users-bounces@lists.berlios.de" target="_blank">opensim-users-bounces@lists.berlios.de</a> [mailto:<a href="mailto:opensim-users-bounces@lists.berlios.de" target="_blank">opensim-users-bounces@lists.berlios.de</a>] <b>On Behalf Of </b>Fleep Tuque<br>
<b>Sent:</b> February-13-12 11:06 AM<br><b>To:</b> <a href="mailto:opensim-users@lists.berlios.de" target="_blank">opensim-users@lists.berlios.de</a><br><b>Subject:</b> [Opensim-users] Intermittent crashing - System.OutofMemoryException<u></u><u></u></span></p>
</div><div><div><p class="MsoNormal"><u></u> <u></u></p><p class="MsoNormal">Hi all,<u></u><u></u></p><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">Our campus opensim system (running version 0.7.2 Release in grid mode) seems to intermittently be crashing the last week or so and I can't figure out why or how to reproduce it. An out of memory exception doesn't make sense to me, the server has 24GB RAM and has very light load since we're still in pilot/testing phase. No more than 5 or 6 users concurrent, only a few sims with much content.. <u></u><u></u></p>
</div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">Does this error mean anything to anyone?<u></u><u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><div><p class="MsoNormal">
012-02-11 18:18:33,738 ERROR - OpenSim.Application [APPLICATION]: <u></u><u></u></p></div><div><p class="MsoNormal">APPLICATION EXCEPTION DETECTED: System.UnhandledExceptionEventArgs<u></u><u></u></p></div><div><p class="MsoNormal">
<u></u> <u></u></p></div><div><p class="MsoNormal">Exception: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.<u></u><u></u></p></div><div><p class="MsoNormal"> at System.Threading.Thread.StartInternal(IPrincipal principal, StackCrawlMark& stackMark)<u></u><u></u></p>
</div><div><p class="MsoNormal"> at System.Threading.Thread.Start()<u></u><u></u></p></div><div><p class="MsoNormal"> at Amib.Threading.SmartThreadPool.StartThreads(Int32 threadsCount)<u></u><u></u></p></div><div><p class="MsoNormal">
at Amib.Threading.SmartThreadPool.Enqueue(WorkItem workItem, Boolean incrementWorkItems)<u></u><u></u></p></div><div><p class="MsoNormal"> at Amib.Threading.SmartThreadPool.QueueWorkItem(WorkItemCallback callback, Object state)<u></u><u></u></p>
</div><div><p class="MsoNormal"> at OpenSim.Framework.Util.FireAndForget(WaitCallback callback, Object obj)<u></u><u></u></p></div><div><p class="MsoNormal"> at OpenSim.Region.ClientStack.LindenUDP.LLUDPServer.PacketReceived(UDPPacketBuffer buffer)<u></u><u></u></p>
</div><div><p class="MsoNormal"> at OpenMetaverse.OpenSimUDPBase.AsyncEndReceive(IAsyncResult iar)<u></u><u></u></p></div><div><p class="MsoNormal"> at System.Net.LazyAsyncResult.Complete(IntPtr userToken)<u></u><u></u></p>
</div><div><p class="MsoNormal"> at System.Net.ContextAwareResult.CompleteCallback(Object state)<u></u><u></u></p></div><div><p class="MsoNormal"> at System.Threading.ExecutionContext.runTryCode(Object userData)<u></u><u></u></p>
</div><div><p class="MsoNormal"> at System.Runtime.CompilerServices.RuntimeHelpers.ExecuteCodeWithGuaranteedCleanup(TryCode code, CleanupCode backoutCode, Object userData)<u></u><u></u></p></div><div><p class="MsoNormal">
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state)<u></u><u></u></p></div><div><p class="MsoNormal"> at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)<u></u><u></u></p>
</div><div><p class="MsoNormal"> at System.Net.ContextAwareResult.Complete(IntPtr userToken)<u></u><u></u></p></div><div><p class="MsoNormal"> at System.Net.LazyAsyncResult.ProtectedInvokeCallback(Object result, IntPtr userToken)<u></u><u></u></p>
</div><div><p class="MsoNormal"> at System.Net.Sockets.BaseOverlappedAsyncResult.CompletionPortCallback(UInt32 errorCode, UInt32 numBytes, NativeOverlapped* nativeOverlapped)<u></u><u></u></p></div><div><p class="MsoNormal">
at System.Threading._IOCompletionCallback.PerformIOCompletionCallback(UInt32 errorCode, UInt32 numBytes, NativeOverlapped* pOVERLAP)<u></u><u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">
Application is terminating: True<u></u><u></u></p></div></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">Any pointers or advice appreciated!<u></u><u></u></p></div><div><p class="MsoNormal">
<u></u> <u></u></p></div><div><p class="MsoNormal">- Chris/Fleep<u></u><u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">Chris M. Collins (SL/OS: Fleep Tuque)<u></u><u></u></p>
</div>
<div><p class="MsoNormal">Center for Simulations & Virtual Environments Research (UCSIM)<u></u><u></u></p></div><div><p class="MsoNormal">UCIT Instructional & Research Computing<u></u><u></u></p></div><div><p class="MsoNormal">
University of Cincinnati<u></u><u></u></p></div><div><p class="MsoNormal">406A Zimmer Hall<u></u><u></u></p></div><div><p class="MsoNormal">315 College Drive<u></u><u></u></p></div><div><p class="MsoNormal">PO BOX 210088<u></u><u></u></p>
</div><div><p class="MsoNormal">Cincinnati, OH 45221-0088<u></u><u></u></p></div><div><p class="MsoNormal"><a href="mailto:chris.collins@uc.edu" target="_blank">chris.collins@uc.edu</a><u></u><u></u></p></div><div><p class="MsoNormal">
<a href="tel:%28513%29%20556-3018" value="+15135563018" target="_blank">(513) 556-3018</a><u></u><u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal"><a href="http://ucsim.uc.edu" target="_blank">http://ucsim.uc.edu</a><u></u><u></u></p>
</div></div></div></div></div><br></div></div><div class="im">_______________________________________________<br>
Opensim-users mailing list<br>
<a href="mailto:Opensim-users@lists.berlios.de" target="_blank">Opensim-users@lists.berlios.de</a><br>
<a href="https://lists.berlios.de/mailman/listinfo/opensim-users" target="_blank">https://lists.berlios.de/mailman/listinfo/opensim-users</a><br>
<br></div></blockquote></div><span class="HOEnZb"><font color="#888888"><br><br clear="all"><div><br></div>-- <br>===================================<br><a href="http://simhost.com" target="_blank">http://simhost.com</a><br>
<a href="http://twitter.com/jstallings2" target="_blank">http://twitter.com/jstallings2</a><br>
<a href="http://www.linkedin.com/pub/5/770/a49" target="_blank">http://www.linkedin.com/pub/5/770/a49</a><br>
</font></span></div>
<br>_______________________________________________<br>
Opensim-users mailing list<br>
<a href="mailto:Opensim-users@lists.berlios.de">Opensim-users@lists.berlios.de</a><br>
<a href="https://lists.berlios.de/mailman/listinfo/opensim-users" target="_blank">https://lists.berlios.de/mailman/listinfo/opensim-users</a><br>
<br></blockquote></div><br></div></div>