<html dir="ltr">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" id="owaParaStyle"></style>
</head>
<body bgcolor="#FFFFFF" fpstyle="1" ocsi="0">
<div style="direction: ltr;font-family: Tahoma;color: #000000;font-size: 10pt;">Dear All,
<div><br>
</div>
<div>Performance of any product is of prime importance, since it results in user actually using or not-using the system.</div>
<div><br>
</div>
<div>My question to all is how do you collect and evaluate performance metrics and measures, specially when you are evaluating virtual vs. real hosts and linux vs. mac vs. windows ? </div>
<div><br>
</div>
<div>Is it just visual perception ? What about network configurations ? Can you please post exact specs of the system, network topology, and raw/processed performance metrics data ? Is it subjective or objective evaluation ?</div>
<div><br>
</div>
<div>I did post something similar on this list few weeks back, and Justin and Dan were kind enough to provide some links, however, those links lead me to believe that the performance testing was only restricted to few metrics such as CPU load, memory load and
not much raw/processed data was available other then couple of tables listing some configuration and values.</div>
<div><br>
</div>
<div>Look forward to hear from you...</div>
<div><br>
</div>
<div>regards</div>
<div><br>
</div>
<div>-- amit</div>
<div><br>
<div style="font-family: Times New Roman; color: #000000; font-size: 16px">
<hr tabindex="-1">
<div id="divRpF418471" style="direction: ltr;"><font face="Tahoma" size="2" color="#000000"><b>From:</b> opensim-dev-bounces@opensimulator.org [opensim-dev-bounces@opensimulator.org] on behalf of Butch Arnold [butch.arnold@3rdrockgrid.com]<br>
<b>Sent:</b> Saturday, October 11, 2014 5:43 PM<br>
<b>To:</b> opensim-dev@opensimulator.org<br>
<b>Subject:</b> Re: [Opensim-dev] Open Simulator Server on Windows vs Linux<br>
</font><br>
</div>
<div></div>
<div>
<div class="moz-cite-prefix">Hi All,<br>
<br>
I haven't compared Linux vs. Windows in some time, but in the past when comparing, a linux based instance seemed to require more ram than the same region running on a windows machine.<br>
We at 3rd Rock use only windows for our grid and centOS for our web server.<br>
It is true that I personally am much more comfortable using windows than I am Linux, but I am not against Linux.<br>
In our early days back in '08 I had originally started 3rd Rock using Linux, but changed over to Windows as I am more comfortable with that platform.<br>
<br>
This topic has all the dangers of quickly turning into a Ford vs. Chevy, or coke vs. pepsi argument, so to be fair, some may prefer linux over windows for different reasons, but the reason 3rd Rock runs windows is that my personal observations and tests revealed
to me that opensim on linux uses more ram "And" I am more comfortable with the windows platform.<br>
<br>
~Butch<br>
<br>
<br>
<br>
<br>
<br>
<br>
On 10/11/2014 4:06 PM, Dahlia Trimble wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">
<div>
<div>
<div>
<div>I have noticed decreased performance when running OpenSimulator in a VirtualBox VM vs. running it on the host. Usually it's when there is a lot of I/O operations, such as high database activity or networking load. I've also seen issues when a lot of timers
are used in scripts. This makes sense as VIrtualBox adds significant overhead to such operations.<br>
<br>
</div>
I've seen much better performance using OpenVZ, however OpenVZ is harder to work with as it's not really a virtual machine but rather more of a constrained operating environment. It does not add as much overhead to I/O operations as a true virtual machine would.
It also did not seem to suffer from the timer issues I've seen in VirtualBox.<br>
<br>
</div>
I've used OpenSImulator on a variety of virtual servers now for several years and in general it does work reasonably well for smaller use cases. I would not consider using anything but bare metal or OpenVZ for any regions which were expected to have high performance
and service many users simultaneously.<br>
<br>
</div>
In general I've found Windows+.NET to be much more robust than Mono. I do see problems occasionally on Linux+Mono but I tend to blame Mono. I have experimental code which can crash and burn any Mono version I've tried to date, yet runs flawlessly on .NET. This
code creates and dereferences millions of very small objects and when run on a Mono installation will leak memory and crash with out of memory errors. I've discussed it with several Mono devs on IRC and the consensus was a possible bug in one or more of the
Mono runtime libraries. I've also seen a lot of random Mono crashes that I just never see in .NET while running the same sim under similar load conditions.<br>
<br>
</div>
While in general I believe .NET to be a more robust operating environment than mono, the lower cost and ease of use of Linux for server-like applications usually means I use Linux servers for running regions. I usually use Windows exclusively for OpenSimulator
development, which may be a reason why I tend to notice such differences. I don't really have any documented empirical evidence to support my reasoning other than having some code which will crash Mono. Most of my rationale is based on observations during
my OpenSimulator development and deployment activities over the past several years.<br>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Sat, Oct 11, 2014 at 8:46 AM, Maxwell, Douglas CIV USARMY ARL (US)
<span dir="ltr"><<a href="mailto:douglas.maxwell3.civ@mail.mil" target="_blank">douglas.maxwell3.civ@mail.mil</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex; border-left:1px #ccc solid; padding-left:1ex">
<div>
<div style="direction:ltr; font-family:Tahoma; color:#000000; font-size:10pt">
<div>
<p>The MOSES project ( <a href="http://militarymetaverse.org/" target="_blank">http://militarymetaverse.org/</a> ) has experimented with a number of different Open Simulator deployment methods. The grid is currently has access to a blend of 5 Dell PowerEdge
R815 servers and one Dell PowerEdge R220. The R815's are virtual machine servers and the R220 is a small Linux host used to serve up to 10 sims. On the R815's we can stand up any operating system we wish to experiment with using virtual machines.
</p>
<p> </p>
<p>Currently, our favorite installation method is using Ubuntu Linux. This is only for convenience as all of the dependencies are available as packages. On Ubuntu, we can start with a bare OS install through completely functioning MOSES grid in about 3 hours,
including compiling from source. Less time when dealing with binaries.</p>
<p> </p>
<p>Our Complete Instructions Here:</p>
<p><a href="http://militarymetaverse.org/wp-content/uploads/2014/10/MIAB_Installation_Instructions_using_Virtual_Box_and_Ubuntu-141006.pdf" target="_blank">http://militarymetaverse.org/wp-content/uploads/2014/10/MIAB_Installation_Instructions_using_Virtual_Box_and_Ubuntu-141006.pdf</a></p>
<p> </p>
<p>We have worked with CentOS, but it is a lot of work. Mostly because of the bootstrapping needed to get Mono and its associated packages working. It is easy to make mistakes and you can spend hours troubleshooting. In the end, it seems to operate similarly
as Ubuntu. </p>
<p> </p>
<p>The version of Windows we typically work with is the Army Golden Master of Windows 2008 Server or Windows 7 AGM. The biggest issue we deal with is just setting up the environment and being forced to manually download and install all the dependencies. This
can take days. The Army version of Windows also has extra registry values and network policies that pose configuration challenges.</p>
<p> </p>
<p>Virtual Machine Performance Differences?</p>
<p> </p>
<p>In our testing we have not *yet* found any measurable difference in performance between Open Simulator deployed via VM or bare host on any operating system. This has been independently verified by our industry partners and other military labs using their
own internal hosts as well as Amazon EC2.</p>
<p> </p>
<p>Operating System Performance Differences?</p>
<p> </p>
<p>Unfortunately there are so many variables that affect open simulator performance that anecdotal evidence to support Windows or Linux simply don't hold up. Its not a simple matter of comparing .Net to Mono. The operating systems are fundamentally different,
so a proper test would involve replicating the Open Simulator servers as closely as possible on each. This would require an initial benchmark test that has both Windows and Linux servers using the same version of Mono, same version of Apache, same version
of MySQL, etc... on the same host configuration (i.e. hardware or VM profile).</p>
<p> </p>
<p>Any deviations introduce variables to the test that must be accounted for. For example, only after the Windows vs. Linux test has been completed and analyzed for differences can you then introduce another variable of .Net vs. Mono and re-run the performance
benchmarks. The original Windows vs. Linux benchmark is the baseline. </p>
<p> </p>
<div style="font-size:13px; font-family:Tahoma"><span style="white-space:normal; word-spacing:0px; text-transform:none; float:none; color:rgb(34,34,34); font:13px
arial,sans-serif; display:inline!important; letter-spacing:normal; background-color:rgb(255,255,255); text-indent:0px">Douglas
Maxwell, MSME</span><br style="white-space:normal; word-spacing:0px; text-transform:none; color:rgb(34,34,34); font:13px
arial,sans-serif; letter-spacing:normal; background-color:rgb(255,255,255); text-indent:0px">
<span style="white-space:normal; word-spacing:0px; text-transform:none; float:none; color:rgb(34,34,34); font:13px
arial,sans-serif; display:inline!important; letter-spacing:normal; background-color:rgb(255,255,255); text-indent:0px">Science and Technology
Manager</span><br style="white-space:normal; word-spacing:0px; text-transform:none; color:rgb(34,34,34); font:13px
arial,sans-serif; letter-spacing:normal; background-color:rgb(255,255,255); text-indent:0px">
<span style="white-space:normal; word-spacing:0px; text-transform:none; float:none; color:rgb(34,34,34); font:13px
arial,sans-serif; display:inline!important; letter-spacing:normal; background-color:rgb(255,255,255); text-indent:0px">Virtual World Strategic
Applications</span><br style="white-space:normal; word-spacing:0px; text-transform:none; color:rgb(34,34,34); font:13px
arial,sans-serif; letter-spacing:normal; background-color:rgb(255,255,255); text-indent:0px">
<span style="white-space:normal; word-spacing:0px; text-transform:none; float:none; color:rgb(34,34,34); font:13px
arial,sans-serif; display:inline!important; letter-spacing:normal; background-color:rgb(255,255,255); text-indent:0px">U.S. Army Research Lab</span><br style="white-space:normal; word-spacing:0px; text-transform:none; color:rgb(34,34,34); font:13px
arial,sans-serif; letter-spacing:normal; background-color:rgb(255,255,255); text-indent:0px">
<span style="white-space:normal; word-spacing:0px; text-transform:none; float:none; color:rgb(34,34,34); font:13px
arial,sans-serif; display:inline!important; letter-spacing:normal; background-color:rgb(255,255,255); text-indent:0px">Simulation & Training Technology
Center (STTC)</span><br style="white-space:normal; word-spacing:0px; text-transform:none; color:rgb(34,34,34); font:13px
arial,sans-serif; letter-spacing:normal; background-color:rgb(255,255,255); text-indent:0px">
<span style="white-space:normal; word-spacing:0px; text-transform:none; float:none; color:rgb(34,34,34); font:13px
arial,sans-serif; display:inline!important; letter-spacing:normal; background-color:rgb(255,255,255); text-indent:0px">(c)<span> </span></span><a href="tel:%28407%29%20242-0209" value="+14072420209" style="white-space:normal; word-spacing:0px; text-transform:none; color:rgb(17,85,204); font:13px
arial,sans-serif; letter-spacing:normal; background-color:rgb(255,255,255); text-indent:0px" target="_blank">(407)
242-0209</a></div>
</div>
</div>
</div>
<br>
_______________________________________________<br>
Opensim-dev mailing list<br>
<a href="mailto:Opensim-dev@opensimulator.org" target="_blank">Opensim-dev@opensimulator.org</a><br>
<a href="http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-dev" target="_blank">http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-dev</a><br>
<br>
</blockquote>
</div>
<br>
</div>
<br>
<fieldset class="mimeAttachmentHeader" target="_blank"></fieldset> <br>
<pre>_______________________________________________
Opensim-dev mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Opensim-dev@opensimulator.org" target="_blank">Opensim-dev@opensimulator.org</a>
<a class="moz-txt-link-freetext" href="http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-dev" target="_blank">http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-dev</a>
</pre>
</blockquote>
<br>
</div>
</div>
</div>
</div>
</body>
</html>