OpenSim Load Balancing and Region Splitting - Revision history

MakoBot: Robot: Replacing 'OpenSim' to 'OpenSimulator', which is the precise name

2012-03-04T06:50:30Z

Robot: Replacing 'OpenSim' to 'OpenSimulator', which is the precise name

MakoBot: Robot: Cosmetic changes

2012-03-04T03:46:20Z

Robot: Cosmetic changes

Justincc at 00:05, 5 July 2011

2011-07-05T00:05:19Z

MakoBot: Removed 'Template:' prefix from template includings and/or changed external-link into internal-link

2011-06-10T23:19:38Z

Removed 'Template:' prefix from template includings and/or changed external-link into internal-link

Johan: link to the forge repository

2009-05-25T00:38:14Z

link to the forge repository

Ideia Boa at 23:50, 21 May 2009

2009-05-21T23:50:01Z

DaveCoyle: minor formatting change

2008-11-23T18:18:05Z

minor formatting change

Adjohn at 14:51, 4 March 2008

2008-03-04T14:51:10Z

Adjohn at 14:50, 4 March 2008

2008-03-04T14:50:29Z

Adjohn: New page: INTRODUCTION This folder contains code that implement: 1. Dynamic load balancing OpenSim is allowing many regions to share a region server, but the optimal number of regions on each ser...

2008-03-04T14:43:05Z

New page: INTRODUCTION This folder contains code that implement: 1. Dynamic load balancing OpenSim is allowing many regions to share a region server, but the optimal number of regions on each ser...

New page

INTRODUCTION

This folder contains code that implement:

1. Dynamic load balancing

OpenSim is allowing many regions to share a region server, but the optimal
number of regions on each server depends on the load of each region, something
which may change as time goes on. 3Di is working on a load balancer that
allows the current load to be monitored and regions to be reassigned without
requiring the servers to be restarted. To move a region, its state is
serialized, and a new clone is created on the target server using this
stream. The old region is then destroyed and the client viewer updated to use
the new region address.

2. Region splitting

Currently each region can hold only a small number of avatars. To allow more
avatars in each region, 3Di has implemented region splitting, in which several
copies of a given region can be distributed across the region servers. Each
sub-region updates a fraction of the avatars, and sends state updates to the
other sub-regions.

IMPLEMENTATION

The code is organised as follows:

* LoadBalancer: communicates with other region servers and creates/destroys
regions on command
* RegionMonitor/MonitorGUI: provides a browser GUI, showing the state of the
grid, and provides buttons for controlling region movement, splitting, and
merging.
* RegionMonitor/ServerPlugin: this is a region server plugin which
communicates with the load balancer GUI to provide information
on the identity and status of the regions on the grid
* RegionProxy: maps messages from a clients to the true location of a region.

USAGE

In order to use these additions the following lines have to be added to
OpenSim.ini:

proxy_offset = -1000
proxy_url = http://10.8.1.50:9001
serialize_dir = /mnt/temp/

If defined, proxy_offset defines how to calculate the true region port, e.g.
if the XML defines the port as 9000 the actual port is 8000 if proxy_offset
is -1000. The RegionProxy module will open a port at 9000 which the clients
can connect to, and route all traffic from there to port 8000. This allows
the region proxy to run on region server together with regions without
blocking them by using the same port number.

The proxy location is defined in proxy_url. When splitting, the region state
is stored on a file in the folder specified in serialize_dir. This has to be
a shared folder which both region servers involved in the split have access to.

3. Monitor GUI

RegionMonitor/MonitorGUI is used to view status of all the managed Region
servers, and send "Move", "Split", "Merge" commands to a specified Regions
server.

MonitorGUI is a web-based application. You can access it through a web browser.
Its back-end is written in perl. (CGI script)

Pre-requierments (CentOS, Fedora)

RPM package "perl-XML-RPC" and relevant packages.

Installation

1. Install Apache
2. copy all the files undef "ThirdParty/3Di/RegionMonitor/MonitorGUI/htdocs" to
"$APACHE_ROOT/htdocs"
3. Configuration in "monitor.cgi"
* 10th line, set the value to your "monitor.cgi"'s location.
* 11th line, set the value to your Grid server.
* 12th line, set your region proxy port number here.
(ref. OpenSim.ini::NetWork::http_listener_port)
* The code also works fine with mod_perl.

@@ Line 11: / Line 11: @@
 == Dynamic load balancing ==
-OpenSim is allowing many regions to share a region server, but the optimal number of regions on each server depends on the load of each region, something which may change as time goes on. 3Di is working on a load balancer that allows the current load to be monitored and regions to be reassigned without requiring the servers to be restarted. To move a region, its state is serialized, and a new clone is created on the target server using this stream. The old region is then destroyed and the client viewer updated to use
+OpenSimulator is allowing many regions to share a region server, but the optimal number of regions on each server depends on the load of each region, something which may change as time goes on. 3Di is working on a load balancer that allows the current load to be monitored and regions to be reassigned without requiring the servers to be restarted. To move a region, its state is serialized, and a new clone is created on the target server using this stream. The old region is then destroyed and the client viewer updated to use
 the new region address.

@@ Line 16: / Line 16: @@
 == Region splitting ==
-Currently each region can hold only a small number of avatars.  To allow more avatars in each region, 3Di has implemented region splitting, in which several copies of a given region can be distributed across the region servers. Each sub-region updates a fraction of the avatars, and sends state updates to the other sub-regions.
+Currently each region can hold only a small number of avatars. To allow more avatars in each region, 3Di has implemented region splitting, in which several copies of a given region can be distributed across the region servers. Each sub-region updates a fraction of the avatars, and sends state updates to the other sub-regions.
 == IMPLEMENTATION ==
@@ Line 32: / Line 32: @@
 * RegionProxy: maps messages from a clients to the true location of a region.
-==USAGE==
+== USAGE ==
 In order to use these additions the following lines have to be added to
@@ Line 52: / Line 52: @@
 a shared folder which both region servers involved in the split have access to.
-==Monitor GUI==
+== Monitor GUI ==
 RegionMonitor/MonitorGUI is used to view status of all the managed Region
@@ Line 68: / Line 68: @@
 Installation
-#Install Apache
+# Install Apache
-#Copy all the files undef "ThirdParty/3Di/RegionMonitor/MonitorGUI/htdocs" to "$APACHE_ROOT/htdocs"
+# Copy all the files undef "ThirdParty/3Di/RegionMonitor/MonitorGUI/htdocs" to "$APACHE_ROOT/htdocs"
-#Configuration in "monitor.cgi"
+# Configuration in "monitor.cgi"
 #* 10th line, set the value to your "monitor.cgi"'s location.
 #* 11th line, set the value to your Grid server.
 #* 12th line, set your region proxy port number here. (ref. OpenSim.ini::NetWork::http_listener_port)
 #* The code also works fine with mod_perl.

@@ Line 2: / Line 2: @@
 {{Quicklinks}}
 <br />
 == INTRODUCTION ==

@@ Line 1: / Line 1: @@
 __NOTOC__
-{{Template:Quicklinks}}
+{{Quicklinks}}
 <br />

@@ Line 4: / Line 4: @@
 == INTRODUCTION ==
-The folder /ThirdParty/3Di/ contains code that implements Dynamic Load Balancing and Region Splitting.
 == Dynamic load balancing ==

← Older revision		Revision as of 23:50, 21 May 2009
Line 1:		Line 1:
		+	__NOTOC__
		+	{{Template:Quicklinks}}
		+	<br />
		+
	== INTRODUCTION ==		== INTRODUCTION ==
	The folder /ThirdParty/3Di/ contains code that implements Dynamic Load Balancing and Region Splitting.		The folder /ThirdParty/3Di/ contains code that implements Dynamic Load Balancing and Region Splitting.

@@ Line 30: / Line 30: @@
 OpenSim.ini:
-proxy_offset = -1000
+ proxy_offset = -1000
-proxy_url = http://10.8.1.50:9001
+ proxy_url = http://10.8.1.50:9001
-serialize_dir = /mnt/temp/
+ serialize_dir = /mnt/temp/
 If defined, proxy_offset defines how to calculate the true region port, e.g.