[Opensim-dev] Proposal: Implement a de-duplicating core ROBUST asset service

[Rory Slegtenhorst]

List,

Please let's not go into that direction. Using the filesystem for generic
storage is one thing. Building a failsafe clustered system is quite another.
As it stands now, the options for setting up a high availability high
performance clustered filesystem are extremely limited, but the options for
a high availability high performance database platform are numerous.

MySQL NDB, Hadoop HBase and Cassandra come into mind as open-source
projects. There are hardly any clustered filesystem solutions that are also
opensource. Yes, there's Hadoop HDFS, but it's not a generic mountable
filesystem. A lot of work needs to be done before HDFS can be utilized in
OpenSim. Some others exist, but most of them are propierty.

On a side note: I have been using MySQL NDB storage for OpenSim in the last
year without any issues. My cluster consists of a load balancer acting as
management console, two mysql nodes and four data nodes. The performance
difference with a standalone MySQL servier is astounding!

Seriously, storing assets on disk (eg a filesystem) is a very bad idea as
scalability will be an issue!

Rory Slegtenhorst
rory dot slegtenhorst at gmail dot com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://opensimulator.org/pipermail/opensim-dev/attachments/20120309/54971f66/attachment-0001.html>