[Opensim-users] Database cleanup

[Justin Clark-Casey]

Karen Palen wrote:
> That is one way to solve the problem, although I don't know MySQL well enough to figure out how!
> 
> I was actually hoping that OpenSim had some built in utility that would do this in a more intelligent way though. Essentially the knowledge about what is deleted or not is fairly high level information within OpenSim itself. A "touch" would at best be an emulation of this.
> 
> Ideally this would run regularly and keep down the "cruft" build-up.
> 
> Next best would be to dump each region to an OAR file, each avatar's inventory to an IAR file then build a new database from that! It would work, but could take several days of effort to make sure that it was done right. My next thought is to use Second Inventory to do the same thing, but that could be even slower!

Dumping OARs and IARs would work but it would be tedious.

For a long time I've wanted to write a tool that would effectively do this 
automatically, identifying the cruft and dumping it via the same mechanisms that 
are used to identify the required asset chains in OAR and IAR saves.  This 
wouldn't be too hard to do for a standalone.  It would be okay for very small 
grids (as long as they can be taken offline for a period).

The larger the grid, the more difficult it gets.  This simplistic dependency 
identification approach seems near impossible for "open" grids (those allowing 
3rd party region simulators).

Unfortunately, such a tool is way back on my pro bono list, way behind all the 
other interesting things I've discussed recently but haven't done yet :)

> 
> Karen
> 
> --- On Mon, 12/21/09, LaeMing <laeming at exemail.com.au> wrote:
> 
>> From: LaeMing <laeming at exemail.com.au>
>> Subject: Re: [Opensim-users] Database cleanup
>> To: opensim-users at lists.berlios.de
>> Date: Monday, December 21, 2009, 7:34 PM
>> Hmmm. When I was in the DB manually
>> editing all my regions' ground textures 
>> and so (36 region megaregion, this was far quicker than
>> doing it in-sim), I 
>> noticed a lot of old regiondata from earlier iterations of
>> my OpenSim 
>> experiments hanging about too. I was able to hand-delete
>> all the unwanted 
>> regioninfo from the mySql tools, but the tools didn't want
>> to let me enter 
>> edit mode for the binary blobs of region heightmaps, so I
>> couldn't work out 
>> how to hand-delete those.
>>
>> I imagine, like Karen, there is also a lot of dangling
>> cruft built up in my 
>> inventory too. Since I am the only user for now, would it
>> be fair to say 
>> anything in world or in my current inventory has been
>> 'touched' last login, 
>> and assuming mySql does (or can) flag touch dates for
>> entries, could I just 
>> find the method of deleting all entries untouched since my
>> last login (after a 
>> full backup of course)?
>>
>> Lae
>>
>>
>> On Tuesday December 22 2009 09:52:22 Karen Palen wrote:
>>> My OpenSim database now tops 1Gb with only a single
>> region!
>>> Looking at the database with MySql tools shows that
>> there is a whole lot of
>>>   stuff that I have tried and discarded still in
>> the database and that it
>>>   does not seem to be flagged for removal.
>>>
>>> Is there some OpenSim database maintenance tool that I
>> haven't found yet?
>>> How DO people like OSGrid keep the database to a
>> manageable size?
>>> Karen
>>>
>>>
>>>
>>> _______________________________________________
>>> Opensim-users mailing list
>>> Opensim-users at lists.berlios.de
>>> https://lists.berlios.de/mailman/listinfo/opensim-users
>>>
>> _______________________________________________
>> Opensim-users mailing list
>> Opensim-users at lists.berlios.de
>> https://lists.berlios.de/mailman/listinfo/opensim-users
>>
> 
> 
>       
> _______________________________________________
> Opensim-users mailing list
> Opensim-users at lists.berlios.de
> https://lists.berlios.de/mailman/listinfo/opensim-users
> 


-- 
Justin Clark-Casey (justincc)
http://justincc.org
http://twitter.com/justincc