0004437: OpenSim Crashes when using SQLITE in Mono 2.4.3 or higher

(0014460)
kazzy (reporter)
2009-12-10 01:09

Can't seem to reproduce this at all on 64-bit Mono 2.4.3, version dd5696e8bd29b1b48ae39bb5c94a59593f42548f

(0014463)
Zauber (reporter)
2009-12-10 09:37

This was on OpenSim 0.6.7-post-fixes that the bug occurred. I upgrade to 0.6.8-rc1 to see if the bug is still occuring there.

As well, as a test I wish to backup my SQLite database and then erase it so that I have a clean slate, in case my SQLite database was corrupted.

(0014464)
kazzy (reporter)
2009-12-10 10:19

Note: I tested with MySQL, and this exception is occurring in the database engine.

(0014543)
Zauber (reporter)
2009-12-18 10:00

This issue is occuring with the newly-released Mono 2.6 as well. MYSQL still appears to work with 2.4.3 and higher when others use it, but I myself cannot test it because I accidentally corrupted MYSQL's configuration on my machine, so I need to wipe it out and reinstall.

(0014544)
Zauber (reporter)
2009-12-18 10:03

I'm also updating this to "Block" because it cripples OpenSimulator's ability to function out of the box. I realize that people can just use mysql to bypass the problem, but there are some people who can't use MYSQL for some reason. Namelytechnical issues with MYSQL and their system, or because their computer skills aren't good enough to set it up.

(0014545)
jhurliman (manager)
2009-12-18 10:15

I can confirm this is an issue on Mono 2.6

(0014563)
Zauber (reporter)
2009-12-23 12:46

I just adopted the opensimulator package for Arch Linux and became it's maintainer. I've included a warning about the SQLITE/Mono bug and instructions on how to revert to Mono 2.4.2.

(0014564)
Zauber (reporter)
2009-12-23 15:38

jhurliman, which OS/Linux distribution did you test this with?

(0014565)
Digi Fly (reporter)
2009-12-23 16:31

I get a sqlite error when i try to install/run a fresh installed one.
No regions, no users. it happens many times at that point. then i switch to mysql and everything works fine.

kazzy, test it again, but with a complete fresh install and no databases present.

(0014566)
Zauber (reporter)
2009-12-23 17:44
edited on: 2009-12-23 17:46

Digi Fly, I just tested that a few hours ago on OpenSim-0.6.8 and Mono 2.6.1. The bug is still present. I'll test it again in a little bit.

EDIT: This was with a fresh install, as well.

(0014567)
Digi Fly (reporter)
2009-12-23 17:46

Zauber, thats correct. thats what i mean. use clean
opensim and you get the error. so its easy to reproduce

(0014576)
stephane (reporter)
2009-12-25 12:41
edited on: 2009-12-25 12:42

I tried "make test" with the following branches:
  0.6.7-release
  0.6.8-release
  master

All failed with similar results ("System.Data.DBConcurrencyException : Concurrency violation: the UpdateCommand affected 0 records."; "Mono.Data.SqliteClient.SqliteExecutionException : SQL logic error or missing database")

This is using Debian "testing" which includes 2.4.3.

(0014577)
Zauber (reporter)
2009-12-25 13:07

What I want to know is this: Is the bug affecting all uses of SQLITE, or just using it for specific parts of OpenSim? I cannot test this myself, as I have yet to figure out how I got mysql working on my system before.

(0014590)
Digi Fly (reporter)
2009-12-26 07:39

Zauber, i have that problem with mono 2.4.x to

(0014592)
Zauber (reporter)
2009-12-26 10:25

Digi Fly, what is the x? Mono 2.4.3 and higher carries this bug.

(0014594)
Digi Fly (reporter)
2009-12-26 12:54

Now i same a bit, i9m not sure if it where 2.4.2 or 2.4.3 thats why i put X in it. cannot trace it back. but zauber you could be right that it where 2.4.3

(0014782)
justincc (administrator)
2010-01-15 10:43

Melanie updated the sqlite library in Git master in commmit ab0dfbc1631d6a01fd3a44bdb03e47dab2148987 on Mon Jan 4. Did this help at all?

(0014783)
melanie (administrator)
2010-01-15 10:48

No. No change. It's still broken and all we can do is wait for the Mono people to fix it.

(0014791)
melanie (administrator)
2010-01-15 20:31

This is the MONO SQLite issue. It is the only one I'm leaving open. We don't need a flood of reports about an unfixable issue.

(0014981)
Teravus (administrator)
2010-02-13 02:23

I just committed some changes to the SQLite region datastore, I'd love to hear if this resolves the reported issue. Commit details are as follows:
[05:08] <CIA-18> opensim: teravus * rfa6da2f6c666 /OpenSim/Data/SQLite/SQLiteRegionData.cs:
[05:08] <CIA-18> opensim: * This is an attempt to resolve mantis 4437 by using SqliteAdapter type
[05:08] <CIA-18> opensim: statements instead of blanket SQL statements. The hope is that this makes
[05:08] <CIA-18> opensim: SQLite work on Linux/Mono again. Re:
[05:08] <CIA-18> opensim: http://opensimulator.org/mantis/view.php?id=4437 [^]
[05:08] <CIA-18> opensim: * Added a 'Create Update Statement' method that takes two fields for a primary key
[05:08] <CIA-18> opensim: * Added an Update and Delete command for parcels and land access list table rows.

(0014988)
stephane (reporter)
2010-02-13 14:59

Confirmed working OK with Mono 2.4.3 (Debian's "2.4.3+dfsg-1") on Debian/GNU Linux "testing", OpenSim commit 45493171b01c1a623edc70fcb92c48e307c7f89f.

(0015208)
justincc (administrator)
2010-03-26 14:41

Still getting reports that this doesn't work - will have to try directly.

(0015255)
justincc (administrator)
2010-04-02 16:49

Okay, managed to reproduce this bug using mono 2.6.3

(0015256)
justincc (administrator)
2010-04-02 16:55
edited on: 2010-04-02 16:59

Okay, my own attempts to isolate this bug were largely unsuccessful, though it does appear to be confined to the data adapter code. Executing sql statements directly (as is done by assets, inventory and some other classes) continues to work fine.

However, in googling I finally came across the fact that Mono has actually deprecated Mono.Data.SqliteClient in favour of Mono.Data.Sqlite apparantly for some time. They plan to remove SqliteClient in 2.8.

http://www.mono-project.com/Release_Notes_Mono_2.8 [^]

So, I've ported the code over (which is unfortunately a bit more complicated than just changing the imports) and I'm still getting a perplexing regionsettings error, albeit a slightly more explicit one

InnerException: Mono.Data.Sqlite.SqliteException: Abort due to constraint violation
regionsettings.regionUUID may not be NULL

which is puzzling because regionUUID is not null as far as I can tell.

Will continue investigating this anon.

(0015306)
justincc (administrator)
2010-04-09 13:56

Created temporary branch sqlite-mono-2.6. Code here mostly works with Mono 2.6 and SQLite though there is at least one terrain retrieval bug. Not yet tested with Mono 2.4 or Windows

(0015382)
rajid (reporter)
2010-04-26 18:29

I'm not sure how much I can help, if any, however... My sims (running under latest Ubuntu with Mono 2.4.3) seem to crash about 1 / wk. If it would help, I can try to get a crash dump. I can definitely give you lots of stack backtraces.

(0015500)
justincc (administrator)
2010-05-21 14:55

Fixed for 0.6.9 and master for Linux and Windows, though not for Mac OSX. Unfortunately, Mac OSX is not easily fixable though this may be addressed later on.

Issue History
Date Modified	Username	Field	Change
2009-12-09 23:09	Zauber	New Issue
2009-12-09 23:09	Zauber	Git Revision	=> Unknown
2009-12-09 23:09	Zauber	SVN Revision	=> 0
2009-12-09 23:09	Zauber	Run Mode	=> Standalone (Multiple Regions)
2009-12-09 23:09	Zauber	Physics Engine	=> ODE
2009-12-09 23:09	Zauber	Environment	=> Mono / Linux32, Mono / Linux64
2009-12-09 23:09	Zauber	Mono Version	=> 2.4.2
2009-12-10 01:09	kazzy	Note Added: 0014460
2009-12-10 09:37	Zauber	Note Added: 0014463
2009-12-10 10:19	kazzy	Note Added: 0014464
2009-12-18 10:00	Zauber	Note Added: 0014543
2009-12-18 10:00	Zauber	Summary	OpenSim Crashes with unusual exception on Mono 2.4.3 => OpenSim Crashes when using SQLITE in Mono 2.4.3 or higher
2009-12-18 10:03	Zauber	Note Added: 0014544
2009-12-18 10:03	Zauber	Severity	crash => block
2009-12-18 10:03	Zauber	Category	[MISC] Compiling / Building => [REGION] OpenSim Core
2009-12-18 10:15	jhurliman	Note Added: 0014545
2009-12-23 12:46	Zauber	Note Added: 0014563
2009-12-23 15:38	Zauber	Note Added: 0014564
2009-12-23 16:31	Digi Fly	Note Added: 0014565
2009-12-23 17:44	Zauber	Note Added: 0014566
2009-12-23 17:46	Digi Fly	Note Added: 0014567
2009-12-23 17:46	Zauber	Note Edited: 0014566
2009-12-25 12:41	stephane	Note Added: 0014576
2009-12-25 12:42	stephane	Note Edited: 0014576
2009-12-25 13:07	Zauber	Note Added: 0014577
2009-12-25 14:00	melanie	Note Added: 0014578
2009-12-25 14:02	Zauber	Note Added: 0014579
2009-12-25 14:09	melanie	Note Added: 0014580
2009-12-25 14:16	Zauber	Relationship added	child of 0004463
2009-12-25 14:18	Zauber	Note Added: 0014581
2009-12-25 14:24	melanie	Note Added: 0014583
2009-12-25 14:58	melanie	Note Deleted: 0014583
2009-12-25 14:58	melanie	Note Deleted: 0014581
2009-12-25 14:58	melanie	Note Deleted: 0014580
2009-12-25 14:58	melanie	Note Deleted: 0014579
2009-12-25 14:58	melanie	Note Deleted: 0014578
2009-12-26 07:39	Digi Fly	Note Added: 0014590
2009-12-26 10:25	Zauber	Note Added: 0014592
2009-12-26 12:54	Digi Fly	Note Added: 0014594
2010-01-15 10:43	justincc	Note Added: 0014782
2010-01-15 10:43	justincc	Status	new => feedback
2010-01-15 10:48	melanie	Note Added: 0014783
2010-01-15 10:48	melanie	Status	feedback => confirmed
2010-01-15 20:30	melanie	Relationship deleted	child of 0004463
2010-01-15 20:31	melanie	Note Added: 0014791
2010-02-13 02:23	Teravus	Note Added: 0014981
2010-02-13 14:59	stephane	Note Added: 0014988
2010-02-21 22:04	chi11ken	Relationship added	related to 0004481
2010-02-21 22:08	chi11ken	Relationship added	related to 0003695
2010-02-21 22:09	chi11ken	Relationship added	related to 0004577
2010-03-26 14:28	justincc	Product Version	0.6.7 => 0.6.9.RC1
2010-03-26 14:41	justincc	Status	confirmed => assigned
2010-03-26 14:41	justincc	Assigned To	=> justincc
2010-03-26 14:41	justincc	Note Added: 0015208
2010-03-31 15:58	justincc	Relationship added	has duplicate 0004644
2010-04-02 16:49	justincc	Note Added: 0015255
2010-04-02 16:55	justincc	Note Added: 0015256
2010-04-02 16:59	justincc	Note Edited: 0015256
2010-04-09 13:56	justincc	Note Added: 0015306
2010-04-26 18:29	rajid	Note Added: 0015382
2010-05-21 14:55	justincc	Status	assigned => closed
2010-05-21 14:55	justincc	Note Added: 0015500
2010-05-21 14:55	justincc	Resolution	open => fixed
2010-05-21 14:56	justincc	Relationship deleted	has duplicate 0004644

Notes
(0014460) kazzy (reporter) 2009-12-10 01:09	Can't seem to reproduce this at all on 64-bit Mono 2.4.3, version dd5696e8bd29b1b48ae39bb5c94a59593f42548f

(0014463) Zauber (reporter) 2009-12-10 09:37	This was on OpenSim 0.6.7-post-fixes that the bug occurred. I upgrade to 0.6.8-rc1 to see if the bug is still occuring there. As well, as a test I wish to backup my SQLite database and then erase it so that I have a clean slate, in case my SQLite database was corrupted.

(0014464) kazzy (reporter) 2009-12-10 10:19	Note: I tested with MySQL, and this exception is occurring in the database engine.

(0014543) Zauber (reporter) 2009-12-18 10:00	This issue is occuring with the newly-released Mono 2.6 as well. MYSQL still appears to work with 2.4.3 and higher when others use it, but I myself cannot test it because I accidentally corrupted MYSQL's configuration on my machine, so I need to wipe it out and reinstall.

(0014544) Zauber (reporter) 2009-12-18 10:03	I'm also updating this to "Block" because it cripples OpenSimulator's ability to function out of the box. I realize that people can just use mysql to bypass the problem, but there are some people who can't use MYSQL for some reason. Namelytechnical issues with MYSQL and their system, or because their computer skills aren't good enough to set it up.

(0014545) jhurliman (manager) 2009-12-18 10:15	I can confirm this is an issue on Mono 2.6

(0014563) Zauber (reporter) 2009-12-23 12:46	I just adopted the opensimulator package for Arch Linux and became it's maintainer. I've included a warning about the SQLITE/Mono bug and instructions on how to revert to Mono 2.4.2.

(0014564) Zauber (reporter) 2009-12-23 15:38	jhurliman, which OS/Linux distribution did you test this with?

(0014565) Digi Fly (reporter) 2009-12-23 16:31	I get a sqlite error when i try to install/run a fresh installed one. No regions, no users. it happens many times at that point. then i switch to mysql and everything works fine. kazzy, test it again, but with a complete fresh install and no databases present.

(0014566) Zauber (reporter) 2009-12-23 17:44 edited on: 2009-12-23 17:46	Digi Fly, I just tested that a few hours ago on OpenSim-0.6.8 and Mono 2.6.1. The bug is still present. I'll test it again in a little bit. EDIT: This was with a fresh install, as well.

(0014567) Digi Fly (reporter) 2009-12-23 17:46	Zauber, thats correct. thats what i mean. use clean opensim and you get the error. so its easy to reproduce

(0014576) stephane (reporter) 2009-12-25 12:41 edited on: 2009-12-25 12:42	I tried "make test" with the following branches: 0.6.7-release 0.6.8-release master All failed with similar results ("System.Data.DBConcurrencyException : Concurrency violation: the UpdateCommand affected 0 records."; "Mono.Data.SqliteClient.SqliteExecutionException : SQL logic error or missing database") This is using Debian "testing" which includes 2.4.3.

(0014577) Zauber (reporter) 2009-12-25 13:07	What I want to know is this: Is the bug affecting all uses of SQLITE, or just using it for specific parts of OpenSim? I cannot test this myself, as I have yet to figure out how I got mysql working on my system before.

(0014590) Digi Fly (reporter) 2009-12-26 07:39	Zauber, i have that problem with mono 2.4.x to

(0014592) Zauber (reporter) 2009-12-26 10:25	Digi Fly, what is the x? Mono 2.4.3 and higher carries this bug.

(0014594) Digi Fly (reporter) 2009-12-26 12:54	Now i same a bit, i9m not sure if it where 2.4.2 or 2.4.3 thats why i put X in it. cannot trace it back. but zauber you could be right that it where 2.4.3

(0014782) justincc (administrator) 2010-01-15 10:43	Melanie updated the sqlite library in Git master in commmit ab0dfbc1631d6a01fd3a44bdb03e47dab2148987 on Mon Jan 4. Did this help at all?

(0014783) melanie (administrator) 2010-01-15 10:48	No. No change. It's still broken and all we can do is wait for the Mono people to fix it.

(0014791) melanie (administrator) 2010-01-15 20:31	This is the MONO SQLite issue. It is the only one I'm leaving open. We don't need a flood of reports about an unfixable issue.

(0014981) Teravus (administrator) 2010-02-13 02:23	I just committed some changes to the SQLite region datastore, I'd love to hear if this resolves the reported issue. Commit details are as follows: [05:08] <CIA-18> opensim: teravus * rfa6da2f6c666 /OpenSim/Data/SQLite/SQLiteRegionData.cs: [05:08] <CIA-18> opensim: * This is an attempt to resolve mantis 4437 by using SqliteAdapter type [05:08] <CIA-18> opensim: statements instead of blanket SQL statements. The hope is that this makes [05:08] <CIA-18> opensim: SQLite work on Linux/Mono again. Re: [05:08] <CIA-18> opensim: http://opensimulator.org/mantis/view.php?id=4437 [^] [05:08] <CIA-18> opensim: * Added a 'Create Update Statement' method that takes two fields for a primary key [05:08] <CIA-18> opensim: * Added an Update and Delete command for parcels and land access list table rows.

(0014988) stephane (reporter) 2010-02-13 14:59	Confirmed working OK with Mono 2.4.3 (Debian's "2.4.3+dfsg-1") on Debian/GNU Linux "testing", OpenSim commit 45493171b01c1a623edc70fcb92c48e307c7f89f.

(0015208) justincc (administrator) 2010-03-26 14:41	Still getting reports that this doesn't work - will have to try directly.

(0015255) justincc (administrator) 2010-04-02 16:49	Okay, managed to reproduce this bug using mono 2.6.3

(0015256) justincc (administrator) 2010-04-02 16:55 edited on: 2010-04-02 16:59	Okay, my own attempts to isolate this bug were largely unsuccessful, though it does appear to be confined to the data adapter code. Executing sql statements directly (as is done by assets, inventory and some other classes) continues to work fine. However, in googling I finally came across the fact that Mono has actually deprecated Mono.Data.SqliteClient in favour of Mono.Data.Sqlite apparantly for some time. They plan to remove SqliteClient in 2.8. http://www.mono-project.com/Release_Notes_Mono_2.8 [^] So, I've ported the code over (which is unfortunately a bit more complicated than just changing the imports) and I'm still getting a perplexing regionsettings error, albeit a slightly more explicit one InnerException: Mono.Data.Sqlite.SqliteException: Abort due to constraint violation regionsettings.regionUUID may not be NULL which is puzzling because regionUUID is not null as far as I can tell. Will continue investigating this anon.

(0015306) justincc (administrator) 2010-04-09 13:56	Created temporary branch sqlite-mono-2.6. Code here mostly works with Mono 2.6 and SQLite though there is at least one terrain retrieval bug. Not yet tested with Mono 2.4 or Windows

(0015382) rajid (reporter) 2010-04-26 18:29	I'm not sure how much I can help, if any, however... My sims (running under latest Ubuntu with Mono 2.4.3) seem to crash about 1 / wk. If it would help, I can try to get a crash dump. I can definitely give you lots of stack backtraces.

(0015500) justincc (administrator) 2010-05-21 14:55	Fixed for 0.6.9 and master for Linux and Windows, though not for Mac OSX. Unfortunately, Mac OSX is not easily fixable though this may be addressed later on.