MantisBT - opensim
View Issue Details
0007204opensim[REGION] Physics Enginespublic2014-06-02 12:582014-07-29 13:43
kenvc 
Robert Adams 
highcrashalways
closedfixed 
Dual Quad Core Xeon 32gbWindowsSever 2012 64
master (dev code) 
 
r/24825
Grid (1 Region per Sim)
BulletSim
.NET / Windows64
None
FS, sing, Replex
0007204: Bulletsim VarRegion recently started crashing on sim startup - Red errors: Exception: System.NullReferenceException
Bulletsim: Just started last few days - Crash on sim startup - Exception: System.NullReferenceException.

Nothing has changed on this instance other than staying updated to latest dev master as always every day or so. This seemed to start sometime within the last few days. The only change to opensim.ini during this time was to add the new setting [Terrain]SendTerrainUpdatesByViewDistance=true
3 logs are attached. Two are from a clean start where the instance crashed on startup. The other log is from a clean start where the same error happened but the instance did not crash. Not sure why it crashes sometimes and not others.

2014-06-02 23:30:53,981 ERROR - OpenSim.Region.Physics.BulletSPlugin.BSScene [BULLETS SCENE]: ProcessPostTaintTaints: BSLinksetCompound.ScheduleRebuild-1216177134: Exception: System.NullReferenceException: Object reference not set to an instance of an object.
   at OpenSim.Region.Physics.BulletSPlugin.BSAPIUnman.AddChildShapeToCompoundShape(BulletShape shape, BulletShape addShape, Vector3 pos, Quaternion rot) in c:\Users\Administrator\Desktop\Opensim\Opensim Dev Master\OpenSim\Region\Physics\BulletSPlugin\BSAPIUnman.cs:line 350
   at OpenSim.Region.Physics.BulletSPlugin.BSLinksetCompound.<>c__DisplayClass3.<RecomputeLinksetCompound>b__2(BSPrimLinkable cPrim) in c:\Users\Administrator\Desktop\Opensim\Opensim Dev Master\OpenSim\Region\Physics\BulletSPlugin\BSLinksetCompound.cs:line 379
   at OpenSim.Region.Physics.BulletSPlugin.BSLinkset.ForEachMember(ForEachMemberAction action) in c:\Users\Administrator\Desktop\Opensim\Opensim Dev Master\OpenSim\Region\Physics\BulletSPlugin\BSLinkset.cs:line 205
   at OpenSim.Region.Physics.BulletSPlugin.BSLinksetCompound.RecomputeLinksetCompound() in c:\Users\Administrator\Desktop\Opensim\Opensim Dev Master\OpenSim\Region\Physics\BulletSPlugin\BSLinksetCompound.cs:line 358
   at OpenSim.Region.Physics.BulletSPlugin.BSLinksetCompound.<ScheduleRebuild>b__0() in c:\Users\Administrator\Desktop\Opensim\Opensim Dev Master\OpenSim\Region\Physics\BulletSPlugin\BSLinksetCompound.cs:line 114
   at OpenSim.Region.Physics.BulletSPlugin.BSScene.ProcessPostTaintTaints() in c:\Users\Administrator\Desktop\Opensim\Opensim Dev Master\OpenSim\Region\Physics\BulletSPlugin\BSScene.cs:line 1040
No tags attached.
related to 0007191closed Robert Adams [BULLETSIM] exception with linkset on startup 
log OpenSim-Crash.log (40,826) 2014-06-02 12:58
http://opensimulator.org/mantis/file_download.php?file_id=3921&type=bug
log OpenSim-NoCrash.log (44,097) 2014-06-02 12:58
http://opensimulator.org/mantis/file_download.php?file_id=3922&type=bug
log OpenSim-AnotherCrash.log (41,278) 2014-06-02 20:37
http://opensimulator.org/mantis/file_download.php?file_id=3923&type=bug
Issue History
2014-06-02 12:58kenvcNew Issue
2014-06-02 12:58kenvcFile Added: OpenSim-Crash.log
2014-06-02 12:58kenvcFile Added: OpenSim-NoCrash.log
2014-06-02 12:59kenvcSummaryBulletsim VarRegion: Recently started crashing on sim startup - Exception: System.NullReferenceException => Bulletsim VarRegion recently started crashing on sim startup - Red errors: Exception: System.NullReferenceException
2014-06-02 20:37kenvcFile Added: OpenSim-AnotherCrash.log
2014-06-02 20:42kenvcDescription Updatedbug_revision_view_page.php?rev_id=2698#r2698
2014-06-02 20:42kenvcAdditional Information Updatedbug_revision_view_page.php?rev_id=2700#r2700
2014-06-02 20:46kenvcNote Added: 0026232
2014-06-02 21:00Robert AdamsAssigned To => Robert Adams
2014-06-02 21:00Robert AdamsStatusnew => assigned
2014-06-02 21:04Robert AdamsNote Added: 0026233
2014-06-02 21:34kenvcAdditional Information Updatedbug_revision_view_page.php?rev_id=2701#r2701
2014-06-04 12:00kenvcNote Added: 0026235
2014-06-08 09:12Robert AdamsRelationship addedrelated to 0007191
2014-06-08 09:15Robert AdamsNote Added: 0026247
2014-06-09 16:55kenvcNote Added: 0026251
2014-06-11 20:04kenvcNote Added: 0026256
2014-06-11 20:04kenvcStatusassigned => resolved
2014-06-11 20:04kenvcFixed in Version => 0.8-rc3
2014-06-11 20:04kenvcResolutionopen => fixed
2014-07-29 13:43chi11kenStatusresolved => closed

Notes
(0026232)
kenvc   
2014-06-02 20:46   
One other bit of info on this. Not sure if this is coincidence or important info, but this particular var appears to be crashing on first startup after updating the sim software.

Restarting after the crash still gets the same red error messages in the log file, but it usually doesn't crash on the 2nd start.
(0026233)
Robert Adams   
2014-06-02 21:04   
This does look like another instance of the rebuilding of linksets failing because of mesh/sculptie assets being loaded. It is a timing thing so assets being in the cache would be different than cases where assets were still in the database.
(0026235)
kenvc   
2014-06-04 12:00   
Not sure what it is, but I see this red spew on every startup now. Sometimes it crashes and sometimes it doesn't. Not sure if its related, but boats on this var now have a very bad rubberband effect when moving and are almost useless:

2014-06-04 13:54:22,094 ERROR - OpenSim.Region.Physics.BulletSPlugin.BSScene [BULLETS SCENE]: ProcessPostTaintTaints: BSLinksetCompound.ScheduleRebuild-1515101655: Exception: System.NullReferenceException: Object reference not set to an instance of an object.
   at OpenSim.Region.Physics.BulletSPlugin.BSAPIUnman.AddChildShapeToCompoundShape(BulletShape shape, BulletShape addShape, Vector3 pos, Quaternion rot) in c:\Users\Administrator\Desktop\Opensim\Opensim Dev Master\OpenSim\Region\Physics\BulletSPlugin\BSAPIUnman.cs:line 350
   at OpenSim.Region.Physics.BulletSPlugin.BSLinksetCompound.<>c__DisplayClass3.<RecomputeLinksetCompound>b__2(BSPrimLinkable cPrim) in c:\Users\Administrator\Desktop\Opensim\Opensim Dev Master\OpenSim\Region\Physics\BulletSPlugin\BSLinksetCompound.cs:line 379
   at OpenSim.Region.Physics.BulletSPlugin.BSLinkset.ForEachMember(ForEachMemberAction action) in c:\Users\Administrator\Desktop\Opensim\Opensim Dev Master\OpenSim\Region\Physics\BulletSPlugin\BSLinkset.cs:line 205
   at OpenSim.Region.Physics.BulletSPlugin.BSLinksetCompound.RecomputeLinksetCompound() in c:\Users\Administrator\Desktop\Opensim\Opensim Dev Master\OpenSim\Region\Physics\BulletSPlugin\BSLinksetCompound.cs:line 358
   at OpenSim.Region.Physics.BulletSPlugin.BSLinksetCompound.<ScheduleRebuild>b__0() in c:\Users\Administrator\Desktop\Opensim\Opensim Dev Master\OpenSim\Region\Physics\BulletSPlugin\BSLinksetCompound.cs:line 114
   at OpenSim.Region.Physics.BulletSPlugin.BSScene.ProcessPostTaintTaints() in c:\Users\Administrator\Desktop\Opensim\Opensim Dev Master\OpenSim\Region\Physics\BulletSPlugin\BSScene.cs:line 1040
2014-06-04 13:54:22,874 DEBUG - OpenSim.Region.Physics.BulletSPlugin.BSScene [BULLETSIM SHAPE MESH] All mesh triangles degenerate. Prim=Object/c639a293-b1b8-4677-bd0c-39a5db40c1ed/pos=<272.9033, 267.2345, 54.81113>/rgn=BulletSim/Moorea Sailing
2014-06-04 13:54:22,874 WARN - OpenSim.Region.Physics.BulletSPlugin.BSScene [BULLETSIM SHAPE] Mesh asset would not mesh. prim=Object/c639a293-b1b8-4677-bd0c-39a5db40c1ed/pos=<272.9033, 267.2345, 54.81113>/rgn=BulletSim/Moorea Sailing, texture=00000000-0000-0000-0000-000000000000
(0026247)
Robert Adams   
2014-06-08 09:15   
I checked in a fix for this exception by checking for the null pointer and rebuilding the linkset again the next simulation tick. When this happens, a warning message is output. There should only be one or two of these warning messages. If there are more, then please report that. I tried to prevent infinite rebuildings of the linkset but that should not be happening. If it is, there is a different problem.
(0026251)
kenvc   
2014-06-09 16:55   
Robert, this fix does appear to have solved the problem. I am seeing one warning message, but do not know if it is the warning you are referring to. I reported it in mantis 7211 before I saw your note here. If that is the same warning you are referring to, then you can delete mantis 7211.
(0026256)
kenvc   
2014-06-11 20:04   
Have not seen this issue happen since Robert's fix. It appears to be resolved.