Mantis Bug Tracker

View Issue Details Jump to Notes ] Issue History ] Print ]
IDProjectCategoryView StatusDate SubmittedLast Update
0008642opensim[REGION] OpenSim Corepublic2020-01-16 02:332020-02-14 01:13
Reporteraiaustin 
Assigned To 
PrioritynormalSeveritymajorReproducibilityalways
StatusnewResolutionopen 
PlatformPCOSWindowsOS Version10
Product Versionmaster (dev code) 
Target Versionmaster (dev code)Fixed in Version 
Summary0008642: Viewers using default Linden Lab Bakes on Mesh (BoM) code are causing continuous repeated avatar bake cycles on servers
DescriptionThis issue is provided on the OpenSim Mantis to note issues that may require viewer changes and to help coordinate necessary viewer changes.

Now that people are using viewers which include fairly recent Linden Lab code for Bakes on Mesh (BoM), more hypergrid visitors for grids and OSGrid regions are causing repeating, never ending, baking cycles. The OpenSim.exe console will likely show the warnings.

This is a known issue and likely to be seen with any viewer based on recent LL code. The issue has been under investigation in testing updates to Firestorm to address the issue and to add code protective of older grids not based on the latest 0.9.1.1 stable version of OpenSim.

Can people with connections to the various viewer developers please ask them to look at the fixes identified for Firestorm 6.3.6 as at r58523:c93fac05beb5 (11-Jan-2020) to consider whether change sin their own BoM handling code is required.

https://vcs.firestormviewer.org/phoenix-firestorm/changeset/c93fac05beb53e10d8ad07eda995e2456e49525d [^]

Additional InformationNotes on specific viewers and versions :

Singularity Beta 1.8.7.7992 (repeated baking observed)
Singularity Beta 1.8.7.8158 (okay?)
TagsNo tags attached.
Git Revision or version number0.9.1.1
Run Mode Grid (Multiple Regions per Sim)
Physics EngineBulletSim
Script EngineXEngine
Environment.NET / Windows64
Mono VersionNone
ViewerVarious
Attached Filestxt file icon 2020-01-16-Repeating-Rebakes-OpenSim.log.txt [^] (11,836 bytes) 2020-01-17 01:19 [Show Content]

- Relationships

-  Notes
(0036059)
tampa (reporter)
2020-01-16 02:41

This rebake spam has been around a decade now with various causes, bad mesh, bad textures, faulty imports etc we finally need something that will blacklist the item/avatar from receiving new bakes when they do so 10 times a second or something. At least temporarily and not just because of this latest faux pas
(0036060)
BillBlight (developer)
2020-01-16 03:01
edited on: 2020-01-16 03:05

I have to agree with tampa on this one, I don't think it is the BOM code per-say , but it may be triggering an old mesh baking issue ..

The baking issue can usually be tracked to piece of bad mesh, and yes it can be one that worked for ages, that has now gotten cached badly ..

I have personally not seen the bake spam for ages ..

(0036062)
aiaustin (developer)
2020-01-16 06:04
edited on: 2020-01-16 06:09

Could be the cause. I was just seeing multiple, never ending bakes warnings on a 0.9.2.0 dev master region and made the assumption it was related to the same issue observed until the Firestorm 6.3.6 (in preparation) fixes were made by Beq Janus.

Here are two instances of the repeating entries of a user on Singularity Beta 1.8.7.7992 visiting a 0.9.2.0 dev master (latest) OSGrid region...

09:51:55 - [AVFACTORY]: Received texture update for randa agrawal 95aef5c3-3564-4440-bc83-538ea7e90623
09:51:55 - [UpdateBakedCache]: cache hits: 0 changed entries: 0 rebakes 5
09:51:55 - [UPLOAD BAKED TEXTURE HANDLER]: Received baked texture 66a10f60-9fdb-4f08-b296-99d953014e7b
09:51:55 - [UPLOAD BAKED TEXTURE HANDLER]: Received baked texture 5775437e-0644-4306-9110-e958c3b3a0b7
09:51:55 - [UPLOAD BAKED TEXTURE HANDLER]: Received baked texture bdf230aa-7c93-46bf-9107-cb62abaace4f
09:51:55 - [UPLOAD BAKED TEXTURE HANDLER]: Received baked texture 4348070f-8afa-4e87-8c13-e31dce2ac7b4
09:51:55 - [UPLOAD BAKED TEXTURE HANDLER]: Received baked texture f0fc12ff-ddff-48a5-ab66-329a0a654e12
09:51:55 - [AVFACTORY]: Received texture update for randa agrawal 95aef5c3-3564-4440-bc83-538ea7e90623
09:51:55 - [UpdateBakedCache]: cache hits: 0 changed entries: 0 rebakes 5
09:51:56 - [UPLOAD BAKED TEXTURE HANDLER]: Received baked texture 229cfa99-e9d5-4a37-a857-5e30de3ab65e
09:51:56 - [UPLOAD BAKED TEXTURE HANDLER]: Received baked texture 360cb3f5-0534-4f91-8d1d-60ae95be3c79
09:51:56 - [UPLOAD BAKED TEXTURE HANDLER]: Received baked texture a4235be8-606b-4ac8-82e6-2b733d686e61
09:51:56 - [UPLOAD BAKED TEXTURE HANDLER]: Received baked texture 52286476-faf1-418e-bc61-6d51355269fa
09:51:56 - [UPLOAD BAKED TEXTURE HANDLER]: Received baked texture aaa0169f-655a-4d80-8329-d65f5fac0cba

Then LOTS and LOTS of exactly the same blocks of repeating messages each with cache hits: 0 changed entries: 0 rebakes 5 and differente bakes texture UUID in each block. Repeated until user moved off the region.

(0036063)
tampa (reporter)
2020-01-16 10:04

I would think a simple piece of code to check whether the same bake for the same uuid has been run more than X times in the last 30 seconds should be enough to at least prevent the spam. Going along with a red warning that potentially bad mesh or object is causing bake failures, that would be more helpful to the user compared to just console spam.
(0036066)
UbitUmarov (administrator)
2020-01-16 11:16

we can not change old opensim versions.
some viewers may decide to not suport those older opensim versions..
cool vl tries to work around that issue
Next Firestorm for opensim will also.

after this, old versions of opensim may need to use old versions of viewers.
(0036067)
aiaustin (developer)
2020-01-16 11:52

Ubit, I observed this on server code 0.9.2.0 latest dev master 2020-01-12 21:29.
(0036068)
UbitUmarov (administrator)
2020-01-16 11:55

Sorry, then the conditions that do trigger the issue, are not clear
(0036069)
aiaustin (developer)
2020-01-16 12:05
edited on: 2020-01-16 12:06

I will report what I can.

Visitor to region OSGrid region RuthAndRoth2 and was using Singularity Beta 1.8.7.7992. I will see if I can track down the visitor and ask what they might have on as an outfit.

Region running on Windows 10 using OSGrid 18-Dec-2019 release overwritten by 0.9.2.0 dev master code as at 2020-01-12 21:29.

(0036070)
UbitUmarov (administrator)
2020-01-16 12:11

if you have the logs, or next time, the rebake message does tell the layer(s) and uuids
(0036071)
UbitUmarov (administrator)
2020-01-16 13:03
edited on: 2020-01-17 01:18

That does seem an old Singularity. Tried to install a recent one, but installer failed to verify the package integrity on the last 2 versions.

(0036072)
aiaustin (developer)
2020-01-16 14:00
edited on: 2020-01-17 01:57

Does this longer log help? Log of user coming in to 0.9.2.0 dev master grid using Singularity Beta Singularity Beta 1.8.7.7992 - attached as 2020-01-16-Repeating-Rebakes-OpenSim.log.txt

Avatar involved was an OSGrid avatar and they told me that they only used a standard starter avatar on OSGrid (Elle).

(0036091)
tampa (reporter)
2020-01-18 04:18

What can sometimes help with worn mesh, rez it out in the region, let the textures load and then attach it to avatar rather than inventory. Also helps to clear region and viewer caches and then do that. There really is no single way to solve it from what I experienced.

The bigger issue is still the spamming, because that not only obfuscates other issues, but also ends up filling logs and memory. The console output should try to detect repeats or limit output when too much is being sent in X amount of time instead of the spam.
(0036092)
aiaustin (developer)
2020-01-18 08:11

But the underlying cause is repeated baking multiple times per second, with different UUIDs generated for the bakes each time as far as I can see.. and this with a simple default OSGrid avatar the user told me. However crazy a viewer goes we don’t really want the sever just taking what comes maybe.

However, recall the real purpose of this mantis issue is to note which viewers we see such issue on so those in touch with the viewer dev community can request or coordinate with viewer developers to fix things.
(0036094)
tampa (reporter)
2020-01-18 09:29

To fix the BoM issue you need more data, while in there might as well write code to suppress the log spam and gather the info needed. Whatever fix you apply, given this whole thing can be a total can of worms, may not solve all issues and more may arise. Having, then, a clear indication and readable log rather than spam is going to put down the groundwork to get future issues solved more effectively. That's really all I am after, while we are in the rabbit hole, might as well dig deeper you know.
(0036214)
Manwa Pastorelli (reporter)
2020-02-13 15:07

If I see this again I will try and log it, this is not, in my opinion, a BOM issue at its core. The last time I saw this was using Firestorm 6.02 on opensim 0.901.

In that case, taking the alpha layer off stopped the cycling, switching viewers also solved it. As did a teleport to another region on the same instance... yet it repeated over and over on one particular region. Sadly it no longer exists to go back and try again. I have since deleted the whole thing.
(0036215)
aiaustin (developer)
2020-02-14 01:13

I am not seeing this any longer when using a test version of Firestorm built for SL+OS which includes the changes to baking code made by Beq Janus, a Firestorm developer, and incorporated into the Firestorm main branch by 15-Jan-2020. Hopefully these will make their way into the next release if Firestorm that is prepared.

- Issue History
Date Modified Username Field Change
2020-01-16 02:33 aiaustin New Issue
2020-01-16 02:41 tampa Note Added: 0036059
2020-01-16 03:01 BillBlight Note Added: 0036060
2020-01-16 03:05 BillBlight Note Edited: 0036060 View Revisions
2020-01-16 06:04 aiaustin Note Added: 0036062
2020-01-16 06:05 aiaustin Note Edited: 0036062 View Revisions
2020-01-16 06:06 aiaustin Note Edited: 0036062 View Revisions
2020-01-16 06:07 aiaustin Note Edited: 0036062 View Revisions
2020-01-16 06:09 aiaustin Note Edited: 0036062 View Revisions
2020-01-16 10:04 tampa Note Added: 0036063
2020-01-16 11:16 UbitUmarov Note Added: 0036066
2020-01-16 11:52 aiaustin Note Added: 0036067
2020-01-16 11:55 UbitUmarov Note Added: 0036068
2020-01-16 12:05 aiaustin Note Added: 0036069
2020-01-16 12:06 aiaustin Note Edited: 0036069 View Revisions
2020-01-16 12:06 aiaustin Note Edited: 0036069 View Revisions
2020-01-16 12:11 UbitUmarov Note Added: 0036070
2020-01-16 13:03 UbitUmarov Note Added: 0036071
2020-01-16 14:00 aiaustin Note Added: 0036072
2020-01-17 01:18 aiaustin Note Edited: 0036072 View Revisions
2020-01-17 01:18 aiaustin Note Edited: 0036071 View Revisions
2020-01-17 01:19 aiaustin File Added: 2020-01-16-Repeating-Rebakes-OpenSim.log.txt
2020-01-17 01:57 aiaustin Note Edited: 0036072 View Revisions
2020-01-18 04:18 tampa Note Added: 0036091
2020-01-18 08:11 aiaustin Note Added: 0036092
2020-01-18 09:29 tampa Note Added: 0036094
2020-02-13 15:07 Manwa Pastorelli Note Added: 0036214
2020-02-14 01:13 aiaustin Note Added: 0036215


Copyright © 2000 - 2012 MantisBT Group
Powered by Mantis Bugtracker