ScriptEngines

From OpenSimulator

(Difference between revisions)
Jump to: navigation, search
m
(OpenSim.ini Settings)
 
(23 intermediate revisions by 4 users not shown)
Line 1: Line 1:
__NOTOC__
 
 
{{Quicklinks}}
 
{{Quicklinks}}
 
<br />
 
<br />
Line 5: Line 4:
 
== Script Engines ==
 
== Script Engines ==
  
This page deals with common parts of scripting and with [[XEngine]]. For [[DotNetEngine]], also see [[OpenSim.Region.ScriptEngine]]
+
OpenSimulator supports scripting via script engines. Script engines are normal region modules.
  
:Note: This page represents an implementation goal. Much of this already works, but some parts are not implemented yet.
+
This page deals with common parts of script engines.<br>
 +
OpenSimulator currently has two public script engines XEngine and YEngine.<br>
 +
For more information, please see [[XEngine]] and [[YEngine]].  
  
OpenSim supports scripting via script engines.
+
For information on the old DotNetEngine which was deprecated in OpenSimulator 0.6.8 and subsequently removed from the core tree, please see [[DotNetEngine]] and [[OpenSim.Region.ScriptEngine]].
  
Script engines are normal region modules, but creating one as a shared module has not yet been tried.
+
:Note: This page represents an implementation goal. Much of this already works, but some parts are not implemented yet.
  
== Changes (If you were running XEngine and it went back to DotNetEngine after r6420, read here) ==
+
== OpenSim.ini Settings ==
 
Multiple script engines can now be active at once. The script_engine directive in OpenSim.ini is no longer used!  
 
Multiple script engines can now be active at once. The script_engine directive in OpenSim.ini is no longer used!  
 
Instead, in the [Startup] section, you will now find
 
Instead, in the [Startup] section, you will now find
 
<source lang="ini">
 
<source lang="ini">
DefaultScriptEngine = "ScriptEngine.DotNetEngine"
+
DefaultScriptEngine = "XEngine"
 
</source>
 
</source>
DotNetEngine is the default, to change it to XEngine, change the comments to activate the line
+
XEngine is the default, to change it to any other engine, change the comments to activate the line
 
<source lang="ini">
 
<source lang="ini">
DefaultScriptEngine = "XEngine"
+
DefaultScriptEngine = (some engine name)
 
</source>  
 
</source>  
Each engine can also be disabled by inserting
+
XEngine can also be disabled by setting
 
<source lang="ini">
 
<source lang="ini">
 +
[XEngine]
 
Enabled = false
 
Enabled = false
 
</source>  
 
</source>  
into its config section. These default to true for both engines.
+
These default to true.
+
From this version on, OpenSim is able to run multiple script engines simultaneously. The default is the DotNetEngine.
+
 
   
 
   
If these new options are absent, DotNetEngine will operate.
+
OpenSimulator should be able to run multiple script engines simultaneously, but this should be avoid
  
==Multiple script engine usage==
+
== Multiple script engine usage ==
  
To run a script on a specific engine, begin the script with:
+
To run a script on a specific engine, begin the script with a first line like:
 
<source lang="lsl">
 
<source lang="lsl">
//XEngine: or //ScriptEngine.DotNetEngine:
+
//XEngine: or //someOtherEngineName:
 
</source>
 
</source>
 
Optionally, this can be followed by a language code:
 
Optionally, this can be followed by a language code:
 
<source lang="lsl">  
 
<source lang="lsl">  
 
//XEngine:lsl
 
//XEngine:lsl
//ScriptEngine.DotNetEngine:c#
+
//someOtherEngineName:lsl
 
</source>
 
</source>
 
Beware: there is a little side effect. If you start your script with anything like
 
Beware: there is a little side effect. If you start your script with anything like
Line 56: Line 56:
 
Compilers take script text and convert it to a .NET assembly. Such an assembly needs to reference a runtime, which provides API stubs.
 
Compilers take script text and convert it to a .NET assembly. Such an assembly needs to reference a runtime, which provides API stubs.
  
This calls out of the appdomain to the API implementation.
+
Currently, a compiler exists for lsl.
  
Currently, a compiler exists for lsl, c#, j# and vb. YieldProlog (yp) can be added to c# scripts.
+
A runtime exists for the LSL API and for the OSSL API. [[LSL Status/Functions]]
  
A runtime exists for the LSL API and for the OSSL API. [[LSL_Status/Functions]]
+
The following describes the directory structure(under /OpenSim/Region/):
 
+
The runtime and compiler are not dependent on each other, and also not dependent on the script engine.
+
 
+
The following describes the directory structure:
+
  
 
{|style="margin-left:20px;"
 
{|style="margin-left:20px;"
|ScriptEngines/DotNetEngine/||The engine itself. Methods to manage threads, AppDomains, etc
 
|-
 
 
|ScriptEngines/XEngine/||The engine itself. Methods to manage threads, AppDomains, etc
 
|ScriptEngines/XEngine/||The engine itself. Methods to manage threads, AppDomains, etc
 
|-
 
|-
Line 80: Line 74:
 
|-
 
|-
 
|ScriptEngines/Shared/Api/Runtime/||The Api runtimes (see below)
 
|ScriptEngines/Shared/Api/Runtime/||The Api runtimes (see below)
|-
 
|ScriptEngines/Shared/Api/Runtime/YieldProlog/||The Yield Prolog runtime
 
 
|}
 
|}
  
  
An API is defined as an implementation, and interface and a runtime. The reason for this seemingly complicated approach has to do with scripts running in AppDomains apart from the normal OpenSim code.
+
An API is defined as an implementation, and interface and a runtime. The reason for this seemingly complicated approach has to do with scripts running in AppDomains apart from the normal OpenSimulator code.
  
 
Creating an API is pretty straightforward, but a few naming conventions must be observed for the Api to function correctly. The script runtime uses reflection to match Api runtimes to implementations, and it uses names to find these matches.
 
Creating an API is pretty straightforward, but a few naming conventions must be observed for the Api to function correctly. The script runtime uses reflection to match Api runtimes to implementations, and it uses names to find these matches.
Line 99: Line 91:
 
         internal SceneObjectPart m_host;
 
         internal SceneObjectPart m_host;
 
         internal uint m_localID;
 
         internal uint m_localID;
         internal LLUUID m_itemID;
+
         internal UUID m_itemID;
 
   
 
   
         public void Initialize(IScriptEngine ScriptEngine, SceneObjectPart host, uint localID, LLUUID itemID)
+
         public void Initialize(IScriptEngine ScriptEngine, SceneObjectPart host, uint localID, UUID itemID)
 
         {
 
         {
 
             m_ScriptEngine = ScriptEngine;
 
             m_ScriptEngine = ScriptEngine;
Line 176: Line 168:
 
The directory OpenSim/Region/ScriptEngines/Shared/CodeTools contains all compilers, converters and other code manipulation tools. It is shared between all script engines. Because of the shared compiler, the script engines can also share compiled assemblies, eliminating the need to recompile each script for each script engine.
 
The directory OpenSim/Region/ScriptEngines/Shared/CodeTools contains all compilers, converters and other code manipulation tools. It is shared between all script engines. Because of the shared compiler, the script engines can also share compiled assemblies, eliminating the need to recompile each script for each script engine.
  
 +
== Code generation ==
 +
 +
LSL to C# code generation is common to all script engines.  This is currently done by translating LSL to C# code and then compiling it.  Compiled code then calls methods in LSL_Api.cs (OpenSim/Region/ScriptEngine/Shared/Api/Implementation/LSL_Api.cs) that correspond to LSL functions or methods in OSSL_Api.cs for OSSL functions, etc.
 +
 +
Since OpenSimulator 0.7.4, there is also a mechanism for making script functions available from region modules without patching OpenSimulator itself.  See [[OSSL_Script_Library/ModInvoke]] for more details.
 +
 +
Parsing the LSL script is kicked off by CSCodeGenerator.Convert() (OpenSim/Region/ScriptEngine/Shared/CodeTools/CSCodeGenerator.cs).  This takes the LSL and uses a parser/lexer to convert into in an abstract syntax tree (AST), before then converting that AST to C# via the LSL2CSCodeTransformer.
 +
 +
The parser (lsl.parser.cs) and lexer (lsl.lexer.cs) are generated using Malcolm Crowe's compiler tools in C# from the trunk/managed/lsl2cs directory in the [[Opensim-libs_git_repository|opensim-libs repository]] from the lsl.parser and lsl.lexer files.  '''Note that if you regenerate this, you will need to change the penultimate number on the arr array in the generated ArgumentDeclarationList_5 class in lsl.parser.cs from 1 to 0.  We need to find out why this bug occurs.'''
 +
 +
The converted C# is then compiled to a DLL by the OpenSimulator Compiler class (via the PerformScriptCompile() method that also triggered LSL -> C# conversion as described above).
 +
 +
You can see the tranformed C# that was compiled by setting
 +
 +
<source lang='ini'>
 +
[XEngine]
 +
WriteScriptSourceToDebugFile = true
 +
</source>
 +
 +
in your OpenSim.ini file.  This will appear in the bin/ScriptEngines/<region-id>/ directory with the filename CommonCompiler_source_CommonCompiler_compiled_<script-asset-id>.lsl.
  
 
[[Category:Scripting]]
 
[[Category:Scripting]]

Latest revision as of 04:22, 22 September 2020


Contents

[edit] Script Engines

OpenSimulator supports scripting via script engines. Script engines are normal region modules.

This page deals with common parts of script engines.
OpenSimulator currently has two public script engines XEngine and YEngine.
For more information, please see XEngine and YEngine.

For information on the old DotNetEngine which was deprecated in OpenSimulator 0.6.8 and subsequently removed from the core tree, please see DotNetEngine and OpenSim.Region.ScriptEngine.

Note: This page represents an implementation goal. Much of this already works, but some parts are not implemented yet.

[edit] OpenSim.ini Settings

Multiple script engines can now be active at once. The script_engine directive in OpenSim.ini is no longer used! Instead, in the [Startup] section, you will now find

DefaultScriptEngine = "XEngine"

XEngine is the default, to change it to any other engine, change the comments to activate the line

DefaultScriptEngine = (some engine name)

XEngine can also be disabled by setting

[XEngine]
Enabled = false

These default to true.

OpenSimulator should be able to run multiple script engines simultaneously, but this should be avoid

[edit] Multiple script engine usage

To run a script on a specific engine, begin the script with a first line like:

//XEngine: or //someOtherEngineName:

Optionally, this can be followed by a language code:

//XEngine:lsl
//someOtherEngineName:lsl

Beware: there is a little side effect. If you start your script with anything like

//any text you want:

(starting with "//" and ending with ":") you'll get an error

"Selected engine unavailable. Running script on XEngine"

A script engine defines a way to load and run a script. It uses compilers and runtimes to accomplish this.

Compilers take script text and convert it to a .NET assembly. Such an assembly needs to reference a runtime, which provides API stubs.

Currently, a compiler exists for lsl.

A runtime exists for the LSL API and for the OSSL API. LSL Status/Functions

The following describes the directory structure(under /OpenSim/Region/):

ScriptEngines/XEngine/ The engine itself. Methods to manage threads, AppDomains, etc
ScriptEngines/Interfaces/ Common interfaces used to create script engines and components
ScriptEngines/Shared/CodeTools/ The currrent compiler
ScriptEngines/Shared/Api/Interface/ The Api interfaces (see below)
ScriptEngines/Shared/Api/Implementation/ The Api implementations (see below)
ScriptEngines/Shared/Api/Runtime/ The Api runtimes (see below)


An API is defined as an implementation, and interface and a runtime. The reason for this seemingly complicated approach has to do with scripts running in AppDomains apart from the normal OpenSimulator code.

Creating an API is pretty straightforward, but a few naming conventions must be observed for the Api to function correctly. The script runtime uses reflection to match Api runtimes to implementations, and it uses names to find these matches.

First, create your API implementation.

namespace OpenSim.Region.ScriptEngine.Shared.Api
 {
     public class XXX_Api: MarshalByRefObject, IXXX_Api, IScriptApi
     {
        internal IScriptEngine m_ScriptEngine;
        internal SceneObjectPart m_host;
        internal uint m_localID;
        internal UUID m_itemID;
 
        public void Initialize(IScriptEngine ScriptEngine, SceneObjectPart host, uint localID, UUID itemID)
        {
            m_ScriptEngine = ScriptEngine;
            m_host = host;
            m_localID = localID;
            m_itemID = itemID;
        }
 
        public void myApiFunction()
        {
        }
     }
 }

Here, the class name (XXX_Api) is used by reflection, it must end in "_Api" to be recognized as an Api.

Place the file in OpenSim/Region/ScriptEngines/Shared/Api/Implementaton/

By convention, it should be named XXX_Api.cs


Next, create an interface to link the Api to the runtime:

namespace OpenSim.Region.ScriptEngine.Shared.Api.Interfaces
 {
     public interface IXXX_Api
     {
         void myApiFunction();
     }
 }

Place this file in OpenSim/Region/ScriptEngines/Api/Interface, named IXXX_Api.


Now, the stub file is needed to connect the script to the Api. This stub file will be loaded into the script AppDomain, and should not contain any processing. It merely forwards the calls to the Api outside of the AppDomain.

namespace OpenSim.Region.ScriptEngine.Shared.ScriptBase
 {
     public partial class ScriptBaseClass : MarshalByRefObject
     {
         public IXXX_Api m_XXX_Functions;
 
         public void ApiTypeXXX(IScriptApi api)
         {
             if(!(api is IXXX_Api))
                 return;
 
             m_XXX_Functions = (IXXX_Api)api;
         }
 
         public void myApiFunction()
         {
             m_XXX_Functions.myApiFunction();
         }
     }
 }

Save this in OpenSim/Region/ScriptEngines/Shared/Api/Runtime, name it XXX_Stub.cs

Here, the ApiTypeXXX naming is the mandatory name, by which the script engine recognizes this Api and matches it up to the API implementation.

Please note that your Api here becomes a part of a partial class, which, in turn, becomes the base class of the script.

On script load, the Api runtime (stub) is called with a reference to the IScriptApi interface of the implementation. That, cast to the custom interface, is used to access the function implementations.

The reason we cannot directly reference the implementation is that that would cause the entire implementation to be loaded into the script's AppDomain. We need to avoid this to keep the memory footprint small.


The directory OpenSim/Region/ScriptEngines/Shared/CodeTools contains all compilers, converters and other code manipulation tools. It is shared between all script engines. Because of the shared compiler, the script engines can also share compiled assemblies, eliminating the need to recompile each script for each script engine.

[edit] Code generation

LSL to C# code generation is common to all script engines. This is currently done by translating LSL to C# code and then compiling it. Compiled code then calls methods in LSL_Api.cs (OpenSim/Region/ScriptEngine/Shared/Api/Implementation/LSL_Api.cs) that correspond to LSL functions or methods in OSSL_Api.cs for OSSL functions, etc.

Since OpenSimulator 0.7.4, there is also a mechanism for making script functions available from region modules without patching OpenSimulator itself. See OSSL_Script_Library/ModInvoke for more details.

Parsing the LSL script is kicked off by CSCodeGenerator.Convert() (OpenSim/Region/ScriptEngine/Shared/CodeTools/CSCodeGenerator.cs). This takes the LSL and uses a parser/lexer to convert into in an abstract syntax tree (AST), before then converting that AST to C# via the LSL2CSCodeTransformer.

The parser (lsl.parser.cs) and lexer (lsl.lexer.cs) are generated using Malcolm Crowe's compiler tools in C# from the trunk/managed/lsl2cs directory in the opensim-libs repository from the lsl.parser and lsl.lexer files. Note that if you regenerate this, you will need to change the penultimate number on the arr array in the generated ArgumentDeclarationList_5 class in lsl.parser.cs from 1 to 0. We need to find out why this bug occurs.

The converted C# is then compiled to a DLL by the OpenSimulator Compiler class (via the PerformScriptCompile() method that also triggered LSL -> C# conversion as described above).

You can see the tranformed C# that was compiled by setting

[XEngine]
WriteScriptSourceToDebugFile = true

in your OpenSim.ini file. This will appear in the bin/ScriptEngines/<region-id>/ directory with the filename CommonCompiler_source_CommonCompiler_compiled_<script-asset-id>.lsl.

Personal tools
General
About This Wiki