qml6glmixer

qml6glmixer provides a way to render an almost-arbitrary QML scene within GStreamer pipeline using the same OpenGL context that GStreamer uses internally. This avoids attempting to share multiple OpenGL contexts avoiding increased synchronisation points and attempting to share an OpenGL context at runtime which some drivers do not like. The Intel driver on Windows is a notable example of the last point.

qml6glmixer will attempt to retrieve the windowing system display connection that Qt is using (#GstGLDisplay). This may be different to any already existing window system display connection already in use in the pipeline for a number of reasons. A couple of examples of this are:

Adding qml6glmixer to an already running pipeline
Not having any qml6glmixer (or qml6glsink, or qml6gloverlay) element start up before any other OpenGL-based element in the pipeline.

If one of these scenarios occurs, then there will be multiple OpenGL contexts in use in the pipeline. This means that either the pipeline will fail to start up correctly, a downstream element may reject buffers, or a complete GPU->System memory->GPU transfer is performed for every buffer.

The requirement to avoid this is that all elements share the same GstGLDisplay object and as Qt cannot currently share an existing window system display connection, GStreamer must use the window system display connection provided by Qt. This window system display connection can be retrieved by either a qml6glsink element, a qml6gloverlay element or a qmlglmixer element. The recommended usage is to have either elements (qml6glsinkorqml6gloverlayorqml6glmixer) be the first to propagate the GstGLDisplay for the entire pipeline to use by setting either element to the READY element state before any other OpenGL element in the pipeline.

In the dynamically adding qml6glmixer (or qml6glsink, or qml6gloverlay) to a pipeline case, there are some considerations for ensuring that the window system display and OpenGL contexts are compatible with Qt. When the qml6glmixer (or qml6glsink, or qml6gloverlay) element is added and brought up to READY, it will propagate it's own GstGLDisplay using the GstContext mechanism regardless of any existing GstGLDisplay used by the pipeline previously. In order for the new GstGLDisplay to be used, the application must then set the provided GstGLDisplay containing GstContext on the pipeline. This may effectively cause each OpenGL element to replace the window system display and also the OpenGL context it is using. As such this process may take a significant amount of time and resources as objects are recreated in the new OpenGL context.

All instances of qml6glmixer, qml6glsink, and qml6gloverlay will return the exact same GstGLDisplay object while the pipeline is running regardless of whether any qml6glmixer, qml6glsink, or qml6gloverlay elements are added or removed from the pipeline.

The Qml scene will run at configured output framerate. The timestamps on the output buffers are used to drive the animation time.

Hierarchy

GObject
    ╰──GInitiallyUnowned
        ╰──GstObject
            ╰──GstElement
                ╰──GstAggregator
                    ╰──GstVideoAggregator
                        ╰──GstGLBaseMixer
                            ╰──GstGLMixer
                                ╰──qml6glmixer

Factory details

Authors: – Matthew Waters

Classification: – Video/QML/Mixer

Rank – none

Plugin – qml6

Package – GStreamer Good Plug-ins

Pad Templates

`sink_%u`

video/x-raw(memory:GLMemory):
         format: { RGBA, BGRA, YV12 }
          width: [ 1, 2147483647 ]
         height: [ 1, 2147483647 ]
      framerate: [ 0/1, 2147483647/1 ]

Presence – request

Direction – sink

Object type – GstQml6GLMixerPad

`src`

video/x-raw(memory:GLMemory):
         format: RGBA
          width: [ 1, 2147483647 ]
         height: [ 1, 2147483647 ]
      framerate: [ 0/1, 2147483647/1 ]

Presence – always

Direction – src

Object type – GstAggregatorPad

Signals

qml-scene-destroyed

qml_scene_destroyed_callback (GstElement * param_0,
                              gpointer udata)

def qml_scene_destroyed_callback (param_0, udata):
    #python callback for the 'qml-scene-destroyed' signal

function qml_scene_destroyed_callback(param_0: GstElement * param_0, udata: gpointer udata): {
    // javascript callback for the 'qml-scene-destroyed' signal
}

Parameters:

param_0 –

No description available

udata –

No description available

Flags: Run Last

qml-scene-initialized

qml_scene_initialized_callback (GstElement * param_0,
                                gpointer udata)

def qml_scene_initialized_callback (param_0, udata):
    #python callback for the 'qml-scene-initialized' signal

function qml_scene_initialized_callback(param_0: GstElement * param_0, udata: gpointer udata): {
    // javascript callback for the 'qml-scene-initialized' signal
}

Parameters:

param_0 –

No description available

udata –

No description available

Flags: Run Last

Properties

qml-scene

“qml-scene” gchararray

The contents of the QML scene

Flags : Read / Write

Default value : NULL

root-item

“root-item” gpointer

The root QQuickItem from the qml-scene used to render

Flags : Read

The results of the search are