Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

For HLS, AAMP uses software demux which is a part of AAMP code by default. If codec info is not in the manifest, AAMP does not demux the TS fragments, which causes h/w demux gstreamer element of the platform to be used by playbin to demux the TS fragments. In summary, AAMP outputs elementary streams on using s/w demux, else output mpeg TS buffers which results in hardware demux to be used.

HLS on Broadcom

...

Device (UVE and S/W Demux)

AAMP manages the pipeline. For audio and video there are separate playbins. AAMP provides audio/video elementary stream to the playbins using appsrc. Playbin connects platform decoder and sink elements using the capability of the  appsrc src pads.

Pipeline graph


HLS on Broadcom

...

Device (UVE, H/W Demux)

AAMP manages the pipeline. AAMP provides  TS  to the playbins using appsrc. Playbin connects platform ts-demux, decoder and sink elements.

Pipeline graph



DASH Widevine on Broadcom

...

Device (UVE)

AAMP manages the pipeline. For audio and video there are separate playbins. AAMP provides audio/video fragmented mp4 buffers to the playbins using appsrc. Playbin connects qtdemux, platform decoder and sink elements using the capability of the src pads.

...

For DASH streams, AAMP downloads and injects ISO-BMFF fragments to gstreamer pipeline. Demuxing is done by opensource qtdemux gstreamer plugin. To achieve PTS re-stamping to achieve desired rate/ continuity across period boundaries, AAMP has added custom patches to qtdemux gstreamer plugin. These patches support custom events from AAMP.

...

.

...

https://gerrit.teamccp.com/plugins/gitiles/rdk/yocto_oe/layers/meta-rdk-ext/+/refs/heads/stable2/recipes-multimedia/gstreamer/files/

0009-qtdemux-aamp-tm.patch

This patch adds support for PTS restamping of outgoing buffers from qtdemux based on  a custom event aamp_override. App can override the base PTS which  is to be used as base for restamping using property "basePTS". If it is not proved, PTS of first fragment will be used as base PTS. 

...

0021-qtdemux-aamp-tm-multiperiod.patch

https://gerrit.teamccp.com/plugins/gitiles/rdk/yocto_oe/layers/meta-rdk-ext/+/refs/heads/stable2/recipes-multimedia/gstreamer/files/0021-qtdemux-aamp-tm-multiperiod.patch

On period transition during trickmode, PTS of the new fragment changes. To ensure smooth trickplay experience, PTS restamping should be continuous. This patch ensures this using aamp-tm-disc event. Fragments after this event has PTS very different from previous fragments. So base PTS has to be recalculated to have continuous trick play experience at this point. PTS offset is calculated by adding last restamped PTS prior to the event and expected delay between Iframes. Base PTS is reset. PTS offset is added to the recalculated PTS on next fragments. 

...

If content is encrypted with Widevine or Playready DRM, aamp decryptor elements )aampplayreadydecryptor or aampwidevinedecryptor) are automatically plugged in after qtdemux by playbin. These elements decrypt samples using opencdm interface.

Pipeline graph

HTML5 Video Tag based playback on Broadcom

...

Device

Here Webkit manages the pipeline. aampsrc is a dummy gstreamer source just to handle aamp:// protocol. aamp element fetches manifets/playlists and fragments, demuxes TS fragment in case of HLS, injects buffers to the downstream element using srcpads. RDK WPE uses Westeros sink gstreamer element as video sink.

...

Broadcom SOC element properties used by AAMP

Element

Property

Description

brcmvideosinkrectangleSet video output rectangle
brcmvideosinkzoom-modeSet video zoom
brcmvideosinkshow-video-windowHide/Show video window
brcmvideosinkenable-reject-prerollNot used anymore
brcmaudiodecoderlimit_bufferingLimit buffering to avoid audio drops during VG on/off
brcmaudiodecoderlimit_buffering_msBuffering duration in milliseconds. Used along with limit_buffering property.
brcmaudiosinkmutemute/unmute audio
brcmaudiosinkvolumeSet audio volume
brcmvideodecodervideo-ptsPTS of last decoded stream. Used to identify EOS/ stall detection
brcmvideodecoderbuffered_bytesGet buffered bytes from decoder. Used for buffering logic
brcmvideodecoderqueued_framesGet number of queued frames from decoder. Used for buffering logic
brcmvideodecodervideodecoderGet videodecoder handle to be used by CC module

Intel gstreamer element properties used by AAMP


Element

Property

Description

ismdgstaudiosinksyncEnsure audio/video synchronisation with playbin playback.
ismdgstaudiosinkinput-gainmute/unmute audio
ismdgstvidsinkstop-keep-frameHide/ continue to show last frame after stop.
ismdgstvidsinkrectangleSet the video output rectangle
ismdgstvidsinkscale-modeSet the video zoom
ismdgstvidsinkcrop-linesDisable cropping. Cropping enabled results in glitches during ABR transitions.
ismdgstvidsinkmuteHide/Show video window
ismdgstvidsinkreuse-vidrendReuse video renderer to avoid glitches during seek.
ismdgsth264viddecdecode-handleGet videodecoder handle to be used by CC module
ismdgstaudiosinkvolumeSet audio volume