Versions Compared

Old Version 25

changes.mady.by.user Vimal K S

Saved on

compared with

New Version Current

changes.mady.by.user Vimal K S

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Validation / Test Coverage Status


...

Category

Subcategory

Existing/

...

New FeatureTest

...

Test Scope

...

Open RDK Issues

...

Readiness

Streaming apps

YouTube

Upgrade

...

Premium app

...

certification test suite

Netflix

Upgrade

...

Available

Premium app certification test suite

Amazon Prime

Upgrade

...

Available

...

Premium app certification test suite

Framework






Firebolt

Upgrade

...

Partially available

Firebolt Native Apps Compliance

...

Suite

•Firebolt JS test suite ( Yet to open source )

Firebolt Certification App ( FCA ) - Open sourcing in progress - Expected ETA - Aug EOM 

Ripple

NewFirebolt Certification App ( FCA ) - Open sourcing in progress - Expected ETA - Aug EOM 

Lightning

Upgrade

Exercise different lightning apps - Refer animation test apps under TDK MVS Test Apps Media Playback And Graphics Validation Test Setup

Strike test tool - https://strike.lightningjs.io/es6/#home

QT for BLE

ExistingManual tests using BLE remote.

Core Thunder framework

Upgrade

...

Ripple

...

Not available

...

Lightning

...

Not available

...

QT for BLE

...

Not available

...

Core Thunder framework

Available

...

RDK API And Event Certification Suite

...

Testing Areas

  • Execute rdkservices plugins test
  • Perform System testing
  • Perform Bootup testing
  • Execute Performance testing
  • Perform WebApp testing

Browser - WPEWebkit

...

Upgrade

Browser

...

Performance Suite 

...

rdkcentral/MVT: Media Validation Tool for verification of browser's media playback capabilities 

Screen cast

DIAL

...

Existing

Test coverage using Xcast RDK service

...

Jira
serverJIRA - 2
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyREFPLTV-1591

Jira
serverJIRA - 2
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyRTD131X-571

- RDK API And Event Certification Suite 

Manual tests for real screen validation

Security

DAC (Containerization)

...

Not available

...

NewContainerization Test Framework 

Dobby

...

In Progress

...

•Dobby test tool enhancement and integration

...

Jira
serverJIRA - 2
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyRDKSEC-153

...

Rialto 

...

In Progress

...

•Playback tests using Rialto sink

...

Jira
serverJIRA - 2
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyREFPLTV-1594

...

Expand
titleRiato

Attendees – Abhishek, Sahithya, Sravanthi, Sudhagar, Anil

  • Rialto end purpose is to run in Container mode, till now feature is integrated and tested clear stream playback with Youtube (non-container). Exact containerization mode playback will be added in next releases.
  • Rialto design approach is still in discussion with Sky team on using Rialto sink elements instead of existing Westeros sink
  • TDK playback check with mediapipeline app is fine and timeout issue fix will be pushed from platform team side
  • Other operations like play/pause, seek, trickplay - not sure how well it might work in Rialto. As Rialto is not production ready , may not work similar way as westeros sink.
  • Usage of Youtube specific configuration in the steps - names can be changed, will be taken up as low priority.
New

Containerization Test Framework 

Rialto 

NewRialto Gstreamer Test Framework  

Packager (Lisa)

...

Not available

...

TBD

NewRDK API And Event Certification Suite 

...

AppArmor 

...

Not available

...

TBD

...

Q1

NewAppArmor Test Framework

Graphics

Rendering

...

ExistingWesteros ESSOS test apps

...

•

- Firebolt Native Apps Compliance Suite 
Graphics ( OpenGL ES )ExistingGlmark2 - Hardware Performance Suite 

...

GstreamerGstreamer

...

Existing

...

Gstreamer unit tests
Gstreamer SoC SDK

...

ExistingFirebolt Native Apps Compliance Suite

...

DRM & Content protection

PlayReady

...

Partially available

Existing

Media Playback And Graphics Validation Suite

...

Widevine

...

Browser Playback tests using DASHIF test streams

...

rdkcentral/MVT: Media Validation Tool for verification of browser's media playback 

Widevine

Existing

Media Playback And Graphics Validation Suite

Common SVP

...

Not available

...

New

Verimatrix

...

Not available

New

Build & Platform

Yocto version

...

Existing

Kernel

...

ExistingKernel

...

Test Framework

Init system

...

ExistingBasic sanity and Performance tests

...

Application Manager

...

Existing

...

Available

RDK Shell service test coverage

...

, RDK API And Event Certification Suite

...

Improve the application management test coverage

...

Q1

Broadcom SDK

...

ExistingHAL Certification Suite

Video Player 

 IP

...

Available

Existing

Media Playback And Graphics Validation Suite

...

rdkcentral/MVT: Media Validation Tool for verification of browser's media playback 

 QAM

ExistingNA

...

•

 DVB

...

ExistingDVB RDK service test coverage

...

, RDK API And Event Certification Suite

...

•DVB component and HAL test coverage

 ATSC

ExistingNA

...

 ATSC

...

 TSB

...

NewFog test coverage

...

•

...

Jira
serverJIRA - 2
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyREFPLTV-1595

Jira
serverJIRA - 2
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyRTD131X-578

...

 DAC Apps

...

Not available

(Test cases/streams for Live protected contents are not available)

 DAC Apps

ExistingContainerization Test Framework 
RDK API And Event Certification Suite 

Remote Control and Voice

Voice Stack

...

Not available

...

•RDK Service test coverage

•Voice HAL test coverage

New


Manual tests for voice remote


RF4CE remote

Existing

BLE voice remote

Existing

External Audio support

Existing

Networking

Wi-Fi

...

Existing

...

•Wi-Fi service test coverage

...

, RDK API And Event Certification Suite

•Wi-Fi

...

HAL test coverage

...

, HAL Certification Suite

RDK API And Event Certification Suite

LAN

...

ExistingTest execution using ethernet connected DUT

Device Management

Telemetry

...

Not available


Automatics Tests

Feature Control

...

Not available

...


Automatics Tests
Crash Upload

...


Automatics Tests

...

TBD

...

Firmware Upgrade

...

Not available

Firmware Upgrade


Xconf firmware upgrade tests via System service RDK API And Event Certification Suite

Webpa


Automatics tests


Validation Platforms

  •  Validation support for a single build ( 32 bit ) on each platform
  •  Along with regular RDK builds for RPI HYB and RPI MC, separate Alexa enabled build for the same.
  •  UEI Tatlow, T4H Lima RCUs supported platform builds for validation.

Platform NameRemarks
1RPI HYB




Complete test suites execution for each RDK6 RC builds

2RPI MC
3Realtek SOC Reference
4Amlogic SOC Reference
5Broadcom SOC Reference
6Sercomm - Realtek Video Accelerator
7Skyworth - Amlogic Video Accelerator
8Sagemcom - Broadcom Video Accelerator
9Amlogic TVApplicable test suites execution.

Validation Process

  • Flash the devices using RDK6 RC builds provided by CMF.
  • Run the tests available in TDK, Automatics and Manual tests against each feature.
  • Attach the test reports including defect mapping in the feature ticket and also provide the tested image details in ticket.
  • Link all open RDK/SOC/OEM issues identified as part of the feature validation in the corresponding feature ticket.
  • If there are no failures then will resolve the ticket as Verified , otherwise Failed and assign back to developer.

...

Defect Dashboard

                            Overall defect summary                                                                                                 

Jira Charts
bordertrue
showinfortrue
serverJIRA - 2
jqllabels%20%3D%20RDK6_featurefeature%20and%20type%3Dbug
statTypestatuses
chartTypepie
width700
isAuthenticatedtrue
serverId11deff04-0380-3a3d-a916-0849d4e573f7

Open                          Open Issues


Jira
serverJIRA - 2
columnIdsissuekey,summary,issuetype,created,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,due,assignee,reporter,priority,status,resolution
maximumIssues20
jqlQuerylabels = RDK6_feature and type=bug
serverId11deff04-0380-3a3d-a916-0849d4e573f7

...