Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Validation / Test Coverage Status


Category

Subcategory

Existing/New FeatureTest Readiness

...

Category

...

Subcategory

...

Test Status

...

Test Scope

...

Open RDK Issues

...

Streaming apps

YouTube

...

UpgradePremium app

...

certification test suite

Netflix

...

Upgrade

Premium app certification test suite

Amazon Prime

...

Upgrade

Premium app certification test suite

Framework






Firebolt

...

Upgrade

...

...

•Firebolt JS test suite ( Yet to open source )

Firebolt Certification App ( FCA ) - Open sourcing in progress - Expected ETA - Aug EOM 

Ripple

NewFirebolt Certification App ( FCA ) - Open sourcing in progress - Expected ETA - Aug EOM 

Lightning

Upgrade

Exercise different lightning apps - Refer animation test apps under TDK MVS Test Apps Media Playback And Graphics Validation Test Setup

Strike test tool - https://strike.lightningjs.io/es6/#home

QT for BLE

ExistingManual tests using BLE remote.

Core Thunder framework

Upgrade

...

Ripple

...

Not available

...

Lightning

...

Not available

...

QT for BLE

...

Not available

...

Core Thunder framework

Available

...

...

Testing Areas

  • Execute rdkservices plugins test
  • Perform System testing
  • Perform Bootup testing
  • Execute Performance testing
  • Perform WebApp testing

Browser - WPEWebkit

...

Upgrade

Browser

...

...

...

Existing

Test coverage using Xcast RDK service

...

Jira
serverJIRA - 2
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyREFPLTV-1591

Jira
serverJIRA - 2
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyRTD131X-571

- RDK API And Event Certification Suite 

Manual tests for real screen validation

Security

DAC (Containerization)

...

Not available

...

...

In Progress

...

•Dobby test tool enhancement and integration

...

Jira
serverJIRA - 2
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyRDKSEC-153

...

Rialto 

...

In Progress

...

•Playback tests using Rialto sink

...

Jira
serverJIRA - 2
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyREFPLTV-1594

...

titleRiato

Attendees – Abhishek, Sahithya, Sravanthi, Sudhagar, Anil

...

...

Packager (Lisa)

...

Not available

...

TBD

...

AppArmor 

...

Not available

...

TBD

...

Q1

NewAppArmor Test Framework

Graphics

Rendering

...

ExistingWesteros ESSOS test apps

...

...

GstreamerGstreamer

...

ExistingGstreamer unit tests
Gstreamer SoC SDK

...

ExistingFirebolt Native Apps Compliance Suite

DRM & Content protection

PlayReady

...

Partially available

...

...

Browser Playback tests using DASHIF test streams

...

...

Not available

...

New

Verimatrix

...

Not available

New

Build & Platform

Yocto version

...

Existing

Kernel

...

ExistingKernel

...

Test Framework

Init system

...

ExistingBasic sanity and Performance tests

Application Manager

...

ExistingRDK Shell service test coverage

...

...

Improve the application management test coverage

...

Broadcom SDK

Existing

...

HAL Certification Suite

Video Player 

 IP

...

Existing

Media

...

...

...

 DVB

...

ExistingDVB RDK service test coverage

...

...

•DVB component and HAL test coverage

 ATSC

ExistingNA

...

 ATSC

...

 TSB

...

...

...

Jira
serverJIRA - 2
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyREFPLTV-1595

Jira
serverJIRA - 2
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyRTD131X-578

...

 DAC Apps

...

Not available

(Test cases/streams for Live protected contents are not available)

 DAC Apps

ExistingContainerization Test Framework 
RDK API And Event Certification Suite 

Remote Control and Voice

Voice Stack

...

Not available

New


Manual tests for voice remote

•RDK Service test coverage

...


RF4CE remote

Existing

BLE voice remote

Existing

External Audio support

Existing

Networking

Wi-Fi

...

Existing

...

•Wi-Fi service test coverage

...

...

HAL test coverage

...

RDK API And Event Certification Suite

LAN

...

ExistingTest execution using ethernet connected DUT

Device Management

Telemetry

...

Not available


Automatics Tests

Feature Control

...

Not available

...


Automatics Tests
Crash Upload

...


Automatics Tests

...

TBD

...

Firmware Upgrade

...

Not available

Firmware Upgrade


Xconf firmware upgrade tests via System service RDK API And Event Certification Suite

Webpa


Automatics tests


Validation Platforms

  •  Validation support for a single build ( 32 bit ) on each platform
  •  Along with regular RDK builds for RPI HYB and RPI MC, separate Alexa enabled build for the same.
  •  UEI Tatlow, T4H Lima RCUs supported platform builds for validation.

Platform NameRemarks
1RPI HYB




Complete test suites execution for each RDK6 RC builds

2RPI MC
3Realtek SOC Reference
4Amlogic SOC Reference
5Broadcom SOC Reference
6Sercomm - Realtek Video Accelerator
7Skyworth - Amlogic Video Accelerator
8Sagemcom - Broadcom Video Accelerator
9Amlogic TVApplicable test suites execution.

Validation Process

  • Flash the devices using RDK6 RC builds provided by CMF.
  • Run the tests available in TDK, Automatics and Manual tests against each feature.
  • Attach the test reports including defect mapping in the feature ticket and also provide the tested image details in ticket.
  • Link all open RDK/SOC/OEM issues identified as part of the feature validation in the corresponding feature ticket.
  • If there are no failures then will resolve the ticket as Verified , otherwise Failed and assign back to developer.

...

Defect Dashboard

                            Overall defect summary                                                                                                 

Jira Charts
bordertrue
showinfortrue
serverJIRA - 2
jqllabels%20%3D%20RDK6_featurefeature%20and%20type%3Dbug
statTypestatuses
chartTypepie
width700
isAuthenticatedtrue
serverId11deff04-0380-3a3d-a916-0849d4e573f7

Open                          Open Issues


Jira
serverJIRA - 2
columnIdsissuekey,summary,issuetype,created,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,due,assignee,reporter,priority,status,resolution
maximumIssues20
jqlQuerylabels = RDK6_feature and type=bug
serverId11deff04-0380-3a3d-a916-0849d4e573f7

...