Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

JoseArunAkhilAnil/SudhagarDeepthiDeepthiDeepthiArunAkhilAkhilShibuShibuAkhil

Category

Subcategory

Existing/New FeatureDev
Owner
Dev ReadinessTest Readiness

Streaming apps

YouTube

UpgradeShibuPremium app certification test suite

Netflix

UpgradeShibu

Premium app certification test suite

Amazon Prime

UpgradeShibu

Premium app certification test suite

Framework






Firebolt

UpgradeJose

Firebolt Native Apps Compliance Suite

Firebolt Certification App ( FCA ) - Open sourcing in progress - Expected ETA - Aug EOM 

Ripple

NewFirebolt Certification App ( FCA ) - Open sourcing in progress - Expected ETA - Aug EOM 

Lightning

UpgradeSuresh

Exercise different lightning apps - Refer animation test apps under TDK MVS Test Apps Media Playback And Graphics Validation Test Setup

Strike test tool - https://strike.lightningjs.io/es6/#home

QT for BLE

ExistingManual tests using BLE remote.

Core Thunder framework

Upgrade

RDK API And Event Certification Suite

Testing Areas

  • Execute rdkservices plugins test
  • Perform System testing
  • Perform Bootup testing
  • Execute Performance testing
  • Perform WebApp testing

Browser - WPEWebkit

UpgradeAkhil

Browser Performance Suite 

rdkcentral/MVT: Media Validation Tool for verification of browser's media playback capabilities 

Screen cast

DIAL

Existing

Test coverage using Xcast RDK service - RDK API And Event Certification Suite 

Manual test tests for real screen validation

Security

DAC (Containerization)

NewContainerization Test Framework - Framework 

Dobby

NewDeepthi

Containerization Test Framework 

Rialto 

NewRialto Gstreamer Test Framework  

Packager (Lisa)

NewRDK API And Event Certification Suite 

AppArmor 

NewDeepthiAppArmor Test Framework

Graphics

Rendering

ExistingWesteros ESSOS test apps - Firebolt Native Apps Compliance Suite 
Graphics ( OpenGL ES )ExistingArunGlmark2 - Hardware Performance Suite 
GstreamerGstreamerExistingGstreamer unit tests
Gstreamer SoC SDKExistingFirebolt Native Apps Compliance Suite

DRM & Content protection

PlayReady

ExistingShibu

Media Playback And Graphics Validation Suite

rdkcentral/MVT: Media Validation Tool for verification of browser's media playback 

Widevine

Existing

Media Playback And Graphics Validation Suite

Common SVP

New

Verimatrix

New

Build & Platform

Yocto version

Existing

Kernel

ExistingAkhilKernel Test Framework

Init system

ExistingAkhilBasic sanity and Performance tests

Application Manager

ExistingAkhilRDK Shell service test coverage, RDK API And Event Certification Suite

Broadcom SDK

ExistingHAL Certification Suite

Video Player 

 IP

Existing

Media Playback And Graphics Validation Suite

rdkcentral/MVT: Media Validation Tool for verification of browser's media playback 

 QAM

ExistingNA

 DVB

ExistingDVB RDK service test coverage, RDK API And Event Certification Suite

 ATSC

ExistingNA

 TSB

NewJoseFog test coverage (Test cases/streams for Live protected contents are not available)

 DAC Apps

ExistingContainerization Test Framework 
RDK API And Event Certification Suite 

Remote Control and Voice

Voice Stack

NewArun


Manual tests for voice remote


RF4CE remote

ExistingArun

BLE voice remote

ExistingArun

External Audio support

ExistingArun

Networking

Wi-Fi

Existing

•Wi-Fi service test coverage, RDK API And Event Certification Suite

•Wi-Fi HAL test coverage, HAL Certification Suite

LAN

ExistingTest execution using ethernet connected DUT

Device Management

Telemetry


Automatics Tests

Feature Control


Automatics Tests
Crash Upload
Automatics Tests

Firmware Upgrade


Xconf firmware upgrade tests via System service RDK API And Event Certification Suite

Webpa


Automatics tests


Validation Platforms

  •  Validation support for a single build ( 32 bit ) on each platform
  •  Along with regular RDK builds for RPI HYB and RPI MC, separate Alexa enabled build for the same.
  •  UEI Tatlow, T4H Lima RCUs supported platform builds for validation.

Platform Name
Builds
Remarks
1RPI HYB
1




Complete test suites execution for each RDK6 RC builds

2RPI MC
1
3Realtek SOC Reference
1
4Amlogic SOC Reference
1
5Broadcom SOC Reference
1
6Sercomm - Realtek Video Accelerator
1
7Skyworth - Amlogic Video Accelerator
1
8Sagemcom - Broadcom Video Accelerator
1
9Amlogic TV
1Only 1 execution of complete test suites for RDK6 release
Applicable test suites execution.

Validation Process

  • Flash the devices using RDK6 RC builds provided by CMF.
  • Run the tests available in TDK, Automatics and Manual tests against each feature.
  • Attach the test reports including defect mapping in the feature ticket and also provide the tested image details in ticket.
  • Link all open RDK/SOC/OEM issues identified as part of the feature validation in the corresponding feature ticket.
  • If there are no failures then will resolve the ticket as Verified , otherwise Failed and assign back to developer.

Defect Dashboard

                            Overall defect summary                                                                                                 

Jira Charts
bordertrue
showinfortrue
serverJIRA - 2
jqllabels%20%3D%20RDK6_featurefeature%20and%20type%3Dbug
statTypestatuses
chartTypepie
width700
isAuthenticatedtrue
serverId11deff04-0380-3a3d-a916-0849d4e573f7

...

Jira
serverJIRA - 2
columnIdsissuekey,summary,issuetype,created,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,due,assignee,reporter,priority,status,resolution
maximumIssues20
jqlQuerylabels = RDK6_feature and type=bug
serverId11deff04-0380-3a3d-a916-0849d4e573f7

...