Versions Compared

Old Version 74

changes.mady.by.user Vimal K S

Saved on

compared with

New Version Current

changes.mady.by.user Vimal K S

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

ShibuShibuShibuSureshArunAkhilserver

Category

Subcategory

Existing/New FeatureDev
Owner		Dev ReadinessTest Readiness

RDK Issues

Discussion Points

Streaming apps

YouTube

UpgradePremium app certification test suite

Netflix

Upgrade

Premium app certification test suite

Amazon Prime

Upgrade

Premium app certification test suite

Framework






Firebolt

UpgradeJose

•Firebolt Native Apps Compliance Suite

Firebolt Certification App ( FCA ) - Open sourcing in progress - Expected ETA - Aug EOM 

Ripple

NewJoseFirebolt Certification App ( FCA ) - Open sourcing in progress - Expected ETA - Aug EOM 

Lightning

Upgrade

Exercise different lightning apps - Refer animation test apps under TDK MVS Test Apps Media Playback And Graphics Validation Test Setup

Strike test tool - https://strike.lightningjs.io/es6/#home

QT for BLE

ExistingManual tests using BLE remote.

Core Thunder framework

Upgrade

RDK API And Event Certification Suite

Testing Areas

  • Execute rdkservices plugins test
  • Perform System testing
  • Perform Bootup testing
  • Execute Performance testing
  • Perform WebApp testing

Browser - WPEWebkit

UpgradeAkhil

Browser Performance Suite 

rdkcentral/MVT: Media Validation Tool for verification of browser's media playback capabilities 

Screen cast

DIAL

ExistingAnil/Sudhagar

Test coverage using Xcast RDK service - RDK API And Event Certification Suite 

Manual test tests for real screen validation

Jira
JIRA - 2
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyREFPLTV-1591
Jira
serverJIRA - 2
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyRTD131X-571

Security

DAC (Containerization)

NewDeepthiContainerization Test Framework - Framework 

Dobby

NewDeepthi

Containerization Test Framework 

JiraserverJIRA - 2columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolutioncolumns

key,summary,type,created,updated,due,assignee,reporter,priority,status,resolutionserverId11deff04-0380-3a3d-a916-0849d4e573f7keyRDKSEC-153

Rialto 

NewDeepthiRialto Gstreamer Test Framework  

Jira
serverJIRA - 2
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyREFPLTV-1594

Jira
serverJIRA - 2
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyREFPLTV-1612

Expand
titleRiato

Attendees – Abhishek, Sahithya, Sravanthi, Sudhagar, Anil

  • Rialto end purpose is to run in Container mode, till now feature is integrated and tested clear stream playback with Youtube (non-container). Exact containerization mode playback will be added in next releases.
  • Rialto design approach is still in discussion with Sky team on using Rialto sink elements instead of existing Westeros sink
  • TDK playback check with mediapipeline app is fine and timeout issue fix will be pushed from platform team side
    • Other operations like play/pause, seek, trickplay - not sure how well it might work in Rialto. As Rialto is not production ready , may not work similar way as westeros sink.
  • Usage of Youtube specific configuration in the steps - names can be changed, will be taken up as low priority.

    • Packager (Lisa)

    NewDeepthiRDK API And Event Certification Suite 

    AppArmor 

    NewDeepthiAppArmor Test Framework

    Jira
    serverJIRA - 2
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId11deff04-0380-3a3d-a916-0849d4e573f7
    keyAMLS905X4-683

    Jira
    serverJIRA - 2
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId11deff04-0380-3a3d-a916-0849d4e573f7
    keyRTD131X-603

    Jira
    serverJIRA - 2
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId11deff04-0380-3a3d-a916-0849d4e573f7
    keyRDKSEC-86

    JiraserverJIRA - 2serverId11deff04-0380-3a3d-a916-0849d4e573f7keySGMM393-388

    Graphics

    Rendering

    ExistingArunWesteros ESSOS test apps - Firebolt Native Apps Compliance Suite Graphics ( OpenGL ES )ExistingArunGlmark2 - Hardware Performance Suite GstreamerGstreamerExistingAkhilGstreamer unit testsGstreamer SoC SDKExistingAkhilFirebolt Native Apps Compliance Suite

    DRM & Content protection

    PlayReady

    ExistingShibu

    Media Playback And Graphics Validation Suite

    rdkcentral/MVT: Media Validation Tool for verification of browser's media playback 

    Widevine

    ExistingShibu

    Media Playback And Graphics Validation Suite

    Common SVP

    NewShibu

    Verimatrix

    New

    Build & Platform

    Yocto version

    ExistingAkhil

    Kernel

    ExistingAkhilKernel Test Framework

    Jira
    serverJIRA - 2
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId11deff04-0380-3a3d-a916-0849d4e573f7
    keyRTD131X-638

    Jira
    serverJIRA - 2
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId11deff04-0380-3a3d-a916-0849d4e573f7
    keyREFPLTV-1630

    Jira
    serverJIRA - 2
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId11deff04-0380-3a3d-a916-0849d4e573f7
    keyAMLS905X4-746

    Jira
    serverJIRA - 2
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId11deff04-0380-3a3d-a916-0849d4e573f7
    keySGMM393-384

    Jira
    serverJIRA - 2
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId11deff04-0380-3a3d-a916-0849d4e573f7
    keyBLADE-389

    Init system

    ExistingAkhilBasic sanity and Performance tests

    Application Manager

    ExistingAkhilRDK Shell service test coverage, RDK API And Event Certification Suite

    Broadcom SDK

    ExistingHAL Certification Suite

    Video Player 

     IP

    Existing

    Media Playback And Graphics Validation Suite

    rdkcentral/MVT: Media Validation Tool for verification of browser's media playback 

     QAM

    ExistingRDKV RMF components test coverage.NA

     DVB

    ExistingDVB RDK service test coverage, RDK API And Event Certification Suite

     ATSC

    ExistingNA

     TSB

    NewJoseFog test coverage

    Jira
    serverJIRA - 2
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId11deff04-0380-3a3d-a916-0849d4e573f7
    keyREFPLTV-1595

    Jira
    serverJIRA - 2
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId11deff04-0380-3a3d-a916-0849d4e573f7
    keyRTD131X-578

    Jira
    serverJIRA - 2
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId11deff04-0380-3a3d-a916-0849d4e573f7
    keySGMM393-377

    Jira
    serverJIRA - 2
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId11deff04-0380-3a3d-a916-0849d4e573f7
    keyAMLS905X4-733

    Jira
    serverJIRA - 2
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId11deff04-0380-3a3d-a916-0849d4e573f7
    keyBLADE-385

    Fog test coverage (Test cases/streams for Live protected contents are not available)

     DAC Apps

    ExistingContainerization Test Framework 
    RDK API And Event Certification Suite 

     DAC Apps

    Existing

    Remote Control and Voice

    Voice Stack

    NewArun


    Manual tests for voice remote


    RF4CE remote

    ExistingArun

    BLE voice remote

    ExistingArun

    External Audio support

    ExistingArun

    Networking

    Wi-Fi

    Existing

    •Wi-Fi service test coverage, RDK API And Event Certification Suite

    •Wi-Fi HAL test coverage, HAL Certification Suite

    LAN

    ExistingTest execution using ethernet connected DUT

    Device Management

    Telemetry


    Automatics Tests

    Feature Control


    Automatics TestsCrash Upload
    Automatics Tests

    Firmware Upgrade

    Jira
    serverJIRA - 2
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId11deff04-0380-3a3d-a916-0849d4e573f7
    keyREFPLTV-1558
    Jira
    serverJIRA - 2
    serverId11deff04-0380-3a3d-a916-0849d4e573f7
    keyRTD131X-635
    Jira
    serverJIRA - 2
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId11deff04-0380-3a3d-a916-0849d4e573f7
    keyAMLS905X4-722

    Jira
    serverJIRA - 2
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId11deff04-0380-3a3d-a916-0849d4e573f7
    keyREFPLTV-1619

    Webpa
    Xconf firmware upgrade tests via System service RDK API And Event Certification Suite

    Webpa


    Automatics tests


    Validation Platforms

    •  Validation support for a single build ( 32 bit ) on each platform
    •  Along with regular RDK builds for RPI HYB and RPI MC, separate Alexa enabled build for the same.
    •  UEI Tatlow, T4H Lima RCUs supported platform builds for validation.

    		Platform NameRemarks
    1RPI HYB




    Complete test suites execution for each RDK6 RC builds

    2RPI MC
    3Realtek SOC Reference
    4Amlogic SOC Reference
    5Broadcom SOC Reference
    6Sercomm - Realtek Video Accelerator
    7Skyworth - Amlogic Video Accelerator
    8Sagemcom - Broadcom Video Accelerator
    9Amlogic TVApplicable test suites execution.

    Validation Process

    • Flash the devices using RDK6 RC builds provided by CMF.
    • Run the tests available in TDK, Automatics and Manual tests against each feature.
    • Attach the test reports including defect mapping in the feature ticket and also provide the tested image details in ticket.
    • Link all open RDK/SOC/OEM issues identified as part of the feature validation in the corresponding feature ticket.
    • If there are no failures then will resolve the ticket as Verified , otherwise Failed and assign back to developer.

    Defect Dashboard

                                Overall defect summary                                                                                                 

    Jira Charts
    bordertrue
    showinfortrue
    serverJIRA - 2
    jqllabels%20%3D%20RDK6_featurefeature%20and%20type%3Dbug
    statTypestatuses
    chartTypepie
    width700
    isAuthenticatedtrue
    serverId11deff04-0380-3a3d-a916-0849d4e573f7

    ...

    Jira
    serverJIRA - 2
    columnIdsissuekey,summary,issuetype,created,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,due,assignee,reporter,priority,status,resolution
    maximumIssues20
    jqlQuerylabels = RDK6_feature and type=bug
    serverId11deff04-0380-3a3d-a916-0849d4e573f7

    ...