Validation / Test Coverage Status
...
Category | Subcategory | Existing/ |
...
...
Test Scope
...
Open RDK Issues
...
Readiness |
Streaming apps | YouTube | Upgrade |
...
...
certification test suite |
Netflix | Upgrade |
...
Available
Premium app certification test suite |
Amazon Prime | Upgrade |
...
Available
...
Premium app certification test suite |
Framework
| Firebolt | Upgrade |
...
Partially available
...
•Firebolt JS test suite ( Yet to open source )
Firebolt Certification App ( FCA ) - Open sourcing in progress - Expected ETA - Aug EOM |
Ripple | New | Firebolt Certification App ( FCA ) - Open sourcing in progress - Expected ETA - Aug EOM |
Lightning | Upgrade | Exercise different lightning apps - Refer animation test apps under TDK MVS Test Apps Media Playback And Graphics Validation Test Setup Strike test tool - https://strike.lightningjs.io/es6/#home |
QT for BLE | Existing | Manual tests using BLE remote. |
Core Thunder framework | Upgrade |
...
Ripple
...
Not available
...
Lightning
...
Not available
...
QT for BLE
...
Not available
...
Core Thunder framework
Available
...
...
Testing Areas- Execute rdkservices plugins test
- Perform System testing
- Perform Bootup testing
- Execute Performance testing
- Perform WebApp testing
|
Browser - WPEWebkit |
...
...
...
...
Existing | Test coverage using Xcast RDK service |
...
Jira |
---|
server | JIRA - 2 |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
---|
key | REFPLTV-1591 |
---|
|
Jira |
---|
server | JIRA - 2 |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
---|
key | RTD131X-571 |
---|
|
...
Not available
...
...
In Progress
...
•Dobby test tool enhancement and integration
...
Jira |
---|
server | JIRA - 2 |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
---|
key | RDKSEC-153 |
---|
|
...
Rialto
...
In Progress
...
•Playback tests using Rialto sink
...
Jira |
---|
server | JIRA - 2 |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
---|
key | REFPLTV-1594 |
---|
|
...
Expand |
---|
|
Attendees – Abhishek, Sahithya, Sravanthi, Sudhagar, Anil - Rialto end purpose is to run in Container mode, till now feature is integrated and tested clear stream playback with Youtube (non-container). Exact containerization mode playback will be added in next releases.
- Rialto design approach is still in discussion with Sky team on using Rialto sink elements instead of existing Westeros sink
- TDK playback check with mediapipeline app is fine and timeout issue fix will be pushed from platform team side
- Other operations like play/pause, seek, trickplay - not sure how well it might work in Rialto. As Rialto is not production ready , may not work similar way as westeros sink.
- Usage of Youtube specific configuration in the steps - names can be changed, will be taken up as low priority.
|
...
Not available
...
TBD
...
...
Not available
...
TBD
...
Q1
...
Existing | Westeros ESSOS test apps |
...
•
...
...
...
Gstreamer unit tests |
Gstreamer SoC SDK |
...
...
|
DRM & Content protection | PlayReady |
...
Partially available
...
Widevine
...
Browser Playback tests using DASHIF test streams
...
...
Not available
...
...
Not available
New |
|
Build & Platform | Yocto version |
...
...
...
...
Existing | Basic sanity and Performance tests |
...
...
...
Available
RDK Shell service test coverage |
...
...
Improve the application management test coverage
...
Q1
...
...
Available
...
...
•
...
Existing | DVB RDK service test coverage |
...
...
•DVB component and HAL test coverage
...
ATSC
...
...
...
•
...
Jira |
---|
server | JIRA - 2 |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
---|
key | REFPLTV-1595 |
---|
|
Jira |
---|
server | JIRA - 2 |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
---|
key | RTD131X-578 |
---|
|
...
DAC Apps
...
Not available
Remote Control and Voice | Voice Stack |
...
Not available
...
•RDK Service test coverage
•Voice HAL test coverage
New |
Manual tests for voice remote
|
RF4CE remote | Existing |
BLE voice remote | Existing |
External Audio support | Existing |
Networking | Wi-Fi |
...
...
•Wi-Fi service test coverage |
...
...
...
RDK API And Event Certification Suite
...
Existing | Test execution using ethernet connected DUT |
Device Management | Telemetry |
...
Not available
Automatics Tests |
Feature Control |
...
Not available
...
| Automatics Tests |
Crash Upload |
...
...
TBD
...
Firmware Upgrade
...
Not available
Validation Platforms
- Validation support for a single build ( 32 bit ) on each platform
- Along with regular RDK builds for RPI HYB and RPI MC, separate Alexa enabled build for the same.
- UEI Tatlow, T4H Lima RCUs supported platform builds for validation.
| Platform Name | Remarks |
---|
1 | RPI HYB |
Complete test suites execution for each RDK6 RC builds |
2 | RPI MC |
3 | Realtek SOC Reference |
4 | Amlogic SOC Reference |
5 | Broadcom SOC Reference |
6 | Sercomm - Realtek Video Accelerator |
7 | Skyworth - Amlogic Video Accelerator |
8 | Sagemcom - Broadcom Video Accelerator |
9 | Amlogic TV | Applicable test suites execution. |
Validation Process
- Flash the devices using RDK6 RC builds provided by CMF.
- Run the tests available in TDK, Automatics and Manual tests against each feature.
- Attach the test reports including defect mapping in the feature ticket and also provide the tested image details in ticket.
- Link all open RDK/SOC/OEM issues identified as part of the feature validation in the corresponding feature ticket.
- If there are no failures then will resolve the ticket as Verified , otherwise Failed and assign back to developer.
...
Defect Dashboard
Overall defect summary
Jira Charts |
---|
border | true |
---|
showinfor | true |
---|
server | JIRA - 2 |
---|
jql | labels%20%3D%20RDK6_featurefeature%20and%20type%3Dbug |
---|
statType | statuses |
---|
chartType | pie |
---|
width | 700 |
---|
isAuthenticated | true |
---|
serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
---|
|
Open Open Issues
Jira |
---|
server | JIRA - 2 |
---|
columnIds | issuekey,summary,issuetype,created,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,due,assignee,reporter,priority,status,resolution |
---|
maximumIssues | 20 |
---|
jqlQuery | labels = RDK6_feature and type=bug |
---|
serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
---|
|
...