Validation / Test Coverage Status
...
Category
...
Subcategory
...
Test Status
...
Test Scope
...
Open RDK Issues
...
Category | Subcategory | Existing/New Feature | Test Readiness |
Streaming apps | YouTube | Upgrade |
...
Not available
...
| certification test suite |
Netflix | Upgrade |
...
Available
Premium app certification test suite |
Amazon Prime | Upgrade |
...
Available
...
Premium app certification test suite |
Framework
| Firebolt | Upgrade |
...
Partially available
...
•Firebolt JS test suite ( Yet to open source )
Firebolt Certification App ( FCA ) - Open sourcing in progress - Expected ETA - Aug EOM |
Ripple | New | Firebolt Certification App ( FCA ) - Open sourcing in progress - Expected ETA - Aug EOM |
Lightning | Upgrade | Exercise different lightning apps - Refer animation test apps under TDK MVS Test Apps Media Playback And Graphics Validation Test Setup Strike test tool - https://strike.lightningjs.io/es6/#home |
QT for BLE | Existing | Manual tests using BLE remote. |
Core Thunder framework | Upgrade |
...
Ripple
...
Not available
...
Lightning
...
Not available
...
QT for BLE
...
Not available
...
Core Thunder framework
Available
...
...
Testing Areas- Execute rdkservices plugins test
- Perform System testing
- Perform Bootup testing
- Execute Performance testing
- Perform WebApp testing
|
Browser - WPEWebkit |
...
...
...
...
| Existing | Test coverage using Xcast RDK service |
...
| Jira |
|---|
| server | JIRA - 2 |
|---|
| columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
|---|
| columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
|---|
| serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
|---|
| key | REFPLTV-1591 |
|---|
|
| Jira |
|---|
| server | JIRA - 2 |
|---|
| columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
|---|
| columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
|---|
| serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
|---|
| key | RTD131X-571 |
|---|
|
...
Not available
...
...
In Progress
...
•Dobby test tool enhancement and integration
...
| Jira |
|---|
| server | JIRA - 2 |
|---|
| columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
|---|
| columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
|---|
| serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
|---|
| key | RDKSEC-153 |
|---|
|
...
Rialto
...
In Progress
...
•Playback tests using Rialto sink
...
| Jira |
|---|
| server | JIRA - 2 |
|---|
| columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
|---|
| columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
|---|
| serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
|---|
| key | REFPLTV-1594 |
|---|
|
...
| Expand |
|---|
|
Attendees – Abhishek, Sahithya, Sravanthi, Sudhagar, Anil - Rialto end purpose is to run in Container mode, till now feature is integrated and tested clear stream playback with Youtube (non-container). Exact containerization mode playback will be added in next releases.
- Rialto design approach is still in discussion with Sky team on using Rialto sink elements instead of existing Westeros sink
- TDK playback check with mediapipeline app is fine and timeout issue fix will be pushed from platform team side
- Other operations like play/pause, seek, trickplay - not sure how well it might work in Rialto. As Rialto is not production ready , may not work similar way as westeros sink.
- Usage of Youtube specific configuration in the steps - names can be changed, will be taken up as low priority.
|
...
Not available
...
TBD
...
...
Not available
...
TBD
...
Q1
...
| Existing | Westeros ESSOS test apps |
...
•
...
...
...
| Gstreamer unit tests |
| Gstreamer SoC SDK |
...
...
|
DRM & Content protection | PlayReady |
...
Partially available
...
Widevine
...
Browser Playback tests using DASHIF test streams
...
...
Not available
...
...
Not available
| New |
|
Build & Platform | Yocto version |
...
...
...
...
| Existing | Basic sanity and Performance tests |
...
...
...
Available
| RDK Shell service test coverage |
...
...
Improve the application management test coverage
...
Q1
...
...
Available
...
...
•
...
| Existing | DVB RDK service test coverage |
...
...
•DVB component and HAL test coverage
...
ATSC
...
...
...
•
...
| Jira |
|---|
| server | JIRA - 2 |
|---|
| columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
|---|
| columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
|---|
| serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
|---|
| key | REFPLTV-1595 |
|---|
|
| Jira |
|---|
| server | JIRA - 2 |
|---|
| columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
|---|
| columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
|---|
| serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
|---|
| key | RTD131X-578 |
|---|
|
...
DAC Apps
...
Not available
Remote Control and Voice | Voice Stack |
...
Not available
...
•RDK Service test coverage
•Voice HAL test coverage
| New |
Manual tests for voice remote
|
RF4CE remote | Existing |
BLE voice remote | Existing |
External Audio support | Existing |
Networking | Wi-Fi |
...
...
•Wi-Fi service test coverage |
...
...
...
RDK API And Event Certification Suite
...
| Existing | Test execution using ethernet connected DUT |
Device Management | Telemetry |
...
Not available
| Automatics Tests |
Feature Control |
...
Not available
...
| Automatics Tests |
| Crash Upload |
...
...
TBD
...
Firmware Upgrade
...
Not available
Validation Platforms
- Validation support for a single build ( 32 bit ) on each platform
- Along with regular RDK builds for RPI HYB and RPI MC, separate Alexa enabled build for the same.
- UEI Tatlow, T4H Lima RCUs supported platform builds for validation.
| Platform Name | Remarks |
|---|
| 1 | RPI HYB |
Complete test suites execution for each RDK6 RC builds |
| 2 | RPI MC |
| 3 | Realtek SOC Reference |
| 4 | Amlogic SOC Reference |
| 5 | Broadcom SOC Reference |
| 6 | Sercomm - Realtek Video Accelerator |
| 7 | Skyworth - Amlogic Video Accelerator |
| 8 | Sagemcom - Broadcom Video Accelerator |
| 9 | Amlogic TV | Applicable test suites execution. |
Validation Process
- Flash the devices using RDK6 RC builds provided by CMF.
- Run the tests available in TDK, Automatics and Manual tests against each feature.
- Attach the test reports including defect mapping in the feature ticket and also provide the tested image details in ticket.
- Link all open RDK/SOC/OEM issues identified as part of the feature validation in the corresponding feature ticket.
- If there are no failures then will resolve the ticket as Verified , otherwise Failed and assign back to developer.
...
Defect Dashboard
Overall defect summary
| Jira Charts |
|---|
| border | true |
|---|
| showinfor | true |
|---|
| server | JIRA - 2 |
|---|
| jql | labels%20%3D%20RDK6_featurefeature%20and%20type%3Dbug |
|---|
| statType | statuses |
|---|
| chartType | pie |
|---|
| width | 700 |
|---|
| isAuthenticated | true |
|---|
| serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
|---|
|
Open Open Issues
| Jira |
|---|
| server | JIRA - 2 |
|---|
| columnIds | issuekey,summary,issuetype,created,duedate,assignee,reporter,priority,status,resolution |
|---|
| columns | key,summary,type,created,due,assignee,reporter,priority,status,resolution |
|---|
| maximumIssues | 20 |
|---|
| jqlQuery | labels = RDK6_feature and type=bug |
|---|
| serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
|---|
|
...
