Validation / Test Coverage Status
...
...
...
Category | Subcategory | Existing/New Feature |
...
Test Scope
...
Open RDK Issues
...
Test Readiness |
Streaming apps | YouTube |
...
...
certification test suite |
Netflix |
...
Upgrade | Premium app certification test suite |
Amazon Prime |
...
Upgrade | Premium app certification test suite |
Framework
| Firebolt |
...
...
...
•Firebolt JS test suite ( Yet to open source )
...
Ripple
...
Lightning
...
Exercise different lightning apps
...
|
QT for BLE | Existing | Manual tests using BLE remote. |
Core Thunder framework |
...
...
Testing Areas- Execute rdkservices plugins test
- Perform System testing
- Perform Bootup testing
- Execute Performance testing
- Perform WebApp testing
|
Browser - WPEWebkit |
...
...
...
Existing | Test coverage using Xcast RDK service |
...
Jira |
---|
server | JIRA - 2 |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
---|
key | REFPLTV-1591 |
---|
|
Jira |
---|
server | JIRA - 2 |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
---|
key | RTD131X-571 |
---|
|
...
...
...
•Dobby test tool enhancement and integration
...
Jira |
---|
server | JIRA - 2 |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
---|
key | RDKSEC-153 |
---|
|
...
Rialto
...
•Playback tests using Rialto sink
...
Jira |
---|
server | JIRA - 2 |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
---|
key | REFPLTV-1594 |
---|
|
...
Expand |
---|
|
Attendees – Abhishek, Sahithya, Sravanthi, Sudhagar, Anil - Rialto end purpose is to run in Container mode, till now feature is integrated and tested clear stream playback with Youtube (non-container). Exact containerization mode playback will be added in next releases.
- Rialto design approach is still in discussion with Sky team on using Rialto sink elements instead of existing Westeros sink
- TDK playback check with mediapipeline app is fine and timeout issue fix will be pushed from platform team side
- Other operations like play/pause, seek, trickplay - not sure how well it might work in Rialto. As Rialto is not production ready , may not work similar way as westeros sink.
- Usage of Youtube specific configuration in the steps - names can be changed, will be taken up as low priority.
|
...
...
...
...
...
...
...
...
...
TBD
|
Build & Platform | Yocto version | Existing |
|
Kernel | Existing | Kernel |
...
Test Framework |
Init system | Existing | Basic sanity and Performance tests |
Application Manager | Existing | RDK Shell service test coverage |
...
...
...
...
NA |
DVB | Existing | DVB RDK service test coverage |
...
...
...
Jira |
---|
server | JIRA - 2 |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
---|
key | REFPLTV-1595 |
---|
|
Jira |
---|
server | JIRA - 2 |
---|
columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
---|
key | RTD131X-578 |
---|
|
...
DAC Apps
...
|
Remote Control and Voice | Voice Stack | New |
•Voice RDK Service test coverage
Manual tests for voice remote
|
RF4CE remote |
...
...
Existing |
External Audio support |
...
Existing |
Networking | Wi-Fi | Existing |
...
•Wi-Fi service test coverage |
...
...
...
HAL Certification Suite
...
...
| Automatics Tests |
Feature Control |
...
| Automatics Tests |
Crash Upload |
...
| Automatics Tests |
Firmware Upgrade |
...
TBD
...
Validation Platforms
- Validation support for a single build ( 32 bit ) on each platform
- Along with regular RDK builds for RPI HYB and RPI MC, separate Alexa enabled build for the same.
- UEI Tatlow, T4H Lima RCUs supported platform builds for validation.
| Platform Name | Remarks |
---|
1 | RPI HYB |
Complete test suites execution for each RDK6 RC builds |
2 | RPI MC |
3 | Realtek SOC Reference |
4 | Amlogic SOC Reference |
5 | Broadcom SOC Reference |
6 | Sercomm - Realtek Video Accelerator |
7 | Skyworth - Amlogic Video Accelerator |
8 | Sagemcom - Broadcom Video Accelerator |
9 | Amlogic TV | Applicable test suites execution. |
Validation Process
- Flash the devices using RDK6 RC builds provided by CMF.
- Run the tests available in TDK, Automatics and Manual tests against each feature.
- Attach the test reports including defect mapping in the feature ticket and also provide the tested image details in ticket.
- Link all open RDK/SOC/OEM issues identified as part of the feature validation in the corresponding feature ticket.
- If there are no failures then will resolve the ticket as Verified , otherwise Failed and assign back to developer.
Defect Dashboard
Overall defect summary
Jira Charts |
---|
border | true |
---|
showinfor | true |
---|
server | JIRA - 2 |
---|
jql | labels%20%3D%20RDK6_featurefeature%20and%20type%3Dbug |
---|
statType | statuses |
---|
chartType | pie |
---|
width | 700 |
---|
isAuthenticated | true |
---|
serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
---|
|
...
Jira |
---|
server | JIRA - 2 |
---|
columnIds | issuekey,summary,issuetype,created,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,due,assignee,reporter,priority,status,resolution |
---|
maximumIssues | 20 |
---|
jqlQuery | labels = RDK6_feature and type=bug |
---|
serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
---|
|
...