Validation / Test Coverage Status
Category | Subcategory | Feature/Component Owner | Test Status | Existing Test Coverage | Test Steps | Test Plan | Test Scope | Open RDK Issues | Discussion Points | Applicable platforms |
Category | Subcategory | Existing/New Feature | Test Readiness |
Not available | | Netflix | AvailableUpgrade | Premium app certification test suite |
Netflix | Upgrade | Premium app |
published certification test suite |
Amazon Prime |
Available published test suitePremium app published certification test suite |
Framework
| Firebolt |
Partially available•Firebolt Test •Firebolt JS test suite ( Yet to open source )
• | • | Ripple | Not available | TBD | TBD | Lightning | Not available | QT for BLE | Not available | TBD | Q1 | Core Thunder framework | Available
RDK Service API and Event Test Suite | •Improve the test coverage | Browser - WPEWebkit | Available | Browser performance test suite | •Track the browser performance test scoresNot available | •Xcast RDK service validation | Q1 | Not available | TBDIn Progress | •Dobby test tool enhancement and integration | Q1In Progress•Playback tests using Rialto sink | Q1 | Not available | TBD | TBDNot available | TBD | Q1 | Partially availableExisting | Westeros ESSOS test apps |
integration• | •AvailableExisting | Gstreamer unit tests |
Gstreamer SoC SDK |
Not availablePartially availableBrowser Playback tests using DASHIF test streams | • | Widevine | Partially available | Browser Playback tests using DASHIF test streamsNot availableTBD | TBDNot available | New |
|
Build & Platform | Yocto version |
NAIn Progress test - LTP | Existing | Basic sanity and Performance tests |
Not availableAvailableExisting | RDK Shell service test coverage |
Improve the application management test coverage | Q1NAAvailable validation test suite•RDKV RMF components | • | Partially availableExisting | DVB RDK service test coverage |
•DVB component and HAL test coverage | ATSC | Not availablePartially available• (Test cases/streams for Live protected contents are not available) |
DAC Apps |
Not available |
Remote Control and Voice | Voice Stack |
Not available | New |
Manual tests for voice remote |
•RDK Service test coverage
•Voice HAL test coverage
|
RF4CE remote | Existing |
BLE voice remote | Existing |
External Audio support | Existing |
Networking | Wi-Fi |
Available•Wifi •Wi-Fi service test coverage |
•Wifi AvailableTBDExisting | Test execution using ethernet connected DUT |
Device Management | Telemetry |
Not available | Automatics Tests |
Feature Control |
Not available | TBDTBD
| Automatics Tests |
Crash Upload |
Not available | Automatics Tests |
Firmware Upgrade |
Not available | TBD
Validation Platforms
- Validation support for a single build ( 32 bit ) on each platform
- Along with regular RDK builds for RPI HYB and RPI MC, separate Alexa enabled build for the same.
- UEI Tatlow, T4H Lima RCUs supported platform builds for validation.
| Platform Name | Remarks |
---|
1 | RPI HYB |
Complete test suites execution for each RDK6 RC builds |
2 | RPI MC |
3 | Realtek SOC Reference |
4 | Amlogic SOC Reference |
5 | Broadcom SOC Reference |
6 | Sercomm - Realtek Video Accelerator |
7 | Skyworth - Amlogic Video Accelerator |
8 | Sagemcom - Broadcom Video Accelerator |
9 | Amlogic TV | Applicable test suites execution. |
Validation Process
- Flash the devices using RDK6 RC builds provided by CMF.
- Run the tests available in TDK, Automatics and Manual tests against each feature.
- Attach the test reports including defect mapping in the feature ticket and also provide the tested image details in ticket.
- Link all open RDK/SOC/OEM issues identified as part of the feature validation in the corresponding feature ticket.
- If there are no failures then will resolve the ticket as Verified , otherwise Failed and assign back to developer.
Defect Dashboard
Overall defect summary
Jira Charts |
---|
border | true |
---|
showinfor | true |
---|
server | JIRA - 2 |
---|
jql | labels%20%3D%20RDK6_featurefeature%20and%20type%3Dbug |
---|
statType | statuses |
---|
chartType | pie |
---|
width | 700 |
---|
isAuthenticated | true |
---|
serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
---|
|
Open Open Issues
Jira |
---|
server | JIRA - 2 |
---|
columnIds | issuekey,summary,issuetype,created,duedate,assignee,reporter,priority,status,resolution |
---|
columns | key,summary,type,created,due,assignee,reporter,priority,status,resolution |
---|
maximumIssues | 20 |
---|
jqlQuery | labels = RDK6_feature and type=bug |
---|
serverId | 11deff04-0380-3a3d-a916-0849d4e573f7 |
---|
|
...