Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Image RemovedImage Added

Release Notes
RDKM  Coverage Test cases (RDK-B)
Version: 4.0
16 February 2022



Image Added




Revision History

Release No.

Date

Revision Description

1.0

02 Nov 2021

Initial Release

2.008 Dec 20212nd Release
3.012 Jan 20223rd Release
4.016 Feb 20224th Release



Table of Contents

Introduction

...

  1. WIFI
  2. WEBPA
  3. SNMP
  4. NETWORK CONNECTIVITY
  5. CDL
  6. PARODUS
  7. SYSTEM
  8. SECURITY
  9. XCONF
  10. BRIDGE-MODE
  11. FIREWALL
  12. TELEMETRY

Release Information

Following are the Test cases  delivered in this release:

NoTest case IDCadence/Test TypeStepsDescription 
1TC-RDKB-WH-SNMP-10014HOUR8Verify SNMP get operation for warehouse DOCSIS OIDs and cross-verify the same with its corresponding TR-181 param using WebPA
2TC-RDKB-WEBPA-1020NEW_FEATURE11Verify firmware download event notifications for invalid build with Manageable notification feature enabled
3TC-RDKB-XCONF-10032DAYS2Trigger XCONF/DIFD HTTP CDL with same image version
4TC-RDKB-XCONF-10042DAYS2Trigger XCONF/DIFD TFTP CDL with different image version
5TC-RDKB-XCONF-DELAY-1001NEW_FEATURE12Verify the Xconf flag support the delay download at installation with invalid images
6TC-RDKB-CPU_AND_MEMORY-10014HOUR1Capture CPU and Memory usage individually per process based on request
7TC-RDKB-SYSTEM-70202DAYS4Verify disk usage, up-time, top, date and disk space response from Arm Console
8TC-RDKB-LIGHTTPD-10024HOUR2Verify lighttpd version
9TC-RDKB-WH-SNMP-10024HOUR9verify snmp set for warehouse OID
10TC-RDKB-WIFI-2050SUPPLEMENTARY6Verify that Wi-Fi connectivity of 5 GHz frequency SSID is not affected when 2.4 GHz frequency SSID is disabled
11TC-RDKB-SECURITY-11062DAYS1To verify whether PHP version is upgraded to 7.2.13 or above
12TC-RDKB-SECURITY-11052DAYS2To Verify lighttpd and php fingerprinting
13TC-RDKB-SNMP-10242DAYS3Validate that the static IPv4 address can be retrieved using  rdkbRgDeviceConfigStaticIp (.1.3.6.1.4.1.17270.50.2.1.4.6.0)
14TC-RDKB-WEBPA-10072DAYS5Verify XDNS Ccspxdns not crashing on overriding default values
15TC-RDKB-SECURITY-22014HOUR9Enable 3rd party tracker blocking on a gateway
16TC-RDKB-SECURITY-22024HOUR9Verify third party tracker is not blocked
17TC-RDKB-WH-SNMP-10034HOUR4Verify snmp set for warehouse  DOCSIS OID
18
TC-RDKB-PARODUS-RECON-1001
4HOUR3Verify parodus restarted by self heal when killed
19TC-RDKB-SYSTEM-10014HOUR5dnsmasq version check in RDKB devices
20TC-RDKB-WH-SNMP-10071HOUR27Warehouse test coverage for Wireless OIDs - Sequence strict
21

TC-RDKB-SYSTEM-5001

2DAYS2Verify stanTC-RDKB-PARODUS-ENBL-1003dard timestamp format is used in RDKB logging
22TC-RDKB-SECURITY-10022DAYS8Testcase for securing syscfg.db parameters via encryption.
23TC-RDKB-PARODUS-1010NEW_FEATURE6Verify parodus reconnect with jitter algorithm
24TC-RDKB-PARODUS-1011NEW_FEATURE23Drop process privileges (RDK-B Platforms)
25TC-RDKB-WIFI-10011HOUR18verify the status of wifi mesh service on enabling and disabling it
26TC-RDKB-PARODUS-ENBL-10032DAYS17Verify Enable Parodus in log messages
27TC-RDKB-FIREWALL-10002DAYS9Verify WAN - LAN traffic is blocked when Firewall is configured to Custom Security
28TC-RDKB-WIFI-5051
2DAYS24Verify Management Frame Power Controls for 2.4 GHz and 5 GHz Radios using WebPA
29TC-RDKB-SELF-HEAL-PING-SERVER-30012DAYS7List of servers (URIs) and minimum set of servers to ping MUST be configurable via bootfile or Comcast SNMP OIDs
30TC-RDKB-SYSTEM-55151HOUR8Verify the logging of WebPA telemetry data in the Parodus Logs
31TC-RDKB-SYSTEM-30432DAYS4Verify the stress testing for Encrypted  file copying from /nvram/ to /opt/secure/
32TC-RDKB-
SYSTEM-10003Test to Verify verify configparamgen utility test
WIFI-ATM-10012DAYS3Validate AirTimeManagement by Assigning Values at APGroup Level
33TC-RDKB-SNMP-10144HOUR6Verify  resetting  the device  through SNMP v3 is successful
34TC-RDKB-WIFI-TX-RATE-CONFIG-50642DAYS17To verfiy high power support in 5GHZ band channel
35TC-RDKB-SELF-HEAL-40004HOUR22Test to verify Self healing feature must be enabled by default using snmp mibs
36TC-RDKB-SYSTEM-3048SUPPLEMENTARY12Test case to verify whether DNS queries follow strict ordering or not
37TC-RDKB-AGGRESSIVE_SELF_HEAL-1001NEW_FEATURE13Verify Aggressive selfheal
38TC-RDKB-ETHWAN-1001SUPPLEMENTARY8Verify CM shutting down in ETHWAN Mode
39TC-RDKB-NW-CHECK-1001SUPPLEMENTARY3Ping to IPV6 from Client connected device
40TC-RDKB-WEBPA-10122DAYS18Verify reboot reason notifications sent for different types of reboot
41TC-RDKB-REBOOT-10152DAYS6Test to verify abort reboot after reboot initiates
42TC-RDKB-SELF-HEAL-4011NEW_FEATURE12Verify wan link heal check after firmware upgrade
43TC-RDKB-TELEMETRY-VER2-10032DAYS15Verify telemetry 2 configurations persist over a device upgrade
44TC-RDKB-SYSCFG-10002DAYS12 Read syscfg parameters encrypted DB
45TC-RDKB-PRO-INFO-50012DAYS17Verify the sensitive keywords are removed from iptables
46TC-RDKB-XCONF-PERIFWUP-10054HOUR10Schedule Periodic Firmware Upgrade Check
47TC-RDKB-BRIDGE-MODE-10034HOUR10Test case to verify router functionalities persistency on mode transisitions
48TC-RDKB-FACTORYRBT-10024HOUR25Factory reboot scenario using WebPA
49TC-RDKB-FACTORYRBT-10034HOUR25Factory reboot scenario using SNMP
50TC-RDKB-SYSTEM-10262DAYS12Verifiy the minidump generated during process crash is uploaded to S3/crash portal
51TC-RDKB-REBOOT-10114HOUR7Perform reboot with device component, delay and reboot reason
52TC-RDKB-SYSTEM-50501HOUR3Verify whether multiple udhcpc.script error messages getting printed in Consolelog.txt
53TC-RDKB-WAREHOUSE-1001NEW_FEATURE10Verify warehouse staging using xconf method
54TC-RDKB-WAREHOUSE-1002NEW_FEATURE10Verify warehouse staging using webpa method
55TC-RDKB-DOWNUPSTREAM-1001SUPPLEMENTARY3Validate the timestamp for upstream/downstream ranging
56TC-RDKB-SELF-HEAL-ACW-30012DAYS5Average usage must be computed over 15 minute time window
57TC-RDKB-REBOOT-10142DAYS8Verify Abort Reboot after successful CDL
58TC-RDKB-PRO-INFO-50022DAYS17Verify the sensitive keywords are removed from ip6tables
59TC-RDKB-SELF-HEAL-40034HOUR
8
6Test to validate if the cron scheduling on ATOM side whether it is having LogUploadFrequency value _TR181
60TC-RDKB-TR69-10004HOUR1Verification of Device Serial Number using TR69 parameter -Device.DeviceInfo.SerialNumber
61TC-RDKB-TR69-10014HOUR1Verification of Device Model Name using TR69 parameter -Device.DeviceInfo.ModelName
62TC-RDKB-TR69-10024HOUR1Verification of Device Software Version using TR69 parameter -Device.DeviceInfo.SoftwareVersion
63TC-RDKB-WIFI-RESTORE-10024HOUR19Verify WiFi settings like SSID ,Network Security mode,Channel Selection Mode,Channel bandwidth,Network name enabled status,Guard interval ,Network active status,Supported Protocols,Radio Status and Radio Channel can be restored to default settings using SNMP command for doing WIFI settings reset
64TC-RDKB-SYSTEM-PING-IPRUT-50012DAYS4Verify Add IP from ATOM side private network using Ping and ip route
65TC-RDKB-XCONF-UP-DWN-50012DAYS10Validate firmware Upgrade Time Check via xconf
66TC-RDKB-WEBPA-1019NEW_FEATURE15Verify firmware download event notifications with Manageable notification feature disabled
67TC-RDKB-CPUPROC-1000NEW_FEATURE14Test to verify CPU Performance Analysis - Process Analyzer
68TC-RDKB-REBOOT-50031HOUR8Verify interface reboot due to brlan0 and verify logs in SelfHeal.txt.0 file
69TC-RDKB-FACTORYRESET_REBOOT-10012DAYS49Test to verify default values after factory reset and value persistance after reboot
70TC-RDKB-CCSP-10004HOUR6Verify service configuration feature is disabled
71TC-RDKB-AGGRESSIVE_SELF_HEAL-1002NEW_FEATURE24Verify critical & non-critical processes are handling independently in SelfHealAggressive log file and SelfHeal file
72TC-RDKB-REBOOT-10134HOUR24Verify device gives response as invalid request when there is no reboot is pending and abort reboot command is sent
73TC-RDKB-WIFI-TX-RATE-CONFIG-50612DAYS48Verify the configuration of Transmission Control Rate for 2.4 GHz and 5GHz Radio using WebPA
74TC-RDKB-BRIDGE-MODE-10014HOUR10Verification of enabling and disabling Bridge mode via SNMP
75TC-RDKB-WIFI-CON-PERF-1002PERFORMANCE2Find out the average mean time for Wi-Fi connection establishment of 2.4GHz radio band with 20 times
76TC-RDKB-WIFI-CON-PERF-1003PERFORMANCE2Find out the average mean time for Wi-Fi connection establishment of 5GHz radio band with 20 times
77TC-RDKB-WIFI-4001SUPPLEMENTARY10Ping via IPV4 and IPV6 on 2.4GHz when 5GHz is disabled.
78TC-RDKB-WIFI-4002SUPPLEMENTARY10Ping via IPV4 and IPV6 on 5GHz when 2.4GHz is disabled.
79TC-RDKB-WIFI-4003SUPPLEMENTARY12
Client connectivity test on 2.4GHz and 5GHz
Test to verify that LAN side wireless CPE gets an IP address when dual radio bands(2.4GHZ and 5 GHZ) are enabled in CM
80TC-RDKB-ENCRYPT-10012DAYS10Test to verify  Encrypt WiFi passwords stored in NVRAM
81TC-RDKB-WIFI-SEC-MODE-1001SUPPLEMENTARY7Verification of 2.4 GHz Private SSID connectivity using valid and invalid WPA2-PSK-AES key
82TC-RDKB-WIFI-SEC-MODE-1002SUPPLEMENTARY7Verification of 5 GHz Private SSID connectivity using valid and invalid WPA2-PSK-AES key
83TC-RDKB-SYSTEM-9010
15
2DAYS17Verify ccsp-webpa-adapter
84TC-RDKB-WIFI-4004SUPPLEMENTARY20Enable/Disable both 2.4GHz, and 5Ghz and confirm Client connects/disconnects successfully
85TC-RDKB-SYSTEM-30422DAYS21Verify that /opt/secure folder is encrypted
86
TC-RDKB-NetCat-1003
2DAYS6This test is to verify that secure "nc" utility is implemented on Atom based devices, to run only in client mode
87TC-RDKB-CDL-EXCLUDE-1004NEW_FEATURE3To verify firmware update with AutoExcluded.Enable is false, AutoExcluded.XconfUrl is MOCK XCONF URL
88TC-RDKB-WIFI-50012DAYS15Verify 2.4 GHz WiFi beacon rate changing behavior
89TC-RDKB-CPU_AND_MEMORY-10022DAYS6Capture CPU and Memory usage individually per process based on request
90TC-RDKB-WIFI-2001SUPPLEMENTARY6Enable/Disable Broadcast SSID for 2.4 Ghz WiFi network and verify disabled status
91TC-RDKB-WIFI-2002SUPPLEMENTARY6Enable/Disable Broadcast SSID for 5 Ghz WiFi network and verify disabled status
92TC-RDKB-SYSTEM-10284HOUR5Test to verify CPU usage
93TC-RDKB-WIFI-BAND-STEERING-10052DAYS3Verify Set or Get PhyRate threshold for 2.4GHz band to initiate Steering using TR69 data objects
94TC-RDKB-WIFI-BAND-STEERING-10042DAYS3Verify Set or Get PhyRate threshold for 5GHz band to initiate Steering using TR69 data objects
95

TC-RDKB-WEBPA-1018

2DAYS11Verify Implementation of new WifiClient data model for harvester under Device.WiFi.
96

TC-RDKB-WIFI-BAND-STEERING-1011

2DAYS15Set IdleInactiveTime  and OverlaodInactiveTimne to values and  verify cfg -s and lbd.conf is updated
97TC-RDKB-SELF-HEAL-40024HOUR6Test to Validate if corrective action is taken (eRouter reboot only) when DNS resolve test failure case
98TC-RDKB-SELF-HEAL-40094HOUR8Verify that the MSO is able to configure the resource usage time window via SNMP
99

TC-RDKB-WIFI-BAND-STEERING-1003

2DAYS7verify  the factory default value of  Band steering paarmeters using webpa and dmcli
100TC-RDKB-SELF-HEAL-40104HOUR5Verification of setting invalid values to avgCPUThreshold and avgMemoryThreshold using SNMP MIB


Release Identification

GIT URL:

...

Developer instructions : https://wiki.rdkcentral.com/display/ASP/Automatics+Developer+GuideGuide to Automatics REST API Implementation

Test Case Configurations: https://wiki.rdkcentral.com/display/ASP/Automatics+RDK-B+Test+Property+configuration

...