Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Release Notes
RDKM  Coverage Test cases (RDK-B)
Version: 5.0
16 March 2022



Image RemovedImage Added




Revision History

Release No.

Date

Revision Description

1.0

02 Nov 2021

Initial Release

2.008 Dec 20212nd Release
3.012 Jan 20223rd Release
4.016 Feb 20224th Release
5.016 Mar 20225th Release


Table of Contents

Introduction

...

NoTest case IDCadence/Test TypeStepsDescription 
1TC-RDKB-WIFI-NWCON-CONNECTIVITYPERF-100210002DAYSPERFORMANCE125Verify the ping related default values in the device after factory resetting by SNMPFind out the successful Wi-Fi connectivity rate of 2.4GHz radio band with 10 times in Wireless Gateway
2TC-RDKB-WIFI-WHCON-SNMPPERF-100010014HOURPERFORMANCE125Find out the successful Wi-Fi connectivity rate of 5GHz radio band with 10 times in Wireless GatewayVerify get SNMP for warehouse OIDs
3TC-RDKB-SNMPNTP-100700034HOUR68Synchronize System Time with NTP ServerVerification of DOCSIS Mib functionality
4TC-RDKB-SNMPSYSTEM-505050032DAYS327Verify Access Points security mode via SNMP parameterWebpa Notifications on Firmware Upgrade
5TC-RDKB-CDLSYSTEM-EXCLUDEDIBBLER-10061001NEW_FEATURE2DAYS32To check the dibbler versionTo verify firmware update with AutoExcluded. Enable is true, AutoExcluded.XconfUrl is empty
6
TC-RDKB-
NW
FS-
CONNECTIVITY
LAYOUT-
1005
1010
2DAYSSUPPLEMENTARY153Test to verify resolv.conf file system layout validation and DNS valueVerify whether valid IP address are set for the ping servers by SNMP and the ping success logs are captured in selfHeallog.txt.0
7TC-RDKB-NWDROPBEAR-CONNECTIVITY-100611022DAYS4HOUR2014Test class to Verify whether the Invalid IP address of the ping server is set by SNMP and failure messages are logged when the ping fails in selfHeal log and Ping failures are captured in telemetry dashboardsecurity keys related to SCP present in the device or not
8TC-RDKB-SNMPWIFI-101250202DAYS4HOUR64Test to verify the default number of allowed clients for PublicWiFi Secure and open SSID using WebPA.Verify enabling/disabling bridge mode through SNMP v3 is successful
9TC-RDKB-CDLSNMP-EXCLUDE-1001NEW_FEATURE410232DAYS9Test to verify that the SNMP set/get can be performed successfully using valid MTA community stringTo verify firmware update with AutoExclude.Enable is false, XconfUrl is empty
10TC-RDKB-CDLMTA-EXCLUDE-1003NEW_FEATURE310012DAYS3Test to reset MTA of the deviceTo verify firmware update with AutoExcluded.Enable is false, AutoExcluded.XconfUrl is CI XCONF URL
11TC-RDKB-NWWH-CONNECTIVITYSNMP-101010052DAYS4HOUR17Verify whether the invalid  ping servers and valid ping servers are set by SNMP and  failure messages are logged when the ping fails in selfHeal logECM Firmware Upgrade and Factory Reset OIDs - Sequence strict warehouse OIDs
12TC-RDKB-PARODUSFACTORYRBT-10062DAYS1HOUR199Verify themis curl to acquire JWT for parodusTest to verify Default SSID and Password after Factory Resetting Router through WebPA
13TC-RDKB-PARODUSFACTORYRBT-100810072DAYS1HOUR126Verify Integrate parodus2ccsp with YoctoDefault SSID and Password after Factory Resetting WiFi through WebPA object
14TC-RDKB-PARODUSREBOOT-100710122DAYS1812Verify device provides notification via WebPA to indicate that reboot is about to occur after firmware upgrade and adds delay to the rebootVerify Integrate parodus2ccsp with Yocto
15TC-RDKB-SELF-PARODUSHEAL-100940054HOUR108Test to verify configurable parodus reboot reasonself heal diagnostic mode test scenarios using WebPA parameter
16TC-RDKB-PARODUSSYSTEM-ENBLIPSET-100410082DAYSSUPPLEMENTARY817Verify Webpa commands when Parodus is Enabledupgrade ipset to v.6.34
17TC-RDKB-WIFI-PARODUSCC-NOPOLLNEG-10014HOURSUPPLEMENTARY822Validate that SSH, telnet to LAN geteway IP from connected clients is not successfulTest to verify parodus nopoll
18TC-RDKB-SNMPDROPBEAR-102711034HOUR1214Test class to Verify the cable modem SNMPv3 parameters from RDK using RFC/XConf (Broadcom RDKB platforms)whether security keys related to SCP present in the device or not in ATOM side
19TC-RDKB-EXEC-FILE-WEBPACHK-101310012DAYS10Verify Webpa requests (GET/SET/PUT/POST/DELETE) are working fine and Webpa notifications should be sent successfully to serverwhether user is able to run user or manual script even after giving 777 permission
20TC-RDKB-SYSTEMWIFI-102150534HOURSUPPLEMENTARY510Verify the reduction in power level of 2.4GHz WiFi Access Point does not impact the non-management frames.Test to verify removal of  telnet daemon
21TC-RDKB-SYSTEMWIFI-500250542DAYSSUPPLEMENTARY710Verify the reduction in power level of 5GHz WiFi Access Point does not impact the non-management frames.Verify logging for Harvester and LMLite reports
22TC-RDKB-TRACE-ROUTESNMPV3-10012DAYS4HOUR419Test to verify trace route of the device using ipv4 addresssnmpv3 migration
23TC-RDKB-WH-SNMP-102110062DAYS4HOUR216Test to Verify that the device does not respond to invalid community stringVerify ECM Docs DevSw Admin Status OIDs - Sequence strict warehouse OIDs
24TC-RDKB-SNMPAUTOREBOOT-102210002DAYS4HOUR212Test to verify the default parameter values of Auto rebootValidate that the device does not give valid SNMP response  for invalid MTA community String
25TC-RDKB-SNMPWIFI-101050142DAYSSUPPLEMENTARY815This test case is to Verify Configuring the AAA server Primary/Secondary IP address for 2.4 and 5GHzthe controlled user access (Allow) for 5GHZ against different MAC addresses by way of MAC ACLs
26

TC-RDKB-

SYSTEM

WIFI_RADIO-

5007

1002

2DAYS37Ability to disable WiFi Radio through WEBPAVerify Xconf default value,Hardware version,Linux kernel upgrade version  from logs
27TC-RDKB-REBOOTWIFI-500150114HOURSUPPLEMENTARY614Test This test case is to verify the docsdevresetnow mib functionalitycontrolled user access (Allow All) to the Specific Device for 2.4 and 5 GHZ against different MAC addresses by way of MAC ACLs
28TC-RDKB-FSREBOOT-LAYOUT-10015005SUPPLEMENTARY2DAYS28Test to Verify RDKB devices patches kernel - after rebootnvram file system layout validation
29TC-RDKB-FS-LAYOUT-1002SUPPLEMENTARY2THERMAL_FAN-1000NEW_FEATURE11Device shall have the ability to retrieve the fan diagnostics via WebPAnvram2 file system layout validation
30TC-RDKB-FSWIFI-LAYOUT-10035021SUPPLEMENTARY4HOUR38Test to verify number of allowed clients for Public Secure and open SSID can be writable using WebPA/TR69 and changes are logged in WebPA/TR69 log filetmp file system layout validation
31TC-RDKB-FSWIFI-LAYOUTWEBPA-10043003SUPPLEMENTARY312Verify the ability to change mode from a/n/ac to ac only, a/n/ac to n only, a-n-ac to n-ac only radio on the 5 GHz radiominidumps file system layout validation
32TC-RDKB-FSFIREWALL-LAYOUT-10051001SUPPLEMENTARY211Verify LAN - WAN traffic is successful when Firewall is configured to 'Custom Security'rdklogs file system layout validation
33

TC-RDKB-

FS

WIFI-

LAYOUT-1006

5012

SUPPLEMENTARY315Verify the controlled user access (Allow) to the specific Devices for 2.4 GHZ against different MAC addresses by way of MACc ACLscron and etc file system layout validation
34

TC-RDKB-

FS-LAYOUT

TR69-1007

SUPPLEMENTARY4HOUR224This method verifies whether WiFi objects can be enabled disabled via TR69dhcp_static_hosts file system layout validation
35TC-RDKB-FSSELF-LAYOUTHEAL-10084004SUPPLEMENTARY215Test to verify diagnostic mode test scenariosxupnp file system layout validation
36TC-RDKB-FSTR69-LAYOUT-10091010SUPPLEMENTARY4HOUR25This method verifies Advanced Management server parametersDibbler file system layout validation
37TC-RDKB-PARODUSTR69-100120012DAYS4HOUR35Verify ACS related TR-69 functionalityRemoval of parodus start shell script changes from yocto
38TC-RDKB-WEBPAWIFI-PARALLELCLIENT-100610014HOURSUPPLEMENTARY113Test to verify WiFi client connect disconnect eventsVerify multiple WEBPA requests in parallel
39TC-RDKB-DHCP-SECURITYSWITCH-10012DAYSSUPPLEMENTARY512Verify common DHCPv4 code functionalityTest to verify the latest OpenSSL version in RDKB devices
40TC-RDKB-SECURITY-22034HOUR16-WIFI-2GHZ-DHCP-IPV4-DSBLE-5001SUPPLEMENTARY5Verify the IP range in 2.4GHZ WiFi connected client when DHCP Server disabled.Verify third party tracker is blocked after firewall restart
41TC-RDKB-WIFINEGATIVE-RESTORECDL-100110004HOUR2DAYS2110Verify CDL fails for corrupt build generated from same device classVerify WiFi settings like SSID ,Network Security mode,Channel Selection Mode,Channel bandwidth,Network name enabled status,Guard interval ,Network active status,Supported Protocols,Radio Status and Radio Channel can be restored to default settings using webpa command for doing WIFI settings reset
42TC-RDKB-TELEMETRYNEGATIVE-VER2CDL-10012DAYS4HOUR610Verify default values for T2 component  TR-181 parametersCDL fails for corrupt build generated from different device class
43TC-RDKB-TELEMETRYNEGATIVE-VER2CDL-10022DAYS4HOUR1510Verify CDL fails for corrupt build which is partially downloaded or having CRC errorVerify T2 component log files, process and other basic checks
44TC-RDKB-IPV4-WEBPACHECK-100850012DAYSSUPPLEMENTARY177Verify DNS Address persist to the Wi-Fi & Ethernet client after reboot and ethernet client gets IP within acceptable time of 5 minsVerify all reports for Harvester and LMLite are enabled and Verify CcspWebpaadapter responds to WEBPA GET, SET requests.
45TC-RDKB-XCONFBRIDGE-CDLMODE-100210042DAYSSUPPLEMENTARY1025Verify the functionality of LAN client after CM reboot in bridge modeAccess SSR and Xconf CDL Via Direct Communication
46TC-RDKB-CDL-50032DAYS9WIFI-5GHZ-DHCP-IPV4-DSBLE-5001SUPPLEMENTARY5Verify the IP range in 5GHZ WiFi connected client when DHCP Server disabled.Enhance TC-RDKB-CDL-502 to include code download using HTTPS
47TC-RDKB-SYSTEMTR69-103110094HOUR10Verify no zombie dnsmasq process detected by self healVerifies whether WiFi objects can be enabled disabled via TR69
48TC-RDKB-WIFI-MESHKEY-WIFIPHARSE-100450014HOURSUPPLEMENTARY214Verify enabling MESH when the Bridge Mode 2.4 GHz SSID is enabled.
49TC-RDKB-2GHZ-TRACEDNS-ROUTENSLOOKUP-10025001SUPPLEMENTARY45Verifying the alternate DNS nslookup functionality for 2.4GHzTest to verify trace route of the device using ipv6 address
50TC-RDKB-5GHZ-CDLDNS-EXCLUDENSLOOKUP-10085001NEW_FEATURESUPPLEMENTARY45Verifying the alternate DNS nslookup functionality for 5 GHzTo verify firmware update with AutoExcluded.Enable is true, AutoExcluded.XconfUrl is MOCK XCONF URL
51TC-RDKB-CDLWIFI-EXCLUDEWEBPA-10073002NEW_FEATURESUPPLEMENTARY36Test case is created to check the ability to change mode from g-n to n-only mode on the 2.4 GHz radioTo verify firmware update with AutoExcluded.Enable is true, AutoExcluded.XconfUrl is CI XCONF URL
52

TC-RDKB-

CDL

WEBPA-

EXCLUDE-1005
NEW_FEATURE4

1011

2DAYS20Verify firmware download event notifications  with Manageable notification feature enabledTo verify firmware update with AutoExcluded.Enable is true, AutoExcluded.XconfUrl is empty
53TC-RDKB-WIFI-CDLKEY-EXCLUDEPHARSE-100250022DAYSSUPPLEMENTARY314Verify that the passphrase key of WIFI access point can be updated for 5 GhzTo verify firmware update with AutoExcluded.Enable is false, AutoExcluded.XconfUrl is empty
54TC-RDKB-BUSYBOX-SYSTEMUTILITY-550210014HOUR27Validate Busybox utility tarVerify the data only partition /nvram is mounted as non-executable
55TC-RDKB-SYSTEMWIFI-550340054HOURSUPPLEMENTARY216Verify Security Mode for WiFi access bands (2.4 and 5 GHz)Verify the data only partition /nvram2 is mounted as non-executable
56TC-RDKB-WIFI-WEBPAPOSSIBLE-PERFCHANNELS-100610012DAYS4HOUR64Verify that WIFI radio does not support channel number other than the possible channels definedCalculate the Average Response Time for two, three and four Get parameter Requests in WEBPA
57

TC-RDKB-

TELEMETRY

ALTN-

VER2

DNS-

1004

1001

4HOURSUPPLEMENTARY416Verify  Alternate DNS in WiFi and Lan Connected clientsVerify negative scenarios for Telemetry version 2
58TC-RDKB-TELEMETRY-VER2-10054HOUR14NMI_REBOOT-1001NEW_FEATURE16Verify NMI mtdoops& SRAM support for BCM ARM processors to capture system state during watchdog resetVerify negative scenarios for Telemetry version 2
59TC-RDKB-WIFI-RESERVED-SECURITYIP-200110032DAYSSUPPLEMENTARY28Verify the Reserved IP for clients for Ethernet clientUpgrade Dropbear to latest version
60TC-RDKB-SYSTEMBUSYBOX_UTILITY-110110034HOUR16Verify DBus - Overly permissive system settingthe installed busy box utilities on CM side


Release Identification

GIT URL:

...

Branchrdk-next

Reference RTAUTO : https://jira.rdkcentral.com/jira/browse/AUTOMATICS-2357

Reference Documentation : https://wiki.rdkcentral.com/display/ASP/Automatics+Orchestration+User+Manual

Developer instructions : https://wiki.rdkcentral.com/display/ASP/Automatics+Developer+GuideAutomatics Providers List

Test Case Configurations:  Automatics RDK-B Test Property configuration

...