Self Heal Support in RPI - User manual - Broadband

Introduction

Self Heal is a monitoring and recovery module.

It continuously monitors the system resources like CPU and Memory and monitors the critical Processes running.

Self heal also performs Connectivity tests.

In case of any problems encountered, Self Heal takes corrective actions like: Rebooting the device, Restarting required process based on predefined conditions.

Self-heal stores Reset Count and Reboot Count.

Environment Setup

Self Heal functionality is handled by a set of scripts. These scripts are available in the RDK build by default.

Please ensure that below Self heal scripts are present on the device at the path "/usr/ccsp/tad".

• resource_monitor.sh

• task_health_monitor.sh

• corrective_action.sh

• self_heal_connectivity.sh

Please refer the below screenshot to verify self heal module was enabled or not,

Executing System

Self Heal is enabled by default and is active at the time of boot up.

It periodically performs below actions.

• Resource monitoring: Monitors memory / cpu usage and if it goes beyond threshold, it reboots the device.
• Process monitoring: It will periodically monitors status of the critical processes.
  • Ccsp processes: If any of these processes crashed, it will be restarted via Self Heal.
  • "CcspCrSsp": If this process is crashed, device will be rebooted.
  • "syseventd": If syseventd is crashed, device will be rebooted.
• Connectivity test: If DNS or WAN_IP is down, device will stop the LAN functionality.

Resource Monitor :    It monitors CPU and MEMORY.

                1.  By default, AVG CPU threshold value will be set as 100. This value will be stored in syscfg database. If we want the change the default AVG CPU threshold value, Please refer the attached screenshot and do the following steps,

                 2. By default, AVG Memory threshold value will be set as 100. This value will be stored in syscfg database. If we want the change the default AVG Memory threshold value, Please refer the attached screenshot and do the following steps,

                  3. Once it's reaches the threshold value, device will be rebooted automatically.                 

Troubleshooting

Support