Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Children Display

...

Table of Contents

Telemetry Introduction:

Telemetry is the automatic recording and transmission of data from remote or inaccessible sources to an IT system in a different location for monitoring and analysis.

RDKB Telemetry Components:

1. Xconf Server
2. Rpi Board with RDK Broadband image
3. Tftp Server

RDKB Telemetry Architecture:

...

draw.io Diagram
bordertrue
viewerToolbartrue
fitWindowfalse
diagramNameTelemetry Architecture - RPI
simpleViewerfalse
width
diagramWidth441
revision5

Image Removed

Overview of Telemetry process:

Rpi board will connect to Xconf Server to get the device configuration information, telemetry profile information and log upload repository (ip address of tftp server). It will search for the markers (contents mentioned in the permanent profile) in the mentioned log file. If it is found in the log file, it will process those information and create a text file and upload that file in the tftp server. This way all the critical data related to device health will be available on timely basis in the tftp server for further analysis.Detail Procedure

XConf Server Configuration procedure:


1. Login to Xconf Server and go to DCM menu item and click on “Formulas” sub menu

...

Telemetry profile entries - 

First field is “Header” - What is the header of the log fileThis is the name for the particular logs collection. This is a custom name and can be decided based on the use case or error condition or any other scenario.
Second field is “Content” - Which string it should look up in the log file - This is the "log message string" that appears in the RDK logs.
Third field is “type” - Which file it should check for the provided content - This is the name of the log file where the above log message string needs to be searched.
Fourth field is “Polling “Skip frequency” - How frequently this search should happen - This is a skip frequency. It can have values like 0, 1, 2 etc.
                     0 - This particular log message is never skipped.
                     1 - Skip every alternate occurrence of this log message.
                     2 - Skip 2 consecutive log message occurrences and then collect 1 occurrence and then again skip 2 occurrences.

Image AddedImage Removed


Based on the R-Pi board supported markers available,we have selected few of them as mentioned below:


Header                    Content                                                                                      

...

Type
Firewall                  starting firewall service    FirewallDebug.txt
Firewall-1

...

Inside firewall service_init()

...

    FirewallDebug.txt
Wi-

...

Fi      Wifi Agent loaded successfully...

...

  WiFilog.txt.0

...

Armconsole   get_PartnerID - Failed Get factoryPartnerId
                                    so set it PartnerID as:

...

comcast  ArmConsolelog.txt.0
swupdate               image itself not downloaded from TFTP,
                                     pls check tftp connection!!

...

 swupdate.log

...

16. Save Permanent profile (ex. Perm_Prof_22Aug) and it will display in the Permanent profiles page

...

19. Verify the created Targeting rule displayed on the Targeting rule page

RPi device side configuration and testing process:

Below steps needed after flashing for the first time:


120. Flash the Telemetry supported RDK Broadband image into SD card and load it into R-Pi board.
21. Image will boot up successfully.
22. Login to the tftp server mentioned in “Upload repository” field of Permanent Profile in telemetry
23on RPi board
2. Configure the CLOUDURL parameter and Log Server/Http Server parameter by providing IP address of XConf server in the two mentioned files /etc/include.properties and /etc/dcm.properties respectively.

For ex. In include.properties file:

CLOUDURL=http://35.155.171.121:9092/xconf/swu/stb?eStbMac=

In dcm.properties file:

DCM_LOG_SERVER_URL=http://35.155.171.121:9092/loguploader/getSettings
DCM_HTTP_SERVER_URL=http://35.155.171.121/xconf/telemetry_upload.php
DCM_LA_SERVER_URL=http://35.155.171.121/xconf/logupload.php

3. After board boot up, disable log rotation by using the command: 

Code Block
themeEmacs
titleLog Monitor Disable
systemctl disable rdkbLogMonitor


4. Verify the image version: cat /version.txt
5. Perform reboot: reboot -f

Important Note:

Disabling log monitor is required because log rotation feature will wipe out logs when threshold reached, due to which telemetry feature can't able to identify the event count.

Telemetry functionality  requires rdk logs.

To bring both log rotation and telemetry feature at same time, user needs to increase the threshold size of max size which is used by log rotation feature  . Please follow Log Rotation Support in RPI User manual - Broadband - 2019 M8 to change threshold size of log rotation.

Below steps are to check telemetry log whenever box boots up ( after first time boot ) :

1. Verify tftp server is running and XConf DCM and Telemetry Permanent profile is configured properly (see Telemetry User manual for XConf side configuration for Telemetry)
2. After reboot, verify Telemetry log: cat /rdklogs/logs/telemetry.log
3. Verify that rtl_json.txt file contains the search results for each of the marker mentioned in the Permanent profile page of Telemetry. If the search is not found it will not show any output for that marker in the rtl_json.txt fileand zipped log files for all other logs displayed in tftp server
4. Verify that rtl_json file and zipped log files for all other logs displayed in AWS(http) server(http://35.155.171.121/xconf/upload)

Future Enhancement:

  1. We are not considering the cron job time setting for log collection and upload.
  2. We are not considering the polling frequency parameter in Telemetry profile entries section of Permanent profile page under Telemetry menu. As of now polling frequency value is considered as 0.

        These things are under future development.