...

Architecture and a brief overview of the work flow

Advantages of the reference telemetry setup

1.Real-Time Monitoring: Telemetry dashboards provide real-time monitoring of systems and processes. This allows for immediate detection and response to any issues or anomalies, enhancing operational efficiency and reducing downtime.

2.Data Visualization: They convert complex data sets into easy-to-understand visual formats like graphs, charts, and maps. This aids in quicker comprehension and better decision-making by presenting data in a user-friendly manner.

3.Performance Analysis: By tracking various metrics and KPIs, telemetry dashboards enable detailed performance analysis. This can lead to insights into trends, patterns, and potential areas for improvement.

How to setup the telemetry upload system

Elastic Search -  Kibana Setup

Server Prerequisites

VM :  Ubuntu 20.04 +

• Telemetry is configured in the RDKB /RDKV devices with on xconf(Single profile telemetry) based telemetry or telemetry2 multiprofile based telemetry.
• The upload URL will be configured as the Telemetry-collector microservice URL , So data will be uploaded to the microservice from the boxes.
• Telemetry microservice is a springboot based microservice that will receive the telemetry data, parses it and sends the processed data to Elastic Search
• Elastic search DB is  where the data is stored, It  is deployed along with Kibana.
• Kibana is a data visualization tool and  user can analyze and filter out the data stored in Elasticsearch DB , with Kibana
• Kibana Admin user will create dashboards based on the requirements from the end user.

Advantages of the reference telemetry setup

1.Real-Time Monitoring: Telemetry dashboards provide real-time monitoring of systems and processes. This allows for immediate detection and response to any issues or anomalies, enhancing operational efficiency and reducing downtime.

2.Data Visualization: They convert complex data sets into easy-to-understand visual formats like graphs, charts, and maps. This aids in quicker comprehension and better decision-making by presenting data in a user-friendly manner.

3.Performance Analysis: By tracking various metrics and KPIs, telemetry dashboards enable detailed performance analysis. This can lead to insights into trends, patterns, and potential areas for improvement.

How to setup the telemetry upload system

Elastic Search -  Kibana Setup

Server Prerequisites

VM :  Ubuntu 20.04 +

You can either deploy the EK setup You can either deploy the EK setup in the same VM or use another VM. For reference setup, we have used two separate  ubuntu server instances

...

sudo tar -xvf apache-tomcat-9.0.85.tar.gz -C /opt/automatics/

 Deployment of the war  

1. Copy the telemetry-collector.war file to the apache-tomcat/webapps folder.
2. Navigate to apache-tomcat/bin directory and start the server by executing command.

./startup.sh

     3. Sample output is given below

Image Removed

     4. Logs can be found in the file -  apache-tomcat<>/logs/catalina.out

.85.tar.gz -C /opt/automatics/

 Deployment of the war  

1. Copy the telemetry-collector.war file to the apache-tomcat/webapps folder.
2. Navigate to apache-tomcat/bin directory and start the server by executing command.

./startup.sh

     3. Sample output is given below

Image Added

     4. Logs can be found in the file -  apache-tomcat<>/logs/catalina.out

Telemetry upload APIS

The APis support upload of both telemetry (Single profile) and telemetry(Multi Profile) which are in different JSON schema/format

RDKB telemetry upload API : 

http://<Server IP/FQDN>:8080/telemetry-collector/rdkb-collector

RDKV telemetry upload API

http://<Server IP/FQDN>:8080/telemetry-collector/rdkv-collector

Reference setup details

Server details

We have two servers which are used for microservice deployment and Elasticsearch-Kibana setup

Telemetry collector VM - 

IP - 52.0.158.162

FQDN :  telemetrycollector.rdkcentral.com

RAM : 16GB

Disk space :  128 GB

Ubuntu : 20.04.6 LTS

Telemetry Dashboard VM - 

IP- 52.71.72.93

FQDN :  telemetrydashboard.rdkcentral.com

RAM : 16GB

Disk space : 300 GB +

Ubuntu : 20.04.6 LTS

Telemetry collector

These are the telemetry upload URLs configured for RDKB and RDKV

RDKB : https://telemetrycollector.rdkcentral.com/telemetry-collector/rdkb-collector

RDKV: https://telemetrycollector.rdkcentral.com/telemetry-collector/rdkv-collector

Telemetry dashboard

We have currently setup RDKB and RDKV dashboards in the Kibana instance. Given below are the details

RDKB dashboards

Device Info   - https://telemetrydashboard.rdkcentral.com:5601/app/dashboards#/view/d7462060-ab98-11ee-9d36-e37c9e3d744b?_g=(filters:!(),refreshInterval:(pause:!t,value:0),time:(from:now-2w,to:now))

Device Performance - https://telemetrydashboard.rdkcentral.com:5601/app/dashboards#/view/714270f0-a933-11ee-9d36-e37c9e3d744b?_g=(filters:!(),refreshInterval:(pause:!t,value:0),time:(from:now-2w,to:now))

Error Markers - https://telemetrydashboard.rdkcentral.com:5601/app/dashboards#/view/8953c6a0-a954-11ee-9d36-e37c9e3d744b?_g=(filters:!(),refreshInterval:(pause:!t,value:0),time:(from:now-2w,to:now))

RDKV dashboards

https://telemetrydashboard.rdkcentral.com:5601/app/dashboards#/view/30d28b50-95c3-11ee-818a-3bf22ddefffd?_g=(filters:!(),refreshInterval:(pause:!t,value:0),time:(from:now-2w,to:now))

Reference

• https://www.elastic.co/guide/en/kibana/7.17/index.html
• https://phoenixnap.com/kb/how-to-install-elk-stack-on-ubuntu

...