Overview

Data Collection and Analysis (DCA) is responsible for collecting the data from various log files and send to server. The script dca_utility.sh is in place on the set-top box. Based on the DCM response it will create a cron job in the settop box.

...

• First Level
  
  • Frequency - start with 5 minutes and then expand.
  • If log upload frequency is 5 minutes, that is separate from the log collection frequency, which will be based on various parameters. 
    
    • Parameters could be counters. 
    • Parameters may not be available in logs but may need real-time probing using snmp/tr-69 or other methods.
    • We will need collect records based on frequency at which collection needs to occur.
  • Log some events back to the cloud. Could be to S3 or another destination.
  • Records that we it upload should be records that could be fed into Splunk without having to do much processing, for example, a name/value pair or another that is easy to expose on Splunk.
  • There could be multiple records since logging period. 
  • Data collection frequency and upload frequency can be configured differently.
  • The level will be enabled for every device.
• Second Level
  
  • Medium number of logs. Full logs will need to be pushed. 
  • Second and Third level are similar. 
• Third Level
  
  • Similar to current method of full log uploads.

...