Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Template Tickets (these are cloned for each task)

TaskTemplate Ticket
TDK Intake

Jira
serverRDK
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyCMFLAB-1125

RDK-B Iteration/Release

Jira
serverRDK
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyCMFLAB-552

RDK-V Iteration/Release

Jira
serverRDK
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyCMFLAB-365

RDK-B CODEMGMT Iteration

Jira
serverRDK
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyCODEMGMT-238

RDK-B CODEMGMT Quarterly Release

Jira
serverRDK
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyCODEMGMT-425

RDK-V CODEMGMT Iteration

Jira
serverRDK
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyCODEMGMT-180

RDK-V CODEMGMT Quarterly Release

Jira
serverRDK
serverId11deff04-0380-3a3d-a916-0849d4e573f7
keyCODEMGMT-554


Sanity Test Frameworks

Sanity Test Descriptions

...

draw.io Diagram
bordertrue
viewerToolbartrue
fitWindowfalse
diagramNameSanity Test Framework
simpleViewerfalse
width
diagramWidth1055
revision1


Sanity Test Flows

DUTJenkins Sanity Test Flow JobComments
EMU-Bhttps://jenkins.cmf.code.rdkcentral.com/view/TEST/job/test-rdkb-emulator-wifi-flow/
  • there are 3 Sanity EMU-B setups on 
    • Raven
    • R02Server
    • Wind
RPI-Bhttps://jenkins.cmf.code.rdkcentral.com/view/TEST/job/test-rdkb-raspberrypi-wifi-flow/
EMU-Vhttps://jenkins.cmf.code.rdkcentral.com/view/TEST/job/test-hv04-emulators/
  • EMU's are setup on laptop connected to StormTest HV04
RPI-Vhttps://jenkins.cmf.code.rdkcentral.com/view/TEST/job/test-rdkv-raspberrypi-flow/
  • RPI-V RPI's are setup on R04 which is StormTest enabled rack
RPI RefApphttps://jenkins.cmf.code.rdkcentral.com/view/TEST/job/test-raspberrypi-refapp-flow/
  • RPI-V Refapp RPI's are setup on R04 which is StormTest enabled rack
  • Uses StormTest OCR to check subtitles
RPI Thunderhttps://jenkins.cmf.code.rdkcentral.com/view/TEST/job/test-raspberrypi-thunder-flow/
  • RPI Thunder are setup on R04 stormtest rack
RPI Westeroshttps://jenkins.cmf.code.rdkcentral.com/view/TEST/job/test-oss-raspberrypi-flow/
  • Deprecated ?

xg1v3

xi3v2

https://jenkins.cmf.code.rdkcentral.com/view/TEST/job/test-hv04-platforms/
  • Deprecated
  • StormTest HV04


TDK Test Frameworks

TDK Documentation and Releases

...

  • EACH PHASE OF THE FRAMEWORK CAN BE RUN INDEPENDENTLY


All of which are kicked off with a set of input parameters to their various Jenkins jobs. Currently supporting 4 'RUNTYPE' options – 'release', 'nightly', 'nightly-full', and 'master' (no longer used).

...

  • This produces a comparison report per platform on a configurable number of TDK Reference Releases
  • Useful on TDK Intake to see any change in test status or tests removed/added etc

TDK Test Metrics


CMFLAB

CMFLAB Confluence

Test and Git

CMF Gerrit

Comcast Gerrit

...

Code Block
# clone the test repo
git clone "https://code.rdkcentral.com/r/cmf/test"

# browse code in browser via gitiles (must be logged into gerrit)
https://code.rdkcentral.com/r/plugins/gitiles/cmf/test

# TDK test results repo (soon to be deprecated, used to store TDK reference results)
git clone "https://code.rdkcentral.com/r/tata/test-results"

# clone the jenkins dsl test repo where all our test jenkins jobs are maintained
git clone "https://code.rdkcentral.com/r/cmf/jenkins-dsl/jobs/test"

# setup the commit hook if you want push changes for review in CMF Gerrit
cd <repo>
gitdir=$(git rev-parse --git-dir); curl -o ${gitdir}/hooks/commit-msg https://code.rdkcentral.com/r/tools/hooks/commit-msg ; chmod +x ${gitdir}/hooks/commit-msg

# useful git commands/workflow sequence if/when working on branches rather than pushing changes directly on master
git checkout master
git pull —rebase
git checkout -b <branch name>

… make changes
git add <files>
git commit -m "CMFLAB-XXX <commit msg>"
git push origin <branch name>
  if single commit:
    git checkout master
    git cherry-pick <commit ID>
    git push origin HEAD:refs/for/master
  if multiple commits:
    git rebase -i HEAD~<# of commits from HEAD>
    … pick top commit; squash all others
    git log (**check to see that squashed commit has Change-ID)
    if no Change-ID in commit: git commit —amend; exit editor (Change-ID should now be there)
    git push origin HEAD:refs/for/master

Test AWS S3 Buckets


S3 BucketPurpose
s3://rdkcmf-test-results/
  • stores nightly and release sanity and TDK test results
  • store TDK reference results
s3://rdkcmf-test-logs/
  • stores nightly and release logs from TDK test runs
  • may be used in future for sanity testing
s3://rdkcmf-artifacts/jobs/
  • where all builds from internal jenkins are stored
  • we mainly use this to retrieve images from tdk and community build jobs
s3://rdkcmf-artifacts/jobs/test-manual-artifacts/
  • where we store our development builds, refer to next section below
s3://rdkcmf-community-artifacts/jobs/
  • where all builds are stored from contribution builds, useful if you want to run some testing on a contribution

Test Development Builds

The test team maintain their own build scripts which we use to build and test debug images for defect investigations. These scripts are run on personal build slaves and can be used to build on any branch we support in CMF.

...