Versions Compared

Old Version 13

changes.mady.by.user James Cooley

Saved on

compared with

New Version 14

changes.mady.by.user James Cooley

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Each CMF Sanity Test Flow logs all the stages from image deployment, flashing, testing. This along with the DUT logs and video test reports are stored in Jenkins and in S3 buckets.

The video logs contain serial output from the device, logging from the test framework and screen grabs so you can actually see what was happening on the device during the test.

For example:


fullLog.txt:


Code Block
Flash BCMREF
Flash BCM Reference r05s12 Sequence Start
  get BOLT> prompt [SUCCESS]
  boot initrd image [SUCCESS]
  flash bcm rootfs [SUCCESS]
  get BOLT> prompt [SUCCESS]
  boot bcm reference image [SUCCESS]
  Check Service rmfstreamer [SUCCESS]
  Check Service wpeframework [SUCCESS]
  Check Ip Addr 10.5.25.72 [SUCCESS]
Flash BCM Reference r05s12 Sequence [SUCCESS]
Play BCMREF
"Testing Sequence Started" 
  HLS Video Streaming using aamp-cli [SUCCESS]
  DASH Video Streaming using aamp-cli [SUCCESS]
  PLAYREADY_DRM Video Streaming using aamp-cli [SUCCESS]
  Video Accelerator Home Screen Test [SUCCESS]
  Video Accelerator CNN App Video Detection Test [SUCCESS]
  Video Accelerator VOD Video Detection Test [SUCCESS]
  AAMP CI Tests [SUCCESS]
	AAMP CI: WebApp launch passed
	AAMP CI: 1 tests passed
	AAMP CI: 0 tests failed
		AAMP CI: HTML Web App Tests Passed
Testing Sequence [SUCCESS]


gerrit/github message:


snippet from the StormTest video log for the CNN APP Video Detection Test:

Image AddedImage Added