Page History

This document is intended to support QA & Field triage triage teams to do initial analysis for the failures.

...

View file

name	AAMP-Overview.pptx
height	250

Topics

Reference & log pointers to indicate the failure in Broadcom.

Useful Links

AAMP Playback Flow : AAMP Playback Code Flow
Crash Portal : https://crashportal.stb.r53.xcal.tv/login/index
Producing stack traces from google breakpad minidump manually : Producing stack traces from google breakpad minidump Google Breakpad
DRM Error Code : DRM Error Runbook

...

XRE-03092XRE-03092XRE-03090Subscription/Upsell OverlayXRE-03092XRE-03090XRE-03092XRE-03092XRE-06014XRE-03092XRE-03092XRE-06014

S.No

AAMP Error Map Code

Media Error Code

Error Description

Failure on Tune Start

Failure on Mid Tune

Reason for failures

HLS

DASH

IP-Linear

cDVR

VOD

1

AAMP_TUNE_INIT_FAILED

10

AAMP: init failed

X

1. Manifest request failure.
2. Invalid or insufficient data in manifest playlist (content length if "0").
3. If av track duration is "0".
4. If seek target is out of range.

X

XRE-03090

XRE-06014

2

AAMP_TUNE_INIT_FRAGMENT_DOWNLOAD_FAILURE

10

AAMP: init fragment download failed

String that will be logged
(*) AAMP: init fragment download failed : Http Error Code
(*) AAMP: init fragment download failed : Curl Error Code

X

Failed to download the initialization fragment, results in tune failure.

(*) Failure with VOD/cDVR playback, the HTTP error code reflects actual CDN response interms of Curl or HTTP error values.

(*) Failure with Linear playback via FOG, the HTTP error code reflects FOG reported failure, which does not necessarily imply a CDN download failure.

X

XRE-03090

XRE-06014

3

AAMP_TUNE_INVALID_MANIFEST_FAILURE

10

AAMP: Invalid Manifest, parse failed

X

If the format of Manifest is invalid, then it will result in tune falure.

X

XRE-06014

XRE-03092

4

AAMP_TUNE_AUTHORISATION_FAILURE

40

AAMP: Authorization failure
(or)
AAMP: Authorization failure majorError

X

User is not entitled for the requested stream/content.
In HLS : majorError = 3329 and minorError in (12012, 12013)
In DASH : Depends on sec-client error codes

X

5

AAMP_TUNE_UNTRACKED_DRM_ERROR

50

If 3321: AAMP: Individualization server down majorerror
(or)
AAMP: DRM Failure majorError
(or)
If AES(HLS): AAMP: DRM Failure

X

This can come in the case of unknown DRM errors, we can check the logs for understanding the DRM major and minor errorcodes to map the failure.
This can be seen with AVE and AES DRMs.

X

XRE-03090

XRE-06014

6

AAMP_TUNE_DRM_INIT_FAILED

50

AAMP: DRM Initialization Failed

X

Widevine/PlayReady DRM session initialization failed.
A platform or implementation issue can cause this error.

X

XRE-06014

XRE-03092

7

AAMP_TUNE_DRM_DATA_BIND_FAILED

50

AAMP: InitData-DRM Binding Failed

X

Failed to bind init data with DRM, could be due to invalid or incomplete initdata

X

XRE-03090

XRE-06014

XRE-03092

8

AAMP_TUNE_DRM_CHALLENGE_FAILED

50

AAMP: DRM License Challenge Generation Failed

X

Failed to generate DRM license request. Might be due to outdated data in /opt/drm

X

XRE-03090

XRE-06014

XRE-03092

9

AAMP_TUNE_INVALID_DRM_KEY

50

AAMP: Invalid Key Error, from DRM

X

Failed to extact license key from license response. It could be because of wrong response data or invalid key.
HLS with AES DRM.
DASH with WV and PR.

X

XRE-03090

XRE-06014

XRE-03092

10

AAMP

10

AAMP_TUNE_DRM_KEY_UPDATE_FAILED

50

AAMP: Failed to process DRM key

X

Failed to process DRM key. Error code returned from the update API provides more details.

X

XRE-03090

XRE-06014

11

AAMP_TUNE_UNSUPPORTED_STREAM_TYPE

50

AAMP: Unsupported Stream Type

X

DRM sessions can be created for audio or video only. Unsupported media type received for session creation.

X

XRE-03090

XRE-06014

12

AAMP_TUNE_UNSUPPORTED_AUDIO_TYPE

50

AAMP: No supported Audio Types in Manifest

X

If the audio type in manifest is unknown by the player, then the playback will be failed.

X

XRE-03090

XRE-03092

13

AAMP_TUNE_DEVICE_NOT_PROVISIONED

52

AAMP: Device not provisioned

X

Device is not provisioned, see se-client error
SEC_CLIENT_RESULT_MAC_AUTH_NOT_PROVISIONED

X

XRE-03090

XRE-06014

14

AAMP_TUNE_FAILED_PTS_ERROR

80

AAMP: Playback failed due to PTS error

X

If the injected fragment is discarded by the decoder due to PTS and other errors, then the playback will be failed with this error.

X

XRE-03090

XRE-06014

15

AAMP_TUNE_FAILURE_UNKNOWN

100

AAMP: Unknown Failure

X

Otherthan the above described faiures will be logged with unknown failures.

X

XRE-03090

XRE-03092

Recoverable - ( on retry handling these case can be recoverable and the playback can play )

XRE-06014XRE-03090XRE-03092XRE-06014XRE-03092XRE-03092XRE-06014XRE-03090XRE-06014XRE-03092XRE-06014

S.No	AAMP Error Map Code	Media Error Code	Error Description	Failure on Tune Start	Failure on Mid Tune	Reason for failures	HLS	DASH	IP-Linear	cDVR	VOD
1	AAMP_TUNE_MANIFEST_REQ_FAILED	10	AAMP: Manifest Download failed String that will be logged () AAMP: Manifest Download failed : Http Error Code () AAMP: Manifest Download failed : Curl Error Code	X	X	If manifest download failed and retry count exceedes MAX_MANIFEST_DOWNLOAD_RETRY(3)	X	X	XRE-03090		XRE-03092
2	AAMP_TUNE_FRAGMENT_DOWNLOAD_FAILURE	10	AAMP: fragment download failures String that will be logged () AAMP: fragment download failures : Http Error Code () AAMP: fragment download failures : Curl Error Code	X	X	If fragment download failed and retry count exceedes MAX_SEG_DOWNLOAD_FAIL_COUNT(10) () Failure with VOD/cDVR playback, the HTTP error code reflects actual CDN response interms of Curl or HTTP error values. () Failure with Linear playback via FOG, the HTTP error code reflects FOG reported failure, which does not necessarily imply a CDN download failure.	X	X		XRE-06014	XRE-03092
3	AAMP_TUNE_CONTENT_NOT_FOUND	20	AAMP: Resource was not found at the URL(HTTP 404)	X	X	If the manifest / fragment download failed with HTTP 404 error, then this error will be logged. May be the requested manifest / fragment might not be availble in the server.	X	X	XRE-03090	XRE-06014
4	AAMP_TUNE_LICENCE_TIMEOUT	50	AAMP: DRM License Request Timed out	X	X	License requset to server got timed out.		X	XRE-03090		XRE-03092
5	AAMP_TUNE_LICENCE_REQUEST_FAILED	50	AAMP: DRM License Request Failed	X	X	License request failed with server returned error code. HLS with AES DRM. DASH with WV and PR.	X	X	XRE-03090	XRE-06014
6	AAMP_TUNE_FAILED_TO_GET_KEYID	50	AAMP: Failed to parse key id from PSSH	X	X	Failed to parse key id from init data.		X	XRE-03090	XRE-06014
7	AAMP_TUNE_FAILED_TO_GET_ACCESS_TOKEN	50	AAMP: Failed to get access token from Auth Service	X		Failed to get access token from Auth Service; Access token is required to get license for Comcast streams from MDS servers.		X	XRE-03090	XRE-06014	XRE-03092
8	AAMP_TUNE_CORRUPT_DRM_METADATA	50	AAMP: DRM Metadata error majorError	X		Multiple times same Metadata is set to AVE-DRM session or a bad Metadata for a stream set. DRM Major errorcode : 3314	X	XRE-03090		XRE-03092
9	AAMP_TUNE_DRM_DECRYPT_FAILED	50	AAMP: DRM Decryption Failed for Fragments	X	X	If fragment decryption and retry count exceedes MAX_SEG_DRM_DECRYPT_FAIL_COUNT(10) or more fragments.	X		XRE-06014	XRE-03092
10	AAMP_TUNE_CORRUPT_DRM_DATA	51	AAMP: DRM failure due to Corrupt DRM files (or) If 3322, 3328 : AAMP: DRM Failure possibly due to corrupt drm data; majorError If 3307 : AAMP: DRM Failure possibly due to corrupt CertStore majorError	X		Class of AVE DRM library errors that suggest cached DRM files are corrupted. (/opt/persistent/adobe - might be corrupted) DRM Major errorcode : 3322, 3328, 3307 This should trigger automatic "self healing" for next tune.	X	XRE-03090		XRE-03092
11	AAMP_TUNE_GST_PIPELINE_ERROR	80	GstPipeline Error:Decrypt Error GstPipeline Error:Your GStreamer installation is missing a plug-in GstPipeline Error:video decode error GstPipeline Error:HDCP Authentication Failure	X	X	Triggered by GST_MESSAGE_ERROR, with human readable description extracted using gst_message_parse_error. Check the logs for better understanding.	X	X	XRE-03090	XRE-06014
12	AAMP_TUNE_PLAYBACK_STALLED	7600	Playback has been stalled for more than	X	X	AAMP playback stalled because of the non-availability of sufficient fragments.	X	X	XRE-03090		XRE-03092

Crash & Hang Issue Analysis

...

Link: Producing stack traces from google breakpad minidump manually
https://etwiki.sys.comcast.net/display/CPE/Producing+stack+traces+from+google+breakpad+minidump Google Breakpad

For core dump back trace generation: Will create a new page and add the link here..

...

Look for crashed thread and aamp side function symbols available threads, some time aamp can be hold by other modules and that time aamp can met with hung (or) some times aamp itself met hang with its calls. For better understanding analyze the back trace along with the logs.

Example: Image RemovedDELIA-35682 - [Rack][Arris-BCM-XG1v3][AAMPDASH]: WPEIPVideo crash in handleHostCall OPEN here aamp is blocked with sec-client call, see for understanding..

> will add few more examples..

Useful Links

Crash Portal : https://crashportal.stb.r53.xcal.tv/login/index
Producing stack traces from google breakpad minidump manually : Producing stack traces from google breakpad minidump Google Breakpad

DASH Playback Analysis

Successful working case & Functional call flow with Log Snippets

...

Actual receiver log for the above snippets

HLS Playback Analysis

Successful working case & Functional call flow with Log Snippets

...

2019 Jun 18 22:25:24.018072 pacexi5 Receiver[6007]: Thread-6007 [AAMP-WEB] - IP_EX_CONTENT_URL:http://127.0.0.1:9080/tsb?clientId=FOG_AAMP&recordedUrl=http://ccr.linear-nat-pil-red.xcr.comcast.net/MSNBC_HD_NAT_18292_0_8348966700753924163.m3u8 DurationMs:28000
2019 Jun 18 22:25:24.018150 pacexi5 Receiver[6007]: Thread-6007 [AAMP-WEB] - IP_TUNETIME:3,4.4,4.3
...
2019 Jun 18 22:25:24.018204 pacexi5 Receiver[6007]: Thread-6007 [AAMP-WEB] - IP_EX_TUNETIME:3,4.479,4.338,0.825,0.134,0.116,3.289,0.114,0.001,0.000,0.000,0.914,3.288,1,0.119,1,0.116,1,0.815,1,12,0,1,0,0,28,1,0.000,2,1
2019 Jun 18 22:25:24.018367 pacexi5 Receiver[6007]: Thread-6007 [AAMP-WEB] - New flash video is playing. Duration=28000
2019 Jun 18 22:25:24.018401 pacexi5 Receiver[6007]: Thread-6007 [ECM] - New flash video is playing. Duration=28000 hasTSB=1
2019 Jun 18 22:25:24.018469 pacexi5 Receiver[6007]: Thread-6007 [VideoResource] - event=onVideoInfo

Actual receiver log for the above snippets

...

RDK Resources

[*RDK Preferred*]

[RDK Conferences]

Archives

In the News!

Page History

Versions Compared

Key

Topics

Reference & log pointers to indicate the failure in Broadcom.

Useful Links

S.No

AAMP Error Map Code

Media Error Code

Error Description

Failure on Tune Start

Failure on Mid Tune

Reason for failures

HLS

DASH

IP-Linear

VOD

S.No

AAMP Error Map Code

Media Error Code

Error Description

Failure on Tune Start

Failure on Mid Tune

Reason for failures

HLS

DASH

IP-Linear

cDVR

Useful Links

Actual receiver log for the above snippets

Successful working case & Functional call flow with Log Snippets

Actual receiver log for the above snippets

[RDK Preferred]