Summary Table
| rialto | Commit ID: dd801e3aaebf95d77d74938ac4f0ce8ebbf05925 |
| rialto-gstreamer | Commit ID: b141ec59e016c774e33d2c66b75730f393c93d11 |
| rialto-ocdm | Commit ID: 35d4ec5d318e5d42885fb1e208c22fc10cb82505 |
| L1 Tests | |
| Unit Tests | Passed |
| Component Tests | Passed |
| YT Conformance Tests (v. 20240325) | |||||||||
| Devices | AV1 SFR Tests | H264 SFR Tests | HFR Tests | VP9 SFR Tests | MSE Codec Tests | MSE Conformance Tests | Progressive Tests | EME Conformance Tests | |
|---|---|---|---|---|---|---|---|---|---|
| Flex2 | 22/22 | 33/33 | 47/47 | 32/32 | 104/104 | 42/42 | 51/51 | 26/26 | |
| XioneUK | No files were found! Due to a crash! | ||||||||
| Llama | No files were found! Due to a crash! | ||||||||
| NPLB Tests | |
| Devices | Tests |
|---|---|
| Flex2 | 1396/1432 |
| XioneUK | XioneUKNPLBValue |
| Llama | LlamaNPLBValue |
| Links | ||
| Devices | YTCert | NPLB |
|---|---|---|
| Flex2 | https://pv-jen015.uk2.scp.bskyb.com/job/AI/job/RIALTO_BUILDS/job/Flex2-Builds/job/CI_RIALTO_YT_CERT_TEST_FLEX2/164 | https://pv-jen015.uk2.scp.bskyb.com/job/AI/job/RIALTO_BUILDS/job/Flex2-Builds/job/CI_AI_RIALTO_NPLB_TEST_FLEX2/890 |
| XioneUK | XioneUKYTCertLink | XioneUKNPLBLink |
| Llama | LlamaYTCertLink | LlamaNPLBLink |
Flex2 Results
YTCert Results - Flex2
| AV1 SFR Tests | |||
|---|---|---|---|
| 01:TotalVideoFrames | 02:FrameDrop | 03:PlaybackPerfAV1.144p.30fps@1X | 04:PlaybackPerfAV1.240p.30fps@1X |
| 05:PlaybackPerfAV1.360p.30fps@1X | 06:PlaybackPerfAV1.480p.30fps@1X | 07:PlaybackPerfAV1.720p.30fps@0.25X | 08:PlaybackPerfAV1.720p.30fps@0.5X |
| 09:PlaybackPerfAV1.720p.30fps@0.75X | 10:PlaybackPerfAV1.720p.30fps@1X | 11:PlaybackPerfAV1.720p.30fps@1.25X | 12:PlaybackPerfAV1.720p.30fps@1.5X |
| 13:PlaybackPerfAV1.720p.30fps@1.75X | 14:PlaybackPerfAV1.720p.30fps@2X | 15:PlaybackPerfAV1.1080p.30fps@0.25X | 16:PlaybackPerfAV1.1080p.30fps@0.5X |
| 17:PlaybackPerfAV1.1080p.30fps@0.75X | 18:PlaybackPerfAV1.1080p.30fps@1X | 19:PlaybackPerfAV1.1080p.30fps@1.25X | 20:PlaybackPerfAV1.1080p.30fps@1.5X |
| 21:PlaybackPerfAV1.1080p.30fps@1.75X | 22:PlaybackPerfAV1.1080p.30fps@2X | ||
| H264 SFR Tests | |||
| 01:TotalVideoFrames | 02:FrameDrop | 03:PlaybackPerfH264.144p.15fps@1X | 04:PlaybackPerfH264.240p.30fps@1X |
| 05:PlaybackPerfH264.360p.30fps@1X | 06:PlaybackPerfH264.480p.30fps@1X | 07:PlaybackPerfH264.720p.30fps@0.25X | 08:PlaybackPerfH264.720p.30fps@0.5X |
| 09:PlaybackPerfH264.720p.30fps@0.75X | 10:PlaybackPerfH264.720p.30fps@1X | 11:PlaybackPerfH264.720p.30fps@1.25X | 12:PlaybackPerfH264.720p.30fps@1.5X |
| 13:PlaybackPerfH264.720p.30fps@1.75X | 14:PlaybackPerfH264.720p.30fps@2X | 15:PlaybackPerfH264.1080p.30fps@0.25X | 16:PlaybackPerfH264.1080p.30fps@0.5X |
| 17:PlaybackPerfH264.1080p.30fps@0.75X | 18:PlaybackPerfH264.1080p.30fps@1X | 19:PlaybackPerfH264.1080p.30fps@1.25X | 20:PlaybackPerfH264.1080p.30fps@1.5X |
| 21:PlaybackPerfH264.1080p.30fps@1.75X | 22:PlaybackPerfH264.1080p.30fps@2X | 39:PlaybackPerfH264.426p.24fps@1X | 40:PlaybackPerfH264.640p.24fps@1X |
| 41:PlaybackPerfH264.854p.24fps@0.25X | 42:PlaybackPerfH264.854p.24fps@0.5X | 43:PlaybackPerfH264.854p.24fps@0.75X | 44:PlaybackPerfH264.854p.24fps@1X |
| 45:PlaybackPerfH264.854p.24fps@1.25X | 46:PlaybackPerfH264.854p.24fps@1.5X | 47:PlaybackPerfH264.854p.24fps@1.75X | 48:PlaybackPerfH264.854p.24fps@2X |
| 65:PlaybackPerfH264.256p.24fps@1X | |||
| HFR Tests | |||
| 01:TotalVideoFrames | 02:FrameDrop | 03:PlaybackPerfVP9.720p.60fps@0.25X | 04:PlaybackPerfVP9.720p.60fps@0.5X |
| 05:PlaybackPerfVP9.720p.60fps@0.75X | 07:PlaybackPerfVP9.720p.60fps@1.25X | 08:PlaybackPerfVP9.720p.60fps@1.5X | 09:PlaybackPerfVP9.720p.60fps@1.75X |
| 10:PlaybackPerfVP9.720p.60fps@2X | 11:PlaybackPerfVP9.1080p.60fps@0.25X | 12:PlaybackPerfVP9.1080p.60fps@0.5X | 13:PlaybackPerfVP9.1080p.60fps@0.75X |
| 15:PlaybackPerfVP9.1080p.60fps@1.25X | 16:PlaybackPerfVP9.1080p.60fps@1.5X | 17:PlaybackPerfVP9.1080p.60fps@1.75X | 18:PlaybackPerfVP9.1080p.60fps@2X |
| 35:PlaybackPerfH264.720p.60fps@0.25X | 36:PlaybackPerfH264.720p.60fps@0.5X | 37:PlaybackPerfH264.720p.60fps@0.75X | 38:PlaybackPerfH264.720p.60fps@1X |
| 39:PlaybackPerfH264.720p.60fps@1.25X | 40:PlaybackPerfH264.720p.60fps@1.5X | 41:PlaybackPerfH264.720p.60fps@1.75X | 42:PlaybackPerfH264.720p.60fps@2X |
| 43:PlaybackPerfH264.1080p.60fps@0.25X | 44:PlaybackPerfH264.1080p.60fps@0.5X | 45:PlaybackPerfH264.1080p.60fps@0.75X | 46:PlaybackPerfH264.1080p.60fps@1X |
| 47:PlaybackPerfH264.1080p.60fps@1.25X | 48:PlaybackPerfH264.1080p.60fps@1.5X | 49:PlaybackPerfH264.1080p.60fps@1.75X | 50:PlaybackPerfH264.1080p.60fps@2X |
| 51:PlaybackPerfAV1.720p.60fps@0.25X | 52:PlaybackPerfAV1.720p.60fps@0.5X | 53:PlaybackPerfAV1.720p.60fps@0.75X | 55:PlaybackPerfAV1.720p.60fps@1.25X |
| 56:PlaybackPerfAV1.720p.60fps@1.5X | 57:PlaybackPerfAV1.720p.60fps@1.75X | 58:PlaybackPerfAV1.720p.60fps@2X | 59:PlaybackPerfAV1.1080p.60fps@0.25X |
| 60:PlaybackPerfAV1.1080p.60fps@0.5X | 61:PlaybackPerfAV1.1080p.60fps@0.75X | 62:PlaybackPerfAV1.1080p.60fps@1X | 63:PlaybackPerfAV1.1080p.60fps@1.25X |
| 64:PlaybackPerfAV1.1080p.60fps@1.5X | 65:PlaybackPerfAV1.1080p.60fps@1.75X | 66:PlaybackPerfAV1.1080p.60fps@2X | |
| VP9 SFR Tests | |||
| 01:TotalVideoFrames | 02:FrameDrop | 03:PlaybackPerfVP9.144p.30fps@1X | 04:PlaybackPerfVP9.240p.30fps@1X |
| 05:PlaybackPerfVP9.360p.30fps@1X | 06:PlaybackPerfVP9.480p.30fps@1X | 07:PlaybackPerfVP9.720p.30fps@0.25X | 08:PlaybackPerfVP9.720p.30fps@0.5X |
| 09:PlaybackPerfVP9.720p.30fps@0.75X | 10:PlaybackPerfVP9.720p.30fps@1X | 11:PlaybackPerfVP9.720p.30fps@1.25X | 12:PlaybackPerfVP9.720p.30fps@1.5X |
| 13:PlaybackPerfVP9.720p.30fps@1.75X | 14:PlaybackPerfVP9.720p.30fps@2X | 15:PlaybackPerfVP9.1080p.30fps@0.25X | 16:PlaybackPerfVP9.1080p.30fps@0.5X |
| 17:PlaybackPerfVP9.1080p.30fps@0.75X | 18:PlaybackPerfVP9.1080p.30fps@1X | 19:PlaybackPerfVP9.1080p.30fps@1.25X | 20:PlaybackPerfVP9.1080p.30fps@1.5X |
| 21:PlaybackPerfVP9.1080p.30fps@1.75X | 22:PlaybackPerfVP9.1080p.30fps@2X | 39:PlaybackPerfVP9.426p.24fps@1X | 40:PlaybackPerfVP9.640p.24fps@1X |
| 41:PlaybackPerfVP9.854p.24fps@0.25X | 42:PlaybackPerfVP9.854p.24fps@0.5X | 43:PlaybackPerfVP9.854p.24fps@0.75X | 44:PlaybackPerfVP9.854p.24fps@1X |
| 45:PlaybackPerfVP9.854p.24fps@1.25X | 46:PlaybackPerfVP9.854p.24fps@1.5X | 47:PlaybackPerfVP9.854p.24fps@1.75X | 48:PlaybackPerfVP9.854p.24fps@2X |
| MSE Codec Tests | |||
| 01:AppendOpusAudio | 02:AbortOpusAudio | 03:TimestampOffsetOpusAudio | 04:DurationAfterAppendOpusAudio |
| 05:PausedStateWithOpusAudio | 06:IncrementalOpusAudio | 07:LimitedOpusAudio | 08:IncrementalLimitedOpusAudio |
| 09:HighBitRateIncrementalLimitedOpusAudio | 10:AppendOpusAudioOffset | 11:AppendMultipleInitOpusAudio | 12:AppendOpusAudioOutOfOrder |
| 13:BufferedRangeOpusAudio | 14:OpusAudioWithOverlap | 15:OpusAudioWithSmallGap | 16:OpusAudioWithLargeGap |
| 17:DelayedOpusAudio | 18:PlaybackOnlyOpusAudio | 19:PlaybackOnlyAC3Audio | 20:PlaybackOnlyEAC3Audio |
| 21:AppendAACAudio | 22:AbortAACAudio | 23:TimestampOffsetAACAudio | 24:DurationAfterAppendAACAudio |
| 25:PausedStateWithAACAudio | 26:IncrementalAACAudio | 28:IncrementalLimitedAACAudio | 29:HighBitRateIncrementalLimitedAACAudio |
| 30:AppendAACAudioOffset | 31:AppendMultipleInitAACAudio | 32:AppendAACAudioOutOfOrder | 33:BufferedRangeAACAudio |
| 34:AACAudioWithOverlap | 35:AACAudioWithSmallGap | 36:AACAudioWithLargeGap | 37:DelayedAACAudio |
| 38:PlaybackOnlyAACAudio | 39:AppendVP9Video | 40:AbortVP9Video | 41:TimestampOffsetVP9Video |
| 42:DASHLatencyVP9 | 43:DurationAfterAppendVP9Video | 44:PausedStateWithVP9Video | 45:VideoDimensionVP9 |
| 46:PlaybackStateVP9 | 47:PlayPartialVP9Segment | 48:AppendVP9VideoOffset | 49:AppendMultipleInitVP9Video |
| 50:AppendVP9VideoOutOfOrder | 51:BufferedRangeVP9Video | 52:MediaSourceDurationVP9 | 53:VP9VideoWithOverlap |
| 54:VP9VideoWithSmallGap | 55:VP9VideoWithLargeGap | 56:SeekVP9 | 57:LoopVP9 |
| 58:LoopAfterEndedVP9 | 59:LoopAfterEndedNoSeekVP9 | 60:BufUnbufSeekVP9 | 61:DelayedVP9Video |
| 62:PlaybackOnlyVP9Video | 63:AppendH264Video | 64:AbortH264Video | 65:TimestampOffsetH264Video |
| 66:DASHLatencyH264 | 67:DurationAfterAppendH264Video | 68:PausedStateWithH264Video | 69:VideoDimensionH264 |
| 70:PlaybackStateH264 | 71:PlayPartialH264Segment | 72:AppendH264VideoOffset | 73:AppendMultipleInitH264Video |
| 74:AppendH264VideoOutOfOrder | 75:BufferedRangeH264Video | 76:MediaSourceDurationH264 | 77:H264VideoWithOverlap |
| 78:H264VideoWithSmallGap | 79:H264VideoWithLargeGap | 80:SeekH264 | 81:LoopH264 |
| 82:LoopAfterEndedH264 | 83:LoopAfterEndedNoSeekH264 | 84:BufUnbufSeekH264 | 85:DelayedH264Video |
| 86:PlaybackOnlyH264Video | 87:AppendAV1Video | 88:AbortAV1Video | 89:TimestampOffsetAV1Video |
| 90:DASHLatencyAV1 | 91:DurationAfterAppendAV1Video | 92:PausedStateWithAV1Video | 93:VideoDimensionAV1 |
| 94:PlaybackStateAV1 | 95:PlayPartialAV1Segment | 96:AppendAV1VideoOffset | 97:AppendMultipleInitAV1Video |
| 98:AppendAV1VideoOutOfOrder | 99:BufferedRangeAV1Video | 100:MediaSourceDurationAV1 | 101:AV1VideoWithOverlap |
| 102:AV1VideoWithSmallGap | 103:AV1VideoWithLargeGap | 104:SeekAV1 | 105:BufUnbufSeekAV1 |
| MSE Conformance Tests | |||
| 01:InitialMediaDuration | 02:InitialMediaVideoWidth | 03:InitialMediaVideoHeight | 04:InitialMediaReadyState |
| 05:InitialMediaSrc | 06:InitialMediaCurrentSrc | 08:XHRAbort | 09:XHROpenState |
| 10:Presence | 11:Attach | 12:AddSourceBuffer | 13:AddSBException |
| 14:RemoveSourceBuffer | 15:InitialMSDuration | 16:InitialMSReadyState | 17:Duration |
| 18:MediaElementEvents | 19:MediaSourceEvents | 20:VideoBufferSize | 21:VideoBufferSpeed |
| 22:StartPlayWithoutData | 24:StartPlayAtTimeGt0H264+AAC | 25:StartPlayAtTimeGt0VP9+Opus | 26:EventTimestamp |
| 27:SeekTimeUpdate | 28:AppendWindowStart | 29:AppendWindowEnd | 39:SFRAccuracy |
| 40:HFRAccuracy | 41:SFRSpecAccuracy | 42:HFRSpecAccuracy | 44:SFRPausedAccuracy100ms |
| 46:HFRPausedAccuracy100ms | 47:AACSupport | 48:H264Support | 49:VP9Support |
| 50:OpusSupport | 51:AV1Support | 52:H264FrameGaps | 53:H264FrameOverlaps |
| 54:HE-AAC/ExplicitSBR | 55:HE-AAC/ImplicitSBR | ||
| Progressive Tests | |||
| 01:src | 02:currentSrc | 03:defaultPlaybackRate | 04:playbackRate |
| 05:duration | 06:paused | 07:seeking | 08:ended |
| 09:videoWidth | 10:videoHeight | 11:buffered.length | 12:played.length |
| 13:seekable.length | 14:networkState | 15:readyState | 16:networkState |
| 17:readyState | 18:src | 19:networkState | 20:readyState |
| 21:currentSrc | 22:onprogress | 23:ontimeupdate | 24:canplay |
| 25:autoplay | 26:networkState | 27:paused | 28:onwaiting |
| 29:maxGranularityPlaybackRate0.25 | 30:maxGranularityPlaybackRate0.50 | 31:maxGranularityPlaybackRate1.00 | 32:maxGranularityPlaybackRate1.25 |
| 33:maxGranularityPlaybackRate1.50 | 34:maxGranularityPlaybackRate2.00 | 35:minGranularityPlaybackRate0.25 | 36:minGranularityPlaybackRate0.50 |
| 37:minGranularityPlaybackRate1.00 | 38:minGranularityPlaybackRate1.25 | 39:minGranularityPlaybackRate1.50 | 40:minGranularityPlaybackRate2.00 |
| 42:progressing | 43:progressing | 44:duration | 45:PlaybackRate0.25 |
| 46:PlaybackRate0.50 | 47:PlaybackRate1.00 | 48:PlaybackRate1.25 | 49:PlaybackRate1.50 |
| 50:PlaybackRate2.00 | 51:PlaybackRate0.75 | 52:PlaybackRate1.75 | |
| EME Conformance Tests | |||
| 01:WidevineH264Video | 02:WidevineAACAudio | 03:WidevineOpusAudio | 04:WidevineVP9Video |
| 05:WidevineVP9SubsampleVideo | 07:WidevineLicenseDelayH264Video | 08:WidevineLicenseDelayVP9Video | 09:setServerCertificate |
| 10:PlayreadyH264Video | 11:PlayreadyAACAudio | 12:EncryptedEventData | 17:H264VideoCenc |
| 18:H264VideoUnsetScheme | 19:H264VideoInvalidScheme | 20:VP9VideoCenc | 21:VP9VideoUnsetScheme |
| 23:VP9VideoInvalidScheme | 26:AV1VideoInvalidScheme | 27:AACAudioCenc | 28:AACAudioUnsetScheme |
| 30:AACAudioInvalidScheme | 31:OpusAudioCenc | 32:OpusAudioUnsetScheme | 33:OpusAudioInvalidScheme |
| 36:H264VideoCencAACAudioCenc | 37:VP9VideoCencOpusAudioCenc | ||
NPLB Results - Flex2
| Failures | |
| Test Suite | Test Case |
|---|---|
| SbDrmSessionTest | CloseDrmSessionBeforeUpdateSession |
| SbMediaCanPlayMimeAndKeySystem | MinimumSupport |
| SbPlayerGetAudioConfigurationTests/SbPlayerGetAudioConfigurationTest | MultipleSeeks/audio_sintel_5s_pcm_s16le_dmp_video_null_output_punch_out_key_system_null |
| SbPlayerGetMediaTimeTests/SbPlayerGetMediaTimeTest | TimeAfterSeek/audio_beneath_the_canopy_opus_stereo_dmp_video_beneath_the_canopy_137_avc_dmp_output_punch_out_key_system_null |
| SbPlayerGetMediaTimeTests/SbPlayerGetMediaTimeTest | TimeAfterSeek/audio_sintel_381_ac3_dmp_video_beneath_the_canopy_137_avc_dmp_output_punch_out_key_system_null |
| SbPlayerGetMediaTimeTests/SbPlayerGetMediaTimeTest | TimeAfterSeek/audio_sintel_5s_pcm_s16le_dmp_video_null_output_punch_out_key_system_null |
| SbPlayerGetMediaTimeTests/SbPlayerGetMediaTimeTest | TimeAfterSeek/audio_beneath_the_canopy_aac_stereo_dmp_video_beneath_the_canopy_137_avc_dmp_output_punch_out_key_system_com_widevine_alpha |
| SbPlayerGetMediaTimeTests/SbPlayerGetMediaTimeTest | TimeAfterSeek/audio_beneath_the_canopy_opus_stereo_dmp_video_beneath_the_canopy_137_avc_dmp_output_punch_out_key_system_com_widevine_alpha |
| SbPlayerGetMediaTimeTests/SbPlayerGetMediaTimeTest | TimeAfterSeek/audio_sintel_5s_pcm_s16le_dmp_video_null_output_punch_out_key_system_com_widevine_alpha |
| SbPlayerGetMediaTimeTests/SbPlayerGetMediaTimeTest | TimeAfterSeek/audio_beneath_the_canopy_opus_stereo_dmp_video_beneath_the_canopy_137_avc_dmp_output_punch_out_key_system_com_youtube_playready |
| SbPlayerGetMediaTimeTests/SbPlayerGetMediaTimeTest | TimeAfterSeek/audio_sintel_329_ec3_dmp_video_beneath_the_canopy_137_avc_dmp_output_punch_out_key_system_com_youtube_playready |
| SbPlayerGetMediaTimeTests/SbPlayerGetMediaTimeTest | TimeAfterSeek/audio_sintel_5s_pcm_s16le_dmp_video_null_output_punch_out_key_system_com_youtube_playready |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | LimitedAudioInput/audio_sintel_329_ec3_dmp_video_sintel_399_av1_dmp_output_punch_out_key_system_null |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | PartialAudio/audio_beneath_the_canopy_aac_stereo_dmp_video_null_output_punch_out_key_system_null |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | PartialAudio/audio_beneath_the_canopy_opus_stereo_dmp_video_null_output_punch_out_key_system_null |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | PartialAudio/audio_beneath_the_canopy_aac_5_1_dmp_video_null_output_punch_out_key_system_null |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | PartialAudio/audio_beneath_the_canopy_aac_mono_dmp_video_null_output_punch_out_key_system_null |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | PartialAudio/audio_beneath_the_canopy_opus_5_1_dmp_video_null_output_punch_out_key_system_null |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | PartialAudio/audio_beneath_the_canopy_opus_mono_dmp_video_null_output_punch_out_key_system_null |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | PartialAudio/audio_heaac_dmp_video_null_output_punch_out_key_system_null |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | PartialAudio/audio_beneath_the_canopy_aac_stereo_dmp_video_null_output_punch_out_key_system_com_widevine_alpha |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | PartialAudio/audio_beneath_the_canopy_opus_stereo_dmp_video_null_output_punch_out_key_system_com_widevine_alpha |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | PartialAudio/audio_beneath_the_canopy_aac_5_1_dmp_video_null_output_punch_out_key_system_com_widevine_alpha |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | PartialAudio/audio_beneath_the_canopy_aac_mono_dmp_video_null_output_punch_out_key_system_com_widevine_alpha |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | PartialAudio/audio_beneath_the_canopy_opus_5_1_dmp_video_null_output_punch_out_key_system_com_widevine_alpha |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | PartialAudio/audio_beneath_the_canopy_opus_mono_dmp_video_null_output_punch_out_key_system_com_widevine_alpha |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | PartialAudio/audio_heaac_dmp_video_null_output_punch_out_key_system_com_widevine_alpha |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | PartialAudio/audio_beneath_the_canopy_aac_stereo_dmp_video_null_output_punch_out_key_system_com_youtube_playready |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | PartialAudio/audio_beneath_the_canopy_opus_stereo_dmp_video_null_output_punch_out_key_system_com_youtube_playready |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | PartialAudio/audio_beneath_the_canopy_aac_5_1_dmp_video_null_output_punch_out_key_system_com_youtube_playready |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | PartialAudio/audio_beneath_the_canopy_aac_mono_dmp_video_null_output_punch_out_key_system_com_youtube_playready |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | PartialAudio/audio_beneath_the_canopy_opus_5_1_dmp_video_null_output_punch_out_key_system_com_youtube_playready |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | PartialAudio/audio_beneath_the_canopy_opus_mono_dmp_video_null_output_punch_out_key_system_com_youtube_playready |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | PartialAudio/audio_heaac_dmp_video_null_output_punch_out_key_system_com_youtube_playready |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | DiscardAllAudio/audio_sintel_5s_pcm_s16le_dmp_video_null_output_punch_out_key_system_null |
| SbPlayerWriteSampleTests/SbPlayerWriteSampleTest | DiscardAllAudio/audio_sintel_5s_pcm_s16le_dmp_video_null_output_punch_out_key_system_com_widevine_alpha |
| Skipped Tests | |
| Test Suite | Test Case |
|---|---|
| No tests skipped | |
| Excluded NPLB Flex2 Tests | ||||
| NPLB Flex2 | ||||
|---|---|---|---|---|
| Posix* | .* | |||
| SbAudioSinkCreateTest | .* | |||
| SbAudioSinkTest | .* | |||
| SbDrmSessionTest | .SunnyDay, .InvalidSessionUpdateRequestParams | |||
| SbMediaSetAudioWriteDurationTests | /SbMediaSetAudioWriteDurationTest.WriteLimitedInput/*, SbMediaSetAudioWriteDurationTest.WriteContinuedLimitedInput/* | |||
| SbDrmTest | .AnySupportedKeySystems, .MultiDrm | |||
| SbPlayerTests | /SbPlayerTest.* | |||
| SbSocketWaiterWakeUpTest | .CallFromOtherThreadWakesUp, .EarlyCallWakesUpMultiply | |||
| SbMediaBufferTest | .ValidatePerformance | |||
| MultiplePlayerTests | /MultiplePlayerTest.WriteSamples/audio0_beneath_the_canopy_aac_stereo_dmp_* | |||
| SbSocketResolveTest | .SunnyDay | |||
| SbSocketAddressTypes | N/A | |||
| SbPlayerWriteSampleTests | N/A | |||
| SbPlayerGetAudioConfigurationTests | N/A | |||
| VerticalVideoTests | N/A | |||
| SbOnceTest | N/A | |||
| None | N/A | |||
| SbSocketJoinMulticastGroupTest | N/A | |||
| SbStorageGetRecordSizeTest | N/A | |||
| SbStorageReadRecordTest | N/A | |||
| SbStorageWriteRecordTest | N/A | |||
| SbSystemGetLocaleIdTest | N/A | |||
| SbSystemGetPathTest | N/A | |||
| SbSystemGetPropertyTest | N/A | |||
| SbMediaCanPlayMimeAndKeySystem | N/A | |||
| SbSystemGetStackTest | N/A | |||
| SbSystemSymbolizeTest | N/A | |||
Llama Results
YTCert Results - Llama
| AV1 SFR Tests | |||
|---|---|---|---|
| 01:TotalVideoFrames | 02:FrameDrop | 03:PlaybackPerfAV1.144p.30fps@1X | 04:PlaybackPerfAV1.240p.30fps@1X |
| 05:PlaybackPerfAV1.360p.30fps@1X | 06:PlaybackPerfAV1.480p.30fps@1X | 07:PlaybackPerfAV1.720p.30fps@0.25X | 08:PlaybackPerfAV1.720p.30fps@0.5X |
| 09:PlaybackPerfAV1.720p.30fps@0.75X | 10:PlaybackPerfAV1.720p.30fps@1X | 11:PlaybackPerfAV1.720p.30fps@1.25X | 12:PlaybackPerfAV1.720p.30fps@1.5X |
| 13:PlaybackPerfAV1.720p.30fps@1.75X | 14:PlaybackPerfAV1.720p.30fps@2X | 15:PlaybackPerfAV1.1080p.30fps@0.25X | 16:PlaybackPerfAV1.1080p.30fps@0.5X |
| 17:PlaybackPerfAV1.1080p.30fps@0.75X | 18:PlaybackPerfAV1.1080p.30fps@1X | 19:PlaybackPerfAV1.1080p.30fps@1.25X | 20:PlaybackPerfAV1.1080p.30fps@1.5X |
| 21:PlaybackPerfAV1.1080p.30fps@1.75X | 22:PlaybackPerfAV1.1080p.30fps@2X | ||
| H264 SFR Tests | |||
| 01:TotalVideoFrames | 02:FrameDrop | 03:PlaybackPerfH264.144p.15fps@1X | 04:PlaybackPerfH264.240p.30fps@1X |
| 05:PlaybackPerfH264.360p.30fps@1X | 06:PlaybackPerfH264.480p.30fps@1X | 07:PlaybackPerfH264.720p.30fps@0.25X | 08:PlaybackPerfH264.720p.30fps@0.5X |
| 09:PlaybackPerfH264.720p.30fps@0.75X | 10:PlaybackPerfH264.720p.30fps@1X | 11:PlaybackPerfH264.720p.30fps@1.25X | 12:PlaybackPerfH264.720p.30fps@1.5X |
| 13:PlaybackPerfH264.720p.30fps@1.75X | 14:PlaybackPerfH264.720p.30fps@2X | 15:PlaybackPerfH264.1080p.30fps@0.25X | 16:PlaybackPerfH264.1080p.30fps@0.5X |
| 17:PlaybackPerfH264.1080p.30fps@0.75X | 18:PlaybackPerfH264.1080p.30fps@1X | 19:PlaybackPerfH264.1080p.30fps@1.25X | 20:PlaybackPerfH264.1080p.30fps@1.5X |
| 21:PlaybackPerfH264.1080p.30fps@1.75X | 22:PlaybackPerfH264.1080p.30fps@2X | 39:PlaybackPerfH264.426p.24fps@1X | 40:PlaybackPerfH264.640p.24fps@1X |
| 41:PlaybackPerfH264.854p.24fps@0.25X | 42:PlaybackPerfH264.854p.24fps@0.5X | 43:PlaybackPerfH264.854p.24fps@0.75X | 44:PlaybackPerfH264.854p.24fps@1X |
| 45:PlaybackPerfH264.854p.24fps@1.25X | 46:PlaybackPerfH264.854p.24fps@1.5X | 47:PlaybackPerfH264.854p.24fps@1.75X | 48:PlaybackPerfH264.854p.24fps@2X |
| 65:PlaybackPerfH264.256p.24fps@1X | |||
| HFR Tests | |||
| 01:TotalVideoFrames | 02:FrameDrop | 03:PlaybackPerfVP9.720p.60fps@0.25X | 04:PlaybackPerfVP9.720p.60fps@0.5X |
| 05:PlaybackPerfVP9.720p.60fps@0.75X | 07:PlaybackPerfVP9.720p.60fps@1.25X | 08:PlaybackPerfVP9.720p.60fps@1.5X | 09:PlaybackPerfVP9.720p.60fps@1.75X |
| 10:PlaybackPerfVP9.720p.60fps@2X | 11:PlaybackPerfVP9.1080p.60fps@0.25X | 12:PlaybackPerfVP9.1080p.60fps@0.5X | 13:PlaybackPerfVP9.1080p.60fps@0.75X |
| 15:PlaybackPerfVP9.1080p.60fps@1.25X | 16:PlaybackPerfVP9.1080p.60fps@1.5X | 17:PlaybackPerfVP9.1080p.60fps@1.75X | 18:PlaybackPerfVP9.1080p.60fps@2X |
| 35:PlaybackPerfH264.720p.60fps@0.25X | 36:PlaybackPerfH264.720p.60fps@0.5X | 37:PlaybackPerfH264.720p.60fps@0.75X | 38:PlaybackPerfH264.720p.60fps@1X |
| 39:PlaybackPerfH264.720p.60fps@1.25X | 40:PlaybackPerfH264.720p.60fps@1.5X | 41:PlaybackPerfH264.720p.60fps@1.75X | 42:PlaybackPerfH264.720p.60fps@2X |
| 43:PlaybackPerfH264.1080p.60fps@0.25X | 44:PlaybackPerfH264.1080p.60fps@0.5X | 45:PlaybackPerfH264.1080p.60fps@0.75X | 46:PlaybackPerfH264.1080p.60fps@1X |
| 47:PlaybackPerfH264.1080p.60fps@1.25X | 48:PlaybackPerfH264.1080p.60fps@1.5X | 49:PlaybackPerfH264.1080p.60fps@1.75X | 50:PlaybackPerfH264.1080p.60fps@2X |
| 51:PlaybackPerfAV1.720p.60fps@0.25X | 52:PlaybackPerfAV1.720p.60fps@0.5X | 53:PlaybackPerfAV1.720p.60fps@0.75X | 55:PlaybackPerfAV1.720p.60fps@1.25X |
| 56:PlaybackPerfAV1.720p.60fps@1.5X | 57:PlaybackPerfAV1.720p.60fps@1.75X | 58:PlaybackPerfAV1.720p.60fps@2X | 59:PlaybackPerfAV1.1080p.60fps@0.25X |
| 60:PlaybackPerfAV1.1080p.60fps@0.5X | 61:PlaybackPerfAV1.1080p.60fps@0.75X | 62:PlaybackPerfAV1.1080p.60fps@1X | 63:PlaybackPerfAV1.1080p.60fps@1.25X |
| 64:PlaybackPerfAV1.1080p.60fps@1.5X | 65:PlaybackPerfAV1.1080p.60fps@1.75X | 66:PlaybackPerfAV1.1080p.60fps@2X | |
| VP9 SFR Tests | |||
| 01:TotalVideoFrames | 02:FrameDrop | 03:PlaybackPerfVP9.144p.30fps@1X | 04:PlaybackPerfVP9.240p.30fps@1X |
| 05:PlaybackPerfVP9.360p.30fps@1X | 06:PlaybackPerfVP9.480p.30fps@1X | 07:PlaybackPerfVP9.720p.30fps@0.25X | 08:PlaybackPerfVP9.720p.30fps@0.5X |
| 09:PlaybackPerfVP9.720p.30fps@0.75X | 10:PlaybackPerfVP9.720p.30fps@1X | 11:PlaybackPerfVP9.720p.30fps@1.25X | 12:PlaybackPerfVP9.720p.30fps@1.5X |
| 13:PlaybackPerfVP9.720p.30fps@1.75X | 14:PlaybackPerfVP9.720p.30fps@2X | 15:PlaybackPerfVP9.1080p.30fps@0.25X | 16:PlaybackPerfVP9.1080p.30fps@0.5X |
| 17:PlaybackPerfVP9.1080p.30fps@0.75X | 18:PlaybackPerfVP9.1080p.30fps@1X | 19:PlaybackPerfVP9.1080p.30fps@1.25X | 20:PlaybackPerfVP9.1080p.30fps@1.5X |
| 21:PlaybackPerfVP9.1080p.30fps@1.75X | 22:PlaybackPerfVP9.1080p.30fps@2X | 39:PlaybackPerfVP9.426p.24fps@1X | 40:PlaybackPerfVP9.640p.24fps@1X |
| 41:PlaybackPerfVP9.854p.24fps@0.25X | 42:PlaybackPerfVP9.854p.24fps@0.5X | 43:PlaybackPerfVP9.854p.24fps@0.75X | 44:PlaybackPerfVP9.854p.24fps@1X |
| 45:PlaybackPerfVP9.854p.24fps@1.25X | 46:PlaybackPerfVP9.854p.24fps@1.5X | 47:PlaybackPerfVP9.854p.24fps@1.75X | 48:PlaybackPerfVP9.854p.24fps@2X |
| MSE Codec Tests | |||
| 01:AppendOpusAudio | 02:AbortOpusAudio | 03:TimestampOffsetOpusAudio | 04:DurationAfterAppendOpusAudio |
| 05:PausedStateWithOpusAudio | 06:IncrementalOpusAudio | 07:LimitedOpusAudio | 08:IncrementalLimitedOpusAudio |
| 09:HighBitRateIncrementalLimitedOpusAudio | 10:AppendOpusAudioOffset | 11:AppendMultipleInitOpusAudio | 12:AppendOpusAudioOutOfOrder |
| 13:BufferedRangeOpusAudio | 14:OpusAudioWithOverlap | 15:OpusAudioWithSmallGap | 16:OpusAudioWithLargeGap |
| 17:DelayedOpusAudio | 18:PlaybackOnlyOpusAudio | 19:PlaybackOnlyAC3Audio | 20:PlaybackOnlyEAC3Audio |
| 21:AppendAACAudio | 22:AbortAACAudio | 23:TimestampOffsetAACAudio | 24:DurationAfterAppendAACAudio |
| 25:PausedStateWithAACAudio | 26:IncrementalAACAudio | 28:IncrementalLimitedAACAudio | 29:HighBitRateIncrementalLimitedAACAudio |
| 30:AppendAACAudioOffset | 31:AppendMultipleInitAACAudio | 32:AppendAACAudioOutOfOrder | 33:BufferedRangeAACAudio |
| 34:AACAudioWithOverlap | 35:AACAudioWithSmallGap | 36:AACAudioWithLargeGap | 37:DelayedAACAudio |
| 38:PlaybackOnlyAACAudio | 39:AppendVP9Video | 40:AbortVP9Video | 41:TimestampOffsetVP9Video |
| 42:DASHLatencyVP9 | 43:DurationAfterAppendVP9Video | 44:PausedStateWithVP9Video | 45:VideoDimensionVP9 |
| 46:PlaybackStateVP9 | 47:PlayPartialVP9Segment | 48:AppendVP9VideoOffset | 49:AppendMultipleInitVP9Video |
| 50:AppendVP9VideoOutOfOrder | 51:BufferedRangeVP9Video | 52:MediaSourceDurationVP9 | 53:VP9VideoWithOverlap |
| 54:VP9VideoWithSmallGap | 55:VP9VideoWithLargeGap | 56:SeekVP9 | 57:LoopVP9 |
| 58:LoopAfterEndedVP9 | 59:LoopAfterEndedNoSeekVP9 | 60:BufUnbufSeekVP9 | 61:DelayedVP9Video |
| 62:PlaybackOnlyVP9Video | 63:AppendH264Video | 64:AbortH264Video | 65:TimestampOffsetH264Video |
| 66:DASHLatencyH264 | 67:DurationAfterAppendH264Video | 68:PausedStateWithH264Video | 69:VideoDimensionH264 |
| 70:PlaybackStateH264 | 71:PlayPartialH264Segment | 72:AppendH264VideoOffset | 73:AppendMultipleInitH264Video |
| 74:AppendH264VideoOutOfOrder | 75:BufferedRangeH264Video | 76:MediaSourceDurationH264 | 77:H264VideoWithOverlap |
| 78:H264VideoWithSmallGap | 79:H264VideoWithLargeGap | 80:SeekH264 | 81:LoopH264 |
| 82:LoopAfterEndedH264 | 83:LoopAfterEndedNoSeekH264 | 84:BufUnbufSeekH264 | 85:DelayedH264Video |
| 86:PlaybackOnlyH264Video | 87:AppendAV1Video | 88:AbortAV1Video | 89:TimestampOffsetAV1Video |
| 90:DASHLatencyAV1 | 91:DurationAfterAppendAV1Video | 92:PausedStateWithAV1Video | 93:VideoDimensionAV1 |
| 94:PlaybackStateAV1 | 95:PlayPartialAV1Segment | 96:AppendAV1VideoOffset | 97:AppendMultipleInitAV1Video |
| 98:AppendAV1VideoOutOfOrder | 99:BufferedRangeAV1Video | 100:MediaSourceDurationAV1 | 101:AV1VideoWithOverlap |
| 102:AV1VideoWithSmallGap | 103:AV1VideoWithLargeGap | 104:SeekAV1 | 105:BufUnbufSeekAV1 |
| MSE Conformance Tests | |||
| 01:InitialMediaDuration | 02:InitialMediaVideoWidth | 03:InitialMediaVideoHeight | 04:InitialMediaReadyState |
| 05:InitialMediaSrc | 06:InitialMediaCurrentSrc | 08:XHRAbort | 09:XHROpenState |
| 10:Presence | 11:Attach | 12:AddSourceBuffer | 13:AddSBException |
| 14:RemoveSourceBuffer | 15:InitialMSDuration | 16:InitialMSReadyState | 17:Duration |
| 18:MediaElementEvents | 19:MediaSourceEvents | 20:VideoBufferSize | 21:VideoBufferSpeed |
| 22:StartPlayWithoutData | 24:StartPlayAtTimeGt0H264+AAC | 25:StartPlayAtTimeGt0VP9+Opus | 26:EventTimestamp |
| 27:SeekTimeUpdate | 28:AppendWindowStart | 29:AppendWindowEnd | 39:SFRAccuracy |
| 40:HFRAccuracy | 41:SFRSpecAccuracy | 42:HFRSpecAccuracy | 44:SFRPausedAccuracy100ms |
| 46:HFRPausedAccuracy100ms | 47:AACSupport | 48:H264Support | 49:VP9Support |
| 50:OpusSupport | 51:AV1Support | 52:H264FrameGaps | 53:H264FrameOverlaps |
| 54:HE-AAC/ExplicitSBR | 55:HE-AAC/ImplicitSBR | ||
| Progressive Tests | |||
| 01:src | 02:currentSrc | 03:defaultPlaybackRate | 04:playbackRate |
| 05:duration | 06:paused | 07:seeking | 08:ended |
| 09:videoWidth | 10:videoHeight | 11:buffered.length | 12:played.length |
| 13:seekable.length | 14:networkState | 15:readyState | 16:networkState |
| 17:readyState | 18:src | 19:networkState | 20:readyState |
| 21:currentSrc | 22:onprogress | 23:ontimeupdate | 24:canplay |
| 25:autoplay | 26:networkState | 27:paused | 28:onwaiting |
| 29:maxGranularityPlaybackRate0.25 | 30:maxGranularityPlaybackRate0.50 | 31:maxGranularityPlaybackRate1.00 | 32:maxGranularityPlaybackRate1.25 |
| 33:maxGranularityPlaybackRate1.50 | 34:maxGranularityPlaybackRate2.00 | 35:minGranularityPlaybackRate0.25 | 36:minGranularityPlaybackRate0.50 |
| 37:minGranularityPlaybackRate1.00 | 38:minGranularityPlaybackRate1.25 | 39:minGranularityPlaybackRate1.50 | 40:minGranularityPlaybackRate2.00 |
| 42:progressing | 43:progressing | 44:duration | 45:PlaybackRate0.25 |
| 46:PlaybackRate0.50 | 47:PlaybackRate1.00 | 48:PlaybackRate1.25 | 49:PlaybackRate1.50 |
| 50:PlaybackRate2.00 | 51:PlaybackRate0.75 | 52:PlaybackRate1.75 | |
| EME Conformance Tests | |||
| 01:WidevineH264Video | 02:WidevineAACAudio | 03:WidevineOpusAudio | 04:WidevineVP9Video |
| 05:WidevineVP9SubsampleVideo | 07:WidevineLicenseDelayH264Video | 08:WidevineLicenseDelayVP9Video | 09:setServerCertificate |
| 10:PlayreadyH264Video | 11:PlayreadyAACAudio | 12:EncryptedEventData | 17:H264VideoCenc |
| 18:H264VideoUnsetScheme | 19:H264VideoInvalidScheme | 20:VP9VideoCenc | 21:VP9VideoUnsetScheme |
| 23:VP9VideoInvalidScheme | 26:AV1VideoInvalidScheme | 27:AACAudioCenc | 28:AACAudioUnsetScheme |
| 30:AACAudioInvalidScheme | 31:OpusAudioCenc | 32:OpusAudioUnsetScheme | 33:OpusAudioInvalidScheme |
| 36:H264VideoCencAACAudioCenc | 37:VP9VideoCencOpusAudioCenc | ||
NPLB Results - Llama
| Failures | |
| Test Suite | Test Case |
|---|---|
| FatalCrash | 01:FatalCrash |
| Skipped Tests | |
| Test Suite | Test Case |
|---|---|
| No tests skipped | |
| Excluded NPLB Llama Tests | ||||
| NPLB Llama | ||||
|---|---|---|---|---|
| Posix* | .* | |||
| SbAudioSinkCreateTest | N/A | |||
| SbAudioSinkTest | N/A | |||
| SbDrmSessionTest | N/A | |||
| SbMediaSetAudioWriteDurationTests | N/A | |||
| SbDrmTest | N/A | |||
| SbPlayerTests | N/A | |||
| SbSocketWaiterWakeUpTest | N/A | |||
| SbMediaBufferTest | N/A | |||
| MultiplePlayerTests | N/A | |||
| SbSocketResolveTest | N/A | |||
| SbSocketAddressTypes | N/A | |||
| SbPlayerWriteSampleTests | N/A | |||
| SbPlayerGetAudioConfigurationTests | N/A | |||
| VerticalVideoTests | N/A | |||
| SbOnceTest | N/A | |||
| None | N/A | |||
| SbSocketJoinMulticastGroupTest | N/A | |||
| SbStorageGetRecordSizeTest | N/A | |||
| SbStorageReadRecordTest | N/A | |||
| SbStorageWriteRecordTest | N/A | |||
| SbSystemGetLocaleIdTest | N/A | |||
| SbSystemGetPathTest | N/A | |||
| SbSystemGetPropertyTest | N/A | |||
| SbMediaCanPlayMimeAndKeySystem | N/A | |||
| SbSystemGetStackTest | N/A | |||
| SbSystemSymbolizeTest | N/A | |||
Overview
Community Forums
Content Tools
Tasks