You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 20 Next »

Summary Table

rialto Commit ID: e5f67a1c90218948ce93d1c5c2f5442022212ae9
rialto-gstreamer Commit ID: a200eb6d86ebacd2fd5d926172c948ca1b7ba9f4
rialto-ocdm Commit ID: 53c8ad448cc91e9c73b563561d95a7012770af09
L1 Tests
Unit Tests Passed
Component Tests Passed
YT Conformance Tests (v. 20240325)
Devices AV1 SFR Tests H264 SFR Tests HFR Tests VP9 SFR Tests MSE Codec Tests MSE Conformance Tests Progressive Tests EME Conformance Tests
Flex2 22/2233/3347/4732/32104/10442/4251/5126/26
XioneUK No files were found! Due to a crash!
Llama No files were found! Due to a crash!
NPLB Tests
DevicesTests
Flex21228/1230
XioneUKXioneUKNPLBValue
LlamaLlamaNPLBValue
Links
DevicesYTCertNPLB
Flex2https://pv-jen015.uk2.scp.bskyb.com/job/AI/job/AI_BUILDS/job/Flex2-Builds/job/CI_AI_RIALTO_YT_CERT_TEST_FLEX2/750https://pv-jen015.uk2.scp.bskyb.com/job/AI/job/AI_BUILDS/job/Flex2-Builds/job/CI_AI_RIALTO_NPLB_TEST_FLEX2_UK_GS/656
XioneUKXioneUKYTCertLinkXioneUKNPLBLink
LlamaLlamaYTCertLinkLlamaNPLBLink

Flex2 Results

YTCert Results - Flex2

AV1 SFR Tests
01:TotalVideoFrames02:FrameDrop03:PlaybackPerfAV1.144p.30fps@1X04:PlaybackPerfAV1.240p.30fps@1X
05:PlaybackPerfAV1.360p.30fps@1X06:PlaybackPerfAV1.480p.30fps@1X07:PlaybackPerfAV1.720p.30fps@0.25X08:PlaybackPerfAV1.720p.30fps@0.5X
09:PlaybackPerfAV1.720p.30fps@0.75X10:PlaybackPerfAV1.720p.30fps@1X11:PlaybackPerfAV1.720p.30fps@1.25X12:PlaybackPerfAV1.720p.30fps@1.5X
13:PlaybackPerfAV1.720p.30fps@1.75X14:PlaybackPerfAV1.720p.30fps@2X15:PlaybackPerfAV1.1080p.30fps@0.25X16:PlaybackPerfAV1.1080p.30fps@0.5X
17:PlaybackPerfAV1.1080p.30fps@0.75X18:PlaybackPerfAV1.1080p.30fps@1X19:PlaybackPerfAV1.1080p.30fps@1.25X20:PlaybackPerfAV1.1080p.30fps@1.5X
21:PlaybackPerfAV1.1080p.30fps@1.75X22:PlaybackPerfAV1.1080p.30fps@2X
H264 SFR Tests
01:TotalVideoFrames02:FrameDrop03:PlaybackPerfH264.144p.15fps@1X04:PlaybackPerfH264.240p.30fps@1X
05:PlaybackPerfH264.360p.30fps@1X06:PlaybackPerfH264.480p.30fps@1X07:PlaybackPerfH264.720p.30fps@0.25X08:PlaybackPerfH264.720p.30fps@0.5X
09:PlaybackPerfH264.720p.30fps@0.75X10:PlaybackPerfH264.720p.30fps@1X11:PlaybackPerfH264.720p.30fps@1.25X12:PlaybackPerfH264.720p.30fps@1.5X
13:PlaybackPerfH264.720p.30fps@1.75X14:PlaybackPerfH264.720p.30fps@2X15:PlaybackPerfH264.1080p.30fps@0.25X16:PlaybackPerfH264.1080p.30fps@0.5X
17:PlaybackPerfH264.1080p.30fps@0.75X18:PlaybackPerfH264.1080p.30fps@1X19:PlaybackPerfH264.1080p.30fps@1.25X20:PlaybackPerfH264.1080p.30fps@1.5X
21:PlaybackPerfH264.1080p.30fps@1.75X22:PlaybackPerfH264.1080p.30fps@2X39:PlaybackPerfH264.426p.24fps@1X40:PlaybackPerfH264.640p.24fps@1X
41:PlaybackPerfH264.854p.24fps@0.25X42:PlaybackPerfH264.854p.24fps@0.5X43:PlaybackPerfH264.854p.24fps@0.75X44:PlaybackPerfH264.854p.24fps@1X
45:PlaybackPerfH264.854p.24fps@1.25X46:PlaybackPerfH264.854p.24fps@1.5X47:PlaybackPerfH264.854p.24fps@1.75X48:PlaybackPerfH264.854p.24fps@2X
65:PlaybackPerfH264.256p.24fps@1X
HFR Tests
01:TotalVideoFrames02:FrameDrop03:PlaybackPerfVP9.720p.60fps@0.25X04:PlaybackPerfVP9.720p.60fps@0.5X
05:PlaybackPerfVP9.720p.60fps@0.75X07:PlaybackPerfVP9.720p.60fps@1.25X08:PlaybackPerfVP9.720p.60fps@1.5X09:PlaybackPerfVP9.720p.60fps@1.75X
10:PlaybackPerfVP9.720p.60fps@2X11:PlaybackPerfVP9.1080p.60fps@0.25X12:PlaybackPerfVP9.1080p.60fps@0.5X13:PlaybackPerfVP9.1080p.60fps@0.75X
15:PlaybackPerfVP9.1080p.60fps@1.25X16:PlaybackPerfVP9.1080p.60fps@1.5X17:PlaybackPerfVP9.1080p.60fps@1.75X18:PlaybackPerfVP9.1080p.60fps@2X
35:PlaybackPerfH264.720p.60fps@0.25X36:PlaybackPerfH264.720p.60fps@0.5X37:PlaybackPerfH264.720p.60fps@0.75X38:PlaybackPerfH264.720p.60fps@1X
39:PlaybackPerfH264.720p.60fps@1.25X40:PlaybackPerfH264.720p.60fps@1.5X41:PlaybackPerfH264.720p.60fps@1.75X42:PlaybackPerfH264.720p.60fps@2X
43:PlaybackPerfH264.1080p.60fps@0.25X44:PlaybackPerfH264.1080p.60fps@0.5X45:PlaybackPerfH264.1080p.60fps@0.75X46:PlaybackPerfH264.1080p.60fps@1X
47:PlaybackPerfH264.1080p.60fps@1.25X48:PlaybackPerfH264.1080p.60fps@1.5X49:PlaybackPerfH264.1080p.60fps@1.75X50:PlaybackPerfH264.1080p.60fps@2X
51:PlaybackPerfAV1.720p.60fps@0.25X52:PlaybackPerfAV1.720p.60fps@0.5X53:PlaybackPerfAV1.720p.60fps@0.75X55:PlaybackPerfAV1.720p.60fps@1.25X
56:PlaybackPerfAV1.720p.60fps@1.5X57:PlaybackPerfAV1.720p.60fps@1.75X58:PlaybackPerfAV1.720p.60fps@2X59:PlaybackPerfAV1.1080p.60fps@0.25X
60:PlaybackPerfAV1.1080p.60fps@0.5X61:PlaybackPerfAV1.1080p.60fps@0.75X62:PlaybackPerfAV1.1080p.60fps@1X63:PlaybackPerfAV1.1080p.60fps@1.25X
64:PlaybackPerfAV1.1080p.60fps@1.5X65:PlaybackPerfAV1.1080p.60fps@1.75X66:PlaybackPerfAV1.1080p.60fps@2X
VP9 SFR Tests
01:TotalVideoFrames02:FrameDrop03:PlaybackPerfVP9.144p.30fps@1X04:PlaybackPerfVP9.240p.30fps@1X
05:PlaybackPerfVP9.360p.30fps@1X06:PlaybackPerfVP9.480p.30fps@1X07:PlaybackPerfVP9.720p.30fps@0.25X08:PlaybackPerfVP9.720p.30fps@0.5X
09:PlaybackPerfVP9.720p.30fps@0.75X10:PlaybackPerfVP9.720p.30fps@1X11:PlaybackPerfVP9.720p.30fps@1.25X12:PlaybackPerfVP9.720p.30fps@1.5X
13:PlaybackPerfVP9.720p.30fps@1.75X14:PlaybackPerfVP9.720p.30fps@2X15:PlaybackPerfVP9.1080p.30fps@0.25X16:PlaybackPerfVP9.1080p.30fps@0.5X
17:PlaybackPerfVP9.1080p.30fps@0.75X18:PlaybackPerfVP9.1080p.30fps@1X19:PlaybackPerfVP9.1080p.30fps@1.25X20:PlaybackPerfVP9.1080p.30fps@1.5X
21:PlaybackPerfVP9.1080p.30fps@1.75X22:PlaybackPerfVP9.1080p.30fps@2X39:PlaybackPerfVP9.426p.24fps@1X40:PlaybackPerfVP9.640p.24fps@1X
41:PlaybackPerfVP9.854p.24fps@0.25X42:PlaybackPerfVP9.854p.24fps@0.5X43:PlaybackPerfVP9.854p.24fps@0.75X44:PlaybackPerfVP9.854p.24fps@1X
45:PlaybackPerfVP9.854p.24fps@1.25X46:PlaybackPerfVP9.854p.24fps@1.5X47:PlaybackPerfVP9.854p.24fps@1.75X48:PlaybackPerfVP9.854p.24fps@2X
MSE Codec Tests
01:AppendOpusAudio02:AbortOpusAudio03:TimestampOffsetOpusAudio04:DurationAfterAppendOpusAudio
05:PausedStateWithOpusAudio06:IncrementalOpusAudio07:LimitedOpusAudio08:IncrementalLimitedOpusAudio
09:HighBitRateIncrementalLimitedOpusAudio10:AppendOpusAudioOffset11:AppendMultipleInitOpusAudio12:AppendOpusAudioOutOfOrder
13:BufferedRangeOpusAudio14:OpusAudioWithOverlap15:OpusAudioWithSmallGap16:OpusAudioWithLargeGap
17:DelayedOpusAudio18:PlaybackOnlyOpusAudio19:PlaybackOnlyAC3Audio20:PlaybackOnlyEAC3Audio
21:AppendAACAudio22:AbortAACAudio23:TimestampOffsetAACAudio24:DurationAfterAppendAACAudio
25:PausedStateWithAACAudio26:IncrementalAACAudio28:IncrementalLimitedAACAudio29:HighBitRateIncrementalLimitedAACAudio
30:AppendAACAudioOffset31:AppendMultipleInitAACAudio32:AppendAACAudioOutOfOrder33:BufferedRangeAACAudio
34:AACAudioWithOverlap35:AACAudioWithSmallGap36:AACAudioWithLargeGap37:DelayedAACAudio
38:PlaybackOnlyAACAudio39:AppendVP9Video40:AbortVP9Video41:TimestampOffsetVP9Video
42:DASHLatencyVP943:DurationAfterAppendVP9Video44:PausedStateWithVP9Video45:VideoDimensionVP9
46:PlaybackStateVP947:PlayPartialVP9Segment48:AppendVP9VideoOffset49:AppendMultipleInitVP9Video
50:AppendVP9VideoOutOfOrder51:BufferedRangeVP9Video52:MediaSourceDurationVP953:VP9VideoWithOverlap
54:VP9VideoWithSmallGap55:VP9VideoWithLargeGap56:SeekVP957:LoopVP9
58:LoopAfterEndedVP959:LoopAfterEndedNoSeekVP960:BufUnbufSeekVP961:DelayedVP9Video
62:PlaybackOnlyVP9Video63:AppendH264Video64:AbortH264Video65:TimestampOffsetH264Video
66:DASHLatencyH26467:DurationAfterAppendH264Video68:PausedStateWithH264Video69:VideoDimensionH264
70:PlaybackStateH26471:PlayPartialH264Segment72:AppendH264VideoOffset73:AppendMultipleInitH264Video
74:AppendH264VideoOutOfOrder75:BufferedRangeH264Video76:MediaSourceDurationH26477:H264VideoWithOverlap
78:H264VideoWithSmallGap79:H264VideoWithLargeGap80:SeekH26481:LoopH264
82:LoopAfterEndedH26483:LoopAfterEndedNoSeekH26484:BufUnbufSeekH26485:DelayedH264Video
86:PlaybackOnlyH264Video87:AppendAV1Video88:AbortAV1Video89:TimestampOffsetAV1Video
90:DASHLatencyAV191:DurationAfterAppendAV1Video92:PausedStateWithAV1Video93:VideoDimensionAV1
94:PlaybackStateAV195:PlayPartialAV1Segment96:AppendAV1VideoOffset97:AppendMultipleInitAV1Video
98:AppendAV1VideoOutOfOrder99:BufferedRangeAV1Video100:MediaSourceDurationAV1101:AV1VideoWithOverlap
102:AV1VideoWithSmallGap103:AV1VideoWithLargeGap104:SeekAV1105:BufUnbufSeekAV1
MSE Conformance Tests
01:InitialMediaDuration02:InitialMediaVideoWidth03:InitialMediaVideoHeight04:InitialMediaReadyState
05:InitialMediaSrc06:InitialMediaCurrentSrc08:XHRAbort09:XHROpenState
10:Presence11:Attach12:AddSourceBuffer13:AddSBException
14:RemoveSourceBuffer15:InitialMSDuration16:InitialMSReadyState17:Duration
18:MediaElementEvents19:MediaSourceEvents20:VideoBufferSize21:VideoBufferSpeed
22:StartPlayWithoutData24:StartPlayAtTimeGt0H264+AAC25:StartPlayAtTimeGt0VP9+Opus26:EventTimestamp
27:SeekTimeUpdate28:AppendWindowStart29:AppendWindowEnd39:SFRAccuracy
40:HFRAccuracy41:SFRSpecAccuracy42:HFRSpecAccuracy44:SFRPausedAccuracy100ms
46:HFRPausedAccuracy100ms47:AACSupport48:H264Support49:VP9Support
50:OpusSupport51:AV1Support52:H264FrameGaps53:H264FrameOverlaps
54:HE-AAC/ExplicitSBR55:HE-AAC/ImplicitSBR
Progressive Tests
01:src02:currentSrc03:defaultPlaybackRate04:playbackRate
05:duration06:paused07:seeking08:ended
09:videoWidth10:videoHeight11:buffered.length12:played.length
13:seekable.length14:networkState15:readyState16:networkState
17:readyState18:src19:networkState20:readyState
21:currentSrc22:onprogress23:ontimeupdate24:canplay
25:autoplay26:networkState27:paused28:onwaiting
29:maxGranularityPlaybackRate0.2530:maxGranularityPlaybackRate0.5031:maxGranularityPlaybackRate1.0032:maxGranularityPlaybackRate1.25
33:maxGranularityPlaybackRate1.5034:maxGranularityPlaybackRate2.0035:minGranularityPlaybackRate0.2536:minGranularityPlaybackRate0.50
37:minGranularityPlaybackRate1.0038:minGranularityPlaybackRate1.2539:minGranularityPlaybackRate1.5040:minGranularityPlaybackRate2.00
42:progressing43:progressing44:duration45:PlaybackRate0.25
46:PlaybackRate0.5047:PlaybackRate1.0048:PlaybackRate1.2549:PlaybackRate1.50
50:PlaybackRate2.0051:PlaybackRate0.7552:PlaybackRate1.75
EME Conformance Tests
01:WidevineH264Video02:WidevineAACAudio03:WidevineOpusAudio04:WidevineVP9Video
05:WidevineVP9SubsampleVideo07:WidevineLicenseDelayH264Video08:WidevineLicenseDelayVP9Video09:setServerCertificate
10:PlayreadyH264Video11:PlayreadyAACAudio12:EncryptedEventData17:H264VideoCenc
18:H264VideoUnsetScheme19:H264VideoInvalidScheme20:VP9VideoCenc21:VP9VideoUnsetScheme
23:VP9VideoInvalidScheme26:AV1VideoInvalidScheme27:AACAudioCenc28:AACAudioUnsetScheme
30:AACAudioInvalidScheme31:OpusAudioCenc32:OpusAudioUnsetScheme33:OpusAudioInvalidScheme
36:H264VideoCencAACAudioCenc37:VP9VideoCencOpusAudioCenc

NPLB Results - Flex2

Failures
Test Suite Test Case
MultiplePlayerTests/MultiplePlayerTest WriteSamples/audio0_beneath_the_canopy_aac_stereo_dmp_video0_sintel_399_av1_dmp_output_punch_out_key_system_com_youtube_playready
SbPlayerWriteSampleTests/SbPlayerWriteSampleTest WriteMultipleBatches/audio_beneath_the_canopy_opus_mono_dmp_video_null_output_punch_out_key_system_com_youtube_playready
Skipped Tests
Test Suite Test Case
No tests skipped
Excluded NPLB Flex2 Tests
NPLB Flex2
SbPlayerTests /SbPlayerTest.MultiPlayer*
SbSocketAddressTypes /SbSocketGetInterfaceAddressTest.SunnyDaySourceForDestination/type_ipv6
SbPlayerWriteSampleTests /SbPlayerWriteSampleTest.SecondaryPlayerTest/audio_*, SbPlayerWriteSampleTest.DiscardAllAudio/audio_*
SbMediaSetAudioWriteDurationTests N/A
SbPlayerGetAudioConfigurationTests N/A
SbOnceTest N/A
VerticalVideoTests N/A
SbSocketJoinMulticastGroupTest N/A
SbStorageGetRecordSizeTest N/A
SbStorageReadRecordTest N/A
SbStorageWriteRecordTest N/A
SbSystemGetLocaleIdTest N/A
SbSystemGetPathTest N/A
SbSystemGetPropertyTest N/A
SbMediaCanPlayMimeAndKeySystem N/A
SbSystemGetStackTest N/A
SbSystemSymbolizeTest N/A
_______________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
  • No labels