2024-07-30

Summary Table

rialto	v1111
rialto-gstreamer	v2222
rialto-ocdm	v1111

L1 Tests
Unit Tests	Passed
Component Tests	Passed

YT Conformance Tests (v. 20240325)
Devices	AV1 SFR Tests	H264 SFR Tests	HFR Tests	VP9 SFR Tests	MSE Codec Tests	MSE Conformance Tests	Progressive Tests	EME Conformance Tests
Flex2	No results	No results	No results	No results	No results	No results	No results	3/5
XioneUK	No results	No results	No results	No results	No results	No results	No results	5/5
Llama	No Results - Crash Occurred!

NPLB Tests
Devices	Tests
Flex2	1301/1307
XioneUK	984/990
Llama	No Results - Crash Occurred!

Links
Devices	YTCert	NPLB
Flex2	https://pv-jen015.uk2.scp.bskyb.com/job/AI/job/AI_BUILDS/job/Flex2-Builds/job/CI_AI_RIALTO_YT_CERT_TEST_FLEX2/620	https://pv-jen015.uk2.scp.bskyb.com/job/AI/job/AI_BUILDS/job/Flex2-Builds/job/CI_AI_RIALTO_NPLB_TEST_FLEX2_UK_GS/544
XioneUK	https://pv-jen015.uk2.scp.bskyb.com/job/AI/job/AI_BUILDS/job/XiOne/job/CI_AI_RIALTO_YT_CERT_TEST_XIONE_UK/439	https://pv-jen015.uk2.scp.bskyb.com/job/AI/job/AI_BUILDS/job/XiOne/job/CI_AI_RIALTO_NPLB_TEST_XIONE_UK/414
Llama	https://pv-jen015.uk2.scp.bskyb.com/job/AI/job/AI_BUILDS/job/GLASS/job/CI_AI_RIALTO_YT_CERT_TEST_LLAMA/55	https://pv-jen015.uk2.scp.bskyb.com/job/AI/job/AI_BUILDS/job/GLASS/job/CI_AI_RIALTO_NPLB_TEST_LLAMA_UK/346

Flex2 Results

YTCert Results - Flex2

EME Conformance Tests
01:WidevineH264Video	02:WidevineAACAudio	03:WidevineOpusAudio	04:WidevineVP9Video
05:WidevineVP9SubsampleVideo

NPLB Results - Flex2

Failures
Test Suite	Test Case
SbSystemGetStackTest	SunnyDayStackDirection
SbSystemGetStackTest	SunnyDay
SbSystemGetStackTest	SunnyDayShortStack
SbSystemSymbolizeTest	SunnyDay
SbMediaSetAudioWriteDurationTests/SbMediaSetAudioWriteDurationTest	WriteLimitedInput/0
SbMediaSetAudioWriteDurationTests/SbMediaSetAudioWriteDurationTest	WriteLimitedInput/1

Skipped Tests
Test Suite	Test Case
No tests skipped

Excluded NPLB Flex2 Tests
	NPLB Flex2
SbPlayerTests	/SbPlayerTest.MultiPlayer*
SbSocketAddressTypes	/SbSocketGetInterfaceAddressTest.SunnyDaySourceForDestination/type_ipv6
SbMediaSetAudioWriteDurationTests	N/A
SbPlayerWriteSampleTests	N/A
SbPlayerGetAudioConfigurationTests	N/A
VerticalVideoTests	N/A
SbSocketJoinMulticastGroupTest	N/A
SbStorageGetRecordSizeTest	N/A
SbStorageReadRecordTest	N/A
SbStorageWriteRecordTest	N/A
SbSystemGetLocaleIdTest	N/A
SbSystemGetPathTest	N/A
SbSystemGetPropertyTest	N/A
SbMediaCanPlayMimeAndKeySystem	N/A

_______________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________

XioneUk Results

YTCert Results - XioneUk

EME Conformance Tests
01:WidevineH264Video	02:WidevineAACAudio	03:WidevineOpusAudio	04:WidevineVP9Video
05:WidevineVP9SubsampleVideo

NPLB Results - XioneUk

Failures
Test Suite	Test Case
SbSystemSymbolizeTest	SunnyDay
SbSystemGetStackTest	SunnyDayStackDirection
SbSystemGetStackTest	SunnyDay
SbSystemGetStackTest	SunnyDayShortStack
SbSocketAddressTypes/SbSocketGetInterfaceAddressTest	SunnyDayDestination/type_ipv6
SbSocketAddressTypes/SbSocketGetInterfaceAddressTest	SunnyDaySourceNotLoopback/type_ipv6

Skipped Tests
Test Suite	Test Case
No tests skipped

Excluded NPLB Xione Uk Tests
	NPLB Xione Uk
SbPlayerTests	N/A
SbSocketAddressTypes	/SbSocketGetInterfaceAddressTest.SunnyDaySourceForDestination/type_ipv6
SbMediaSetAudioWriteDurationTests	/SbMediaSetAudioWriteDurationTest.*
SbPlayerWriteSampleTests	/SbPlayerWriteSampleTest.WriteSingleBatch*, SbPlayerWriteSampleTest.WriteMultipleBatches*, SbPlayerWriteSampleTest.LimitedAudioInput*, SbPlayerWriteSampleTest.SecondaryPlayerTest*
SbPlayerGetAudioConfigurationTests	/SbPlayerGetAudioConfigurationTest.MultipleSeeks*
VerticalVideoTests	N/A
SbSocketJoinMulticastGroupTest	N/A
SbStorageGetRecordSizeTest	N/A
SbStorageReadRecordTest	N/A
SbStorageWriteRecordTest	N/A
SbSystemGetLocaleIdTest	N/A
SbSystemGetPathTest	N/A
SbSystemGetPropertyTest	N/A
SbMediaCanPlayMimeAndKeySystem	N/A

_______________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________

Llama Results

YTCert Results - Llama

FatalCrash
01:FatalCrash

NPLB Results - Llama

Failures
Test Suite	Test Case
FatalCrash	01:FatalCrash

Skipped Tests
Test Suite	Test Case
No tests skipped

Excluded NPLB Llama Tests
	NPLB Llama
SbPlayerTests	N/A
SbSocketAddressTypes	/SbSocketGetInterfaceAddressTest.SunnyDaySourceForDestination/type_ipv6
SbMediaSetAudioWriteDurationTests	N/A
SbPlayerWriteSampleTests	/SbPlayerWriteSampleTest.WriteSingleBatch*, SbPlayerWriteSampleTest.WriteMultipleBatches*, SbPlayerWriteSampleTest.LimitedAudioInput*, SbPlayerWriteSampleTest.SecondaryPlayerTest*
SbPlayerGetAudioConfigurationTests	/SbPlayerGetAudioConfigurationTest.MultipleSeeks*
VerticalVideoTests	/VerticalVideoTest.WriteSamples*
SbSocketJoinMulticastGroupTest	N/A
SbStorageGetRecordSizeTest	N/A
SbStorageReadRecordTest	N/A
SbStorageWriteRecordTest	N/A
SbSystemGetLocaleIdTest	N/A
SbSystemGetPathTest	N/A
SbSystemGetPropertyTest	N/A
SbMediaCanPlayMimeAndKeySystem	N/A

_______________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________