RDK6MAIN-211 rdk6-main with cherrypicked changes https://code.rdkcentral.com/r/q/topic:rdk6main-webkit2381-thunder42-yt24

Platform changes for 6.1

https://code.rdkcentral.com/r/c/components/generic/rdk-oe/meta-cmf-video/+/97066
https://code.rdkcentral.com/r/c/components/generic/rdk-oe/meta-cmf-video/+/96623 -need to merge to rdk-next then rdk6-main (rdk6main-webkit2381-thunder42-yt24) 


WebKit 2.38.1 results :

   Procedure :Enable WebkitBrowser Plugin from the controller UI <deviceIP:9998> and enter the above URL and tested the videos

Player – Asset TestsObservation on BCM-R4 &WPE-2.38.1(03Jan24 - Local Build)
Shaka player

#1:Big Buck Bunny [DASH, MP4 and WEBM)

Played
#2:Big Buck Bunny [HLS & MP4 ) played
#3: Angel One(multicodec, multilingual) played
#4: Angel One( Widevine, multicodec, multilingual) played
#110: Dash - Clear (2s segments)played
#111: Hls - Clear (Fragmented MP4 & 2s segments)Not played
#112: Dash PlayreadyNot played
#113: HLS - Multi-Track (HLS, Clear & Multi-Track)played
#114: MP4 - Clear (MP4 only)played
DashJS player
#1:Big Buck Bunny [DASH, MP4 and WEBM)played
#3: Angel One(multicodec, multilingual) played
#4: Angel One( Widevine, multicodec, multilingual) played
#110: Dash - Clear (2s segments)played
#112: Dash PlayreadyNot played (Observed Blank screen)
HLSJS player
#2:Big Buck Bunny [HLS & MP4 ) Played
#111: Hls - Clear (Fragmented MP4 & 2s segments)Played
#113: HLS - Multi-Track (HLS, Clear & Multi-Track)Played
AAMP
#1:Big Buck Bunny [DASH, MP4 and WEBM)played
#2:Big Buck Bunny [HLS & MP4 ) played
#3: Angel One(multicodec, multilingual) played
#110: Dash - Clear (2s segments)played
#111: Hls - Clear (Fragmented MP4 & 2s segments)played
#113: HLS - Multi-Track (HLS, Clear & Multi-Track)played
#114: MP4 - Clear (MP4 only)Not played
HTML5
#1:Big Buck Bunny [DASH, MP4 and WEBM)played
#2:Big Buck Bunny [HLS & MP4 ) played
#3: Angel One(multicodec, multilingual) played
#110: Dash - Clear (2s segments)played
#111: Hls - Clear (Fragmented MP4 & 2s segments)played
#113: HLS - Multi-Track (HLS, Clear & Multi-Track)played
#114: MP4 - Clear (MP4 only)played

Note : > Tested the Features video row on the media player

> Progress bar is not moving & Player Stats is blank for HTML5 media player videos.

> Trickmode doesn't works in HTML5


Apps Testing:

AppsObservation on BCM-R4 & WPE-2.38.1(03Jan24 - Local Build)
Amazon Prime VideoN/A
YouTubeWorking
PeacockN/A
XumoWorking
CNNWorking
WeatherNetworkBlank screen
EuroNewsWorking
AccuWeatherWorking
AljazeeraWorking
GuessThatCityWorking
RadiolineWorking
WallStreetJournalError while video playback 
FRacerWorking
AquariumWorking
FireplaceWorking
Deutsche WelleWorking
MyTuner RadioWorking
SudokuWorking
TastemadeWorking
BloombergWorking
PlayworksWorking
SunriseWorking

WEBAUDIO TEST RESULTS

https://webbrowsertools.com/audio-test/

  • Verified on webkit Browser plug-in. Followed the steps in BCM72180-821 - Getting issue details... STATUS

TDK Test scripts for Validating WPE Browser

[RDKVREL-99 WPE Browser upgradation to 2.38 - Broadcom Reference Platform- AC3 criteria should be met by TDK.]

Browser Performance Tests
The Browser performance test suite is used for getting the browser score using different test tools like CSS3, Octane etc. The browser test URL will be loaded in to device using the RDKService apis and fetch the score with the help of web inspect page. The device must provide the web inspect page for the device browser, to perform this suite. The framework is internally using the selenium with Python for parsing the data from browser.

Scripts used:
RDKV_CERT_PVS_Browser_HTML5 - PASS
The HTML5 test score is an indication of how well your browser supports the HTML5 standard and related specifications. It also gives individual scores for tests like video/audio/streaming etc.

TDK Results

Browser score from HTML5 test: 414 out of 555 points
Threshold value for browser performance main score: 300
The browser performance main score is high as expected
RDKV_CERT_PVS_Browser_HTML5 ::: Browser score from test ::: 300 ::: 414


RDKV_CERT_PVS_Browser_CSS3 - PASS
CSS3 test offers a quick and easy way to test and compare browser support for CSS3. The test checks for almost everything which includes Backgrounds and Borders/Image Values and Replaced Content/Selectors/Media Queries/Basic User Interface,Transitions/Animations etc.

TDK Results

The Browser score using CSS3 test is : 55%
Threshold value for browser performance main score: 50
The browser performance main score is high as expected

RDKV_CERT_PVS_Browser_Octane - FAIL - BCM72180-827
Octane 2.0 is a benchmark that measures a JavaScript engine’s performance by running a suite of tests representative of certain use cases in JavaScript applications. Octane 2.0 consists of 17 tests which includes OS kernel simulation benchmark/DeltaBlue/Raytrace etc.

TDK Results

Threshold value for browser performance main score: 1000
The browser performance main score is high as expected
Subcategory Splay score:2184 is less than the threshold value:2800
Subcategory SplayLatency score:3609 is less than the threshold value:4000

The overall browser performance is lower than expected 


RDKV_CERT_PVS_Browser_SunSpider - NA
SunSpider is a benchmark created by the webkit team that aims to measure JavaScript performance on tasks relevant to the current and near future use of JavaScript in the real world, such as encryption and text manipulation. The suite further attempts to be balanced and statistically sound. The sunspider Url is not deprecated. So marked this script as NA.

TDK Results

 Test not executed. Reason : Box Type mismatch.
Device Box Type : Video_Accelerator, Script supported Box Types :[null] 


RDKV_CERT_PVS_Browser_Strike_720_resolution - Script is failing due to TDK Setup Issue
RDKV_CERT_PVS_Browser_Strike_1080_resolution - Script is failing due to TDK Setup Issue
Strike is a benchmarking tool that runs on a web browser and performs the following tasks:

  • Measure to what extent your software stack is compatible with running Lightning applications.
  • Measure how well your software and hardware stack can perform Lightning applications.
  • Test the graphical capabilities of your software and hardware configuration.
  • Measure the capabilities of the web browser in which Strike is executed.
  • Provide a total score to your software and hardware configuration.

RDKV_CERT_PVS_Browser_Animation_FPS - PASS
Animation benchmark test will load bubbles animation to browser and it will display the FPS value based on browser capability, The script will take the FPS value displayed.

Browser score from test: 12.07
Threshold value for browser score: 7
The browser performance score is high as expected


RDKV_CERT_PVS_Browser_Speedometer - PASS
Speedometer is a browser benchmark that measures the responsiveness of Web applications. It uses demo web applications to simulate user actions such as adding to-do items.

Browser score from test: 10.9
Threshold value for browser score: 3
The browser performance score is high as expected


RDKV_CERT_PVS_Browser_MotionMark - Script is failing due to TDK Setup Issue
MotionMark is a graphics benchmark that measures a browser’s capability to animate complex scenes at a target frame rate.

RDKV_CERT_PVS_Browser_SmashCat - NA
Smash Cat is Canvas Performance Test. No external libs used. This does NOT use WebGL

Test not executed. Reason : Box Type mismatch.
Device Box Type : Video_Accelerator, Script supported Box Types :[null]


RDKV_CERT_PVS_Browser_Kraken - Script is failing due to TDK Setup Issue
Kraken is a JavaScript performance benchmark created by Mozilla that measures the speed of several different test cases extracted from real-world applications and libraries.

References:


           HTML Spec Compliance:
           https://html5test.com/

           WebKit 2.38 result :  URL is loading but Results are not Displayed - BCM-R4_WPE-2.38.1

        

YT Automated test suite:  https://ytlr-cert.appspot.com/latest/main.html#1652453525576

Specifically below categories.

  1. Functional Tests
  2. MSE
  3. EME
  4. Format Support Tests


WebKit 2.38 results :

Oops, it seems that you need to place a table or a macro generating a table within the Table Filter macro.

TestsObservation on BCM-R4 &wpe-2.38.1(03Jan24 - Local Build)
Functional Tests
1-22 failed
47-48 failed
64-66 failed
68-93 failed
95 failed
97 failed
99-100 failed
104 failed
MSE Codec tests
1-2 failed
52 failed
76 failed
100 failed
MSE Conformance Tests30-38 Failed
EME Conformance Tests
13-16 failed
24-25 failed
34-35 failed
39-84 failed
Format Support Tests  
3 failed
7-13 failed
40 failed 
72 failed 
99 failed 
111 failed

Please find attached Sanity Test Results - BCM-Sanity-Results-rdk6-main.xlsx

Issue Observed on Thunder4.2 WPE2.38 Builds

Jira TIcketSummaryCLStatus

BCM72180-897

Webaudio Support for WPE2.38https://code.rdkcentral.com/r/c/rdk/components/generic/rdk-oe/meta-rdk-voice/+/96991

BCM72180-856

Restarting of ResidentApp is taking to Startup screen/User on-boarding screen on Thunder4.2 build

BCM72180-858

Clear cookies and App data in Settings screen shows Error on Thunder4.2 builds

BCM72180-860

OGG audio codec is not working
Resolved 

BCM72180-826

Alexa webaudio :Tell me a Jokehttps://code.rdkcentral.com/r/c/rdk/components/generic/rdk-oe/meta-rdk-voice/+/96991
BCM72180-898RDKV_CERT_PVS_Browser_Octane TDK script is failing with WPE2.38

SGMM393-981Featured VOD playback is not working

SGMM393-975Volume+/- not working from Keyboard or BT remote on Thunder4.2 buildshttps://code.rdkcentral.com/r/c/collaboration/oem/sagemcom/yocto_oe/layers/meta-rdk-oem-sagemcom-m393genac/+/97519 Ready for Testing
SGMM393-974Home key is not working to exit the Appshttps://code.rdkcentral.com/r/c/collaboration/oem/sagemcom/yocto_oe/layers/meta-rdk-oem-sagemcom-m393genac/+/96793Ready for Testing
BCM72180-899

Bluetooth pairing is required on every reboot (Lima & Tatlow) on Thunder4.2 Images



BCM72180-859YouTube Sign-in persist even after Factory Reset of the Device

BCM72180-917HLS 4k & VP8 codec video playback is not working

BCM72180-918BT Voice remote device info is not displayed under Voice Remote Control (Lima & Tatlow)





  • No labels

DISCLAIMER: Please note that the use of the RDK Wiki is subject to its Privacy Policy & Terms of Use. In addition, this Wiki may be accessed by all RDK licensees and their contractors.