RDK6MAIN-211 rdk6-main with cherrypicked changes https://code.rdkcentral.com/r/q/topic:rdk6main-webkit2381-thunder42-yt24
https://code.rdkcentral.com/r/c/components/generic/rdk-oe/meta-cmf-video/+/97066
https://code.rdkcentral.com/r/c/components/generic/rdk-oe/meta-cmf-video/+/96623 -need to merge to rdk-next then rdk6-main (rdk6main-webkit2381-thunder42-yt24)
CPE Test utility Tool:
URL : https://cpetestutility.stb.r53.xcal.tv/CPETool/app/#Home
WebKit 2.38.1 results :
Procedure :Enable WebkitBrowser Plugin from the controller UI <deviceIP:9998> and enter the above URL and tested the videos
|
Note : > Tested the Features video row on the media player
> Progress bar is not moving & Player Stats is blank for HTML5 media player videos.
> Trickmode doesn't works in HTML5
Apps Testing:
Apps | Observation on BCM-R4 & WPE-2.38.1(03Jan24 - Local Build) |
Amazon Prime Video | N/A |
YouTube | Working |
Peacock | N/A |
Xumo | Working |
CNN | Working |
WeatherNetwork | Blank screen |
EuroNews | Working |
AccuWeather | Working |
Aljazeera | Working |
GuessThatCity | Working |
Radioline | Working |
WallStreetJournal | Error while video playback |
FRacer | Working |
Aquarium | Working |
Fireplace | Working |
Deutsche Welle | Working |
MyTuner Radio | Working |
Sudoku | Working |
Tastemade | Working |
Bloomberg | Working |
Playworks | Working |
Sunrise | Working |
WEBAUDIO TEST RESULTS
https://webbrowsertools.com/audio-test/
Browser Performance Tests
The Browser performance test suite is used for getting the browser score using different test tools like CSS3, Octane etc. The browser test URL will be loaded in to device using the RDKService apis and fetch the score with the help of web inspect page. The device must provide the web inspect page for the device browser, to perform this suite. The framework is internally using the selenium with Python for parsing the data from browser.
Scripts used:
RDKV_CERT_PVS_Browser_HTML5 - PASS
The HTML5 test score is an indication of how well your browser supports the HTML5 standard and related specifications. It also gives individual scores for tests like video/audio/streaming etc.
TDK Results
Browser score from HTML5 test: 414 out of 555 points |
---|
RDKV_CERT_PVS_Browser_CSS3 - PASS
CSS3 test offers a quick and easy way to test and compare browser support for CSS3. The test checks for almost everything which includes Backgrounds and Borders/Image Values and Replaced Content/Selectors/Media Queries/Basic User Interface,Transitions/Animations etc.
TDK Results
The Browser score using CSS3 test is : 55% |
---|
RDKV_CERT_PVS_Browser_Octane - FAIL - BCM72180-827
Octane 2.0 is a benchmark that measures a JavaScript engine’s performance by running a suite of tests representative of certain use cases in JavaScript applications. Octane 2.0 consists of 17 tests which includes OS kernel simulation benchmark/DeltaBlue/Raytrace etc.
TDK Results
Threshold value for browser performance main score: 1000 |
---|
RDKV_CERT_PVS_Browser_SunSpider - NA
SunSpider is a benchmark created by the webkit team that aims to measure JavaScript performance on tasks relevant to the current and near future use of JavaScript in the real world, such as encryption and text manipulation. The suite further attempts to be balanced and statistically sound. The sunspider Url is not deprecated. So marked this script as NA.
TDK Results
Test not executed. Reason : Box Type mismatch. Device Box Type : Video_Accelerator, Script supported Box Types :[null] |
---|
RDKV_CERT_PVS_Browser_Strike_720_resolution - Script is failing due to TDK Setup Issue
RDKV_CERT_PVS_Browser_Strike_1080_resolution - Script is failing due to TDK Setup Issue
Strike is a benchmarking tool that runs on a web browser and performs the following tasks:
RDKV_CERT_PVS_Browser_Animation_FPS - PASS
Animation benchmark test will load bubbles animation to browser and it will display the FPS value based on browser capability, The script will take the FPS value displayed.
Browser score from test: 12.07 |
---|
RDKV_CERT_PVS_Browser_Speedometer - PASS
Speedometer is a browser benchmark that measures the responsiveness of Web applications. It uses demo web applications to simulate user actions such as adding to-do items.
Browser score from test: 10.9 |
---|
RDKV_CERT_PVS_Browser_MotionMark - Script is failing due to TDK Setup Issue
MotionMark is a graphics benchmark that measures a browser’s capability to animate complex scenes at a target frame rate.
RDKV_CERT_PVS_Browser_SmashCat - NA
Smash Cat is Canvas Performance Test. No external libs used. This does NOT use WebGL
Test not executed. Reason : Box Type mismatch. Device Box Type : Video_Accelerator, Script supported Box Types :[null] |
---|
RDKV_CERT_PVS_Browser_Kraken - Script is failing due to TDK Setup Issue
Kraken is a JavaScript performance benchmark created by Mozilla that measures the speed of several different test cases extracted from real-world applications and libraries.
UVE/QAM feature in RPi Validation tests for WPE browser on Sagemcom and Broadcom
HTML Spec Compliance:
https://html5test.com/
WebKit 2.38 result : URL is loading but Results are not Displayed - BCM-R4_WPE-2.38.1
YT Automated test suite: https://ytlr-cert.appspot.com/latest/main.html#1652453525576
Specifically below categories.
WebKit 2.38 results :
|
Please find attached Sanity Test Results - BCM-Sanity-Results-rdk6-main.xlsx
Issue Observed on Thunder4.2 WPE2.38 Builds
Jira TIcket | Summary | CL | Status |
---|---|---|---|
Webaudio Support for WPE2.38 | https://code.rdkcentral.com/r/c/rdk/components/generic/rdk-oe/meta-rdk-voice/+/96991 | ||
Restarting of ResidentApp is taking to Startup screen/User on-boarding screen on Thunder4.2 build | |||
Clear cookies and App data in Settings screen shows Error on Thunder4.2 builds | |||
OGG audio codec is not working | Resolved | ||
Alexa webaudio :Tell me a Joke | https://code.rdkcentral.com/r/c/rdk/components/generic/rdk-oe/meta-rdk-voice/+/96991 | ||
BCM72180-898 | RDKV_CERT_PVS_Browser_Octane TDK script is failing with WPE2.38 | ||
SGMM393-981 | Featured VOD playback is not working | ||
SGMM393-975 | Volume+/- not working from Keyboard or BT remote on Thunder4.2 builds | https://code.rdkcentral.com/r/c/collaboration/oem/sagemcom/yocto_oe/layers/meta-rdk-oem-sagemcom-m393genac/+/97519 | Ready for Testing |
SGMM393-974 | Home key is not working to exit the Apps | https://code.rdkcentral.com/r/c/collaboration/oem/sagemcom/yocto_oe/layers/meta-rdk-oem-sagemcom-m393genac/+/96793 | Ready for Testing |
BCM72180-899 | Bluetooth pairing is required on every reboot (Lima & Tatlow) on Thunder4.2 Images | ||
BCM72180-859 | YouTube Sign-in persist even after Factory Reset of the Device | ||
BCM72180-917 | HLS 4k & VP8 codec video playback is not working | ||
BCM72180-918 | BT Voice remote device info is not displayed under Voice Remote Control (Lima & Tatlow) |