RDK Resources
[*RDK Preferred*]
Code Management Facility
RDK Forums
[RDK Conferences]
RDK Support
Archives
Papers & Presentations Archive
This manual describes the up-gradation of Yocto tools, the default build system used in RDK Video, from morty(2.2) to dunfell(3.1). In addition to upgrades to opensource packages, Yocto 3.1 also contain Long term Support release feature. The current version lacks the variety of features available in the dunfell.
The upgraded build tools will be used to generate wpe-westeros-image for Raspberrypi reference platform. WPE integrated with westeros provides us better video experience with smoothness and enhances browser responsiveness. Westeros is a replacement of Weston targeting towards embedded systems.
Yocto 3.1 Upgradation support the following:
Each component in RDK is a standalone repository with its own individual build tools producing a library or set of binaries. When we upgrade the OE layers to the newer versions, we need to make necessary changes in the RDK layers which use these components, to avoid build failures.
The OpenEmbedded build system should be able to run on Ubuntu 18.04 distribution/other compatible linux distribution with the following versions for Git, tar, and Python.
Note: You should also have about 50 Gbytes of free disk space for building images.
The essential packages you need for a supported Ubuntu or Debian distribution are shown in the following command:
$ sudo apt-get install gawk wget git-core diffstat unzip texinfo gcc-multilib \ build-essential chrpath socat cpio python python3 python3-pip python3-pexpect \ xz-utils debianutils iputils-ping python3-git python3-jinja2 libegl1-mesa libsdl1.2-dev \ pylint3 xterm
In order to use Yocto build system, the repo tool must be properly installed on the machine.
To install Repo make sure you have a /bin directory in your home directory and that it is included in your path
$ mkdir ~/bin $ PATH=~/bin:$PATH Download the repo tool and ensure that it is executable $ curl http://commondatastorage.googleapis.com/git-repo-downloads/repo > ~/bin/repo $ chmod a+x ~/bin/repo
Note: it is also recommended to put credentials in .netrc when interacting with repo.
A sample .netrc file is illustrated below
machine code.rdkcentral.com login YOUR_USERNAME password YOUR_PASSWORD
To tackle the build issues from moving one version to another, we have decided to split the problem into different subtasks. So instead of building a complete image at one go, we have planned for the generation of following images:
These images need to be tested against different configurations in cmf, to ensure that nothing has broken the existing system.
In order to provide a smooth transition without disturbing the existing branch, we have created a branch called `yocto-dunfell-upgrade` for non-OE layers and another branch called `rdk/yocto-dunfell-upgrade` for OE layers.
Right now we are in the process of resolving build/parse errors. The main source for errors can be classified into 4 categories.
--> Incompatible license with RDK.
--> Trying to apply older patches into newer version of recipes.
--> Recipe version changes due to dependency.
--> If there is a license upgrade to a new recipe which is not compaitable with RDK terms then we need to stick to the older version.
Some of the build errors and its root cause is described in the below table. We will keep updating the table as we encounter more errors.
recipe | layer | error/warning | root cause | action |
---|---|---|---|---|
N/A | N/A | Layer should set LAYERSERIES_COMPAT in its conf/layer.conf file to list the core layer names it is compatible with. | Newer version of bitbake throws warning if we don’t set LAYERSERIES_COMPAT in its conf/layer.conf in the respective layers. | Set LAYERSERIES_COMPAT_<layer name> = "dunfell" in all layers. E.g LAYERSERIES_COMPAT_rdk = "dunfell" for meta-rdk layer. |
N/A | meta-rdk-ext | bb.data_smart.ExpansionError: Failure expanding variable AVAILABLE_LICENSES[:=], expression was ${@' '.join(available_licenses(d))} which triggered exception FileNotFoundError: [Errno 2] No such file or directory. | There is no directory called licenses in the corresponding meta layer. | Need to create a licenses directory under the meta-layer and add RDK license file to it |
N/A | meta-rdk-restricted meta-rdk-video meta-rdk-ext meta-rdk-containers meta-rdk | Error due to the usage of base_contains in multiple recipes. | base_contains is deprecated. | use bb.utils.contains instead of deprecated base_contains in the respective recipes. |
N/A | N/A | Error due to the usage of some of the functions in pythonnative.bbclass in multiple recipes. | pythonnative.bbclass is not available in newer version. | Add meta-python2 layer to get support for legacy pyhton code(E.g pythonnative.bbclass) |
meta-rdk meta-rdk-ext | Error due to the usage of base_conditional in multiple recipes. | base_conditional is deprecated. | use oe.utils.conditional instead of deprecated base_conditional in the respective recipes. | |
uclibc.inc | meta-rdk-ext | Error due to the usage of oe_filter_out in multiple recipes. | oe_filter_out is deprecated. | use oe.utils.str_filter_out instead of deprecated oe_filter_out in the respective recipes. |
gssdp_0.14.10.bb | meta-rdk-ext | Could not include required file recipes-connectivity/gupnp/gssdp.inc in gssdp_0.14.10.bb | The required file is not present in the location. | Replace "require" directive to "include" to specify a loose dependency. |
rdk-generic-broadband-dev-image.bb | meta-rdk | Errors due to required files not being present in yocto 3.1(dunfell) oe layers. | Those file are not available in newer version of Yocto. | Replace "require" directive to "include" to specify a loose dependency. |
rmfhalheaders_git.bb | meta-rdk-video | Error while parsing LIC_FILES_CHKSUM in rmfhalheaders | The recipe uses "files://" instead "file://" in LIC_FILES_CHKSUM field | Update the LIC_FILES_CHKSUM field accordingly. |
Currently, all the changes are being pushed in these branches. Once it is merged, you will be able to follow the build instructions without any error.
To build, follow below instructions
$ mkdir <workspace dir> $ cd <workspace dir> $ repo init -u https://code.rdkcentral.com/r/manifests -b yocto-dunfell-upgrade -m rdkv-asp-nosrc.xml $ repo sync -j4 --no-clone-bundle $ source meta-rdk/setup-environment (Select option raspberrypi-rdk-mc.conf) $ bitbake wpe-westeros-image
Following command can be used to flash the RPI image to sd card using linux machine . dd tool should be available in linux
sudo dd if=<path to ImageName.rpi-sdimg> of=<path to SD card space> bs=4M Example: $ sudo dd if=wpe-westeros-image-raspberrypi-rdk.rpi-sdimg of=/dev/sdb bs=4M
https://www.balena.io/etcher/ can be used to flash RPI image in sd card using windows