Work In Progress


Scope:

           This guide will help RDK-B community to port OneWifi on their platforms


Target Audience:

           RDK-B Software Architects and Engineers

Prerequisites:

TBD

Supported platforms:

  1.       Raspberry Pi4 64 bit
  2.       Raspberry Pi4 32 bit

Supported yocto version:

  1. Dunfell
  2. Kirkstone(supported from rdkb2023q4 official release)

High level architecture:

The internal functional entities of the OneWifi process are as shown in the above diagram. OneWifi software architecture is essentially a multi-threaded software architecture, the three main threads are 

  • Core thread: this thread is the fundamental engine of the process that is responsible for all configuration of WiFi parameters, command/control/status response and WiFi state indications. The core thread is also responsible for steering related activities.
  • DML thread: this thread handles the TR-181 set/get handlers. 
  • Apps thread: this thread is responsible for supporting all WiFi related application/features such as harvester, motion sensing, blaster, single client measurements etc.

The software architecture of working of each thread is detailed below.


OneWiFi Thread Management, Inter Thread Communication and Data Handling

The diagram below depicts thread management and inter thread communication and data transfer in OneWifi. Threads essentially wait for condition and timeouts. If data needs to be processed, the data is posted into queue and the thread is signaled. The thread retrieves the data from the queue and processes the data

Core Functional Blocks/Subsystem


The core thread waits for events or messages, if there are events or messages in the FIFO queue, the thread retrieves the events or messages one after another and takes appropriate action. Three kinds of messages or events can be enqueued in the Core thread queue

  1. South bound messages received from WebConfig Agent or Ovsdb Managervia RBUS callback.
  2. South bound messages received from DML thread because of TR-181 set handler invocation
  3. North bound asynchronous Wi-Fi events from HAL or driver isuch as
    1. Client associations/disassociations
    2. VAP or interface Up/Down
    3. Registered 802.11mgmt frame reception
    4. Band Steering events

All south bound messages are decoded, parsed and validated by core thread. In case, the messages are successfully validated, the core thread uses Wi-Fi HAL function to configure Wi-Fi driver or baseband accordingly. if successful, core thread is also resonsible for updating the persistent database so that in case of reboot or power failure, the Wi-Fi subsystem of the CPE device maintain previous operating configuration. Core thread also handles Wi-Fi or Factory reset commands that may be triggered by messages enqueued by DML thread or during initialization sequence.

All north bound events are translated to state update in ovddb state tables using WebConfig encoded messages sent by core to ovsdb manager.


Core Thread Software Architecture


Some of the components described are as follows:

  • Config Tracker - serves as an internal database for all Radio and VAP attributes. To be consumed by OneWifi internals, eg. stats policies, steering policies, configuration applicator, etc. Intended to be acting as a south bound interface and called by adapters to integrate them into specific systems, eg. rbus+webconfig.
  • State Tracker - serves as a layer to shield OneWifi business logic modules from HAL API which is intended to not be fully object oriented.and to simplify its implementation, eg. event buffer overrun recovery handling, event order sanitization (sometimes implementations source events from multiple streams and their processing ordering is undefined).
  • Configuration Applicator - uses inputs: Config Tracker and other mutators (coming from, eg. Stats or Steering policies) to generate configuration command(s) and submit them only if the assembled configuration command is out-of-sync with what State Tracker is reporting. Configuration Applicator is triggered for recompute by either Config Tracker, State Tracker or any of the registered mutators.
  • Steering/Stats/Other policies - multiple entities implementing specific actions. Mostly interact with State Tracker, Configuration Applicator (as mutators), HAL wrapper (to perform world-visible actions) or between each other modules (Steering modules using some Stats).
  • Rbus-webconfig adapter - adaptation logic which feeds Config Tracker based on Webconfig blobs. Essentially a translator to abstract Webconfig away from core logic. Foo thread / foo adapter - approach recommended on integrating other existing, or thread-heavy tasks. The OneWifi core is a single thread expecting no other threads interacting directly with its data structures or control flows, so adapters and their dispatch handlers are expected to be the entry/exit points between threads to simplify locking.
  • HAL wrapper - virtually a HAL API that allows multiple backing implementations: Wifi HAL, Target API or other in the future. Intended to be mostly stateless and simple "pass through" - allowing out-of-order event delivery, etc. This allows simpler implementation for vendors. The task of sanitizing is handed to State Tracker for actual business logic consumers. The HAL wrapper API is highly aggregated (big blob call for configuration, singular calls for adequate actions like WPS PBC) with hints on which attributes are out-of-sync allowing implementations to optimize if desired. The wrapper is also capable of supporting multiple backing implementations at the same time (without requiring business logic implementation to be aware of any of that) to accommodate mixed vendor chips (on non-Wifi-Hal platforms) such as Broadcom + Quantenna.

All components are intended to schedule most of the actual work through separate dispatch handlers per object entities. This allows easy batching (to debounce and reduce ping-pong), time occupancy (to provide insight into possible stalls, or aid scheduling), forces idempotency (avoids some ab/ba logic issues, provides failure recovery procedures without additional explicit logic) and makes sure memory resource allocation is bound.


Operational Modes

OneWifi can operate in two modes, router and extender. 

Router Mode

In router mode, the stack broadcasts front haul virtual access points that client devices may connect with. Total of seven such virtual access points are created on each radio and provide different kinds of services. 

Extender Mode

TBD


Flow Diagram/Pseudo Code

Core Thread Pseudo Codecore_thread_start_functionrbus_register(rbus_message_cb)read_wifi_ps_dbwifi_hal_initwifi_hal_events_register(wifi_hal_cb)wifi_hal_setRadioOperatingParamswifi_hal_createVAPfor_each_radiorbus_event(web_config_message)decode_messagevalidate_msg() eq SUCCESSyesnorbus_send_to_webconfig(ACK)rbus_send_to_webconfig(NACK)wifi_hal_func() eq SUCCESS(HAL Wrapper)yesnowrite_wifi_ps_dbrbus_send_to_webconfig(SUCCESS)rbus_send_to_webconfig(FAILURE)validate_msg() eq SUCCESSyesnorbus_send_to_ovsdbmgr(ACK)rbus_send_to_ovsdbmgr(NACK)wifi_hal_func() eq SUCCESS(HAL Wrapper)yesnowrite_wifi_ps_dbrbus_send_to_ovsdbmgr(SUCCESS)rbus_send_to_ovsdbmgr(FAILURE)msg eq webconfig_msgyesmsg eq ovdsbmgr_msgyesdml_event(web_config_message)decode_messagewrite_wifi_ps_dbyeswifi_hal_func() eq SUCCESSyesvalidate_msg() eq SUCCESShal_event(hal_cb_event)create_ovsdb_state_blob)rbus_send_to_ovsdbmgr(json_blob)create_ovsdb_state_blob)rbus_send_to_ovsdbmgr(json_blob)create_ovsdb_state_blob)rbus_send_to_ovsdbmgr(json_blob)create_ovsdb_state_blob)rbus_send_to_ovsdbmgr(json_blob)handle_bm_probehandle_bm_client_connecthandle_bm_client_disconnecthandle_bm_rssi_xingbsal_event eq bsal_event_probe_reqyesbsal_event eq bsal_event_client_connectyesbsal_event eq bsal_event_client_disconnectyesbsal_event eq bsal_event_rssi_xingyesevent eq assoc_eventyesevent eq disassoc_eventyesevent eq vap_up_eventyesevent eq vap_down_eventyesevent eq bsal_eventyestimeoutstats_collectionevent_queue_waitcore_thread_endrbus_message_cbcreate_rbus_eventevent_queue_push(rbus_event)wifi_hal_cbcreate_hal_eventevent_queue_push(hal_event)

Message Sequence Diagrams

InitializationCore ThreadWiFi HAL WrapperhostapWiFi DriverLinux Systemctrl-planewifi_initInterfaces Enumerationnl_80211cmd(NL80211_CMD_GET_WIPHY, NLM_F_DUMP, wiphy_dump_handler)wiphy_dump_handler(NL80211_ATTR_WIPHY = 0, NL80211_ATTR_WIPHY_NAME, NL80211_ATTR_SUPPORTED_COMMANDS)wiphy_dump_handler(NL80211_ATTR_WIPHY = 1, NL80211_ATTR_WIPHY_NAME, NL80211_ATTR_SUPPORTED_COMMANDS)wiphy_dump_handler(NL80211_ATTR_WIPHY = 2, NL80211_ATTR_WIPHY_NAME, NL80211_ATTR_SUPPORTED_COMMANDS)for each InterfaceHAL -> LINUX: nl_80211cmd(NL80211_CMD_GET_WIPHY, NL80211_ATTR_WIPHY = i, wiphy_get_info_handler)wiphy_get_info_handler(NL80211_ATTR_CIPHER_SUITES, NL80211_ATTR_WIPHY_BANDS)for each band in NL80211_ATTR_WIPHY_BANDSphy_info_frequenciesphy_info_ht_capaphy_info_vht_capaphy_info_rateseloop_initeap_server_register_methodsSuccesswifi_getHalCapabilityget phy device capabilitiesSuccessfor each Radiowifi_setRadioOperatingParameters(index, radio_param)set radio parametersupdate_hostap_config_params (update struct hostapd_config for this radio)Successwifi_createVAP(radio, vap_map)for each VAPcreate interfacevap_mode_apnl80211_cmd(NL80211_CMD_SET_INTERFACE, NL80211_IFTYPE_AP)update_hostap_data (update struct hostapd_data for this interface)update_hostap_bss (update struct hostapd_bss_config for this interface)update_hostap_iface (update struct hostapd_iface for this interface)setup_driver(wpa_drv_ops)drv_inithostapd_setup_bss(hostapd_data)flushwifi_drv_flushsta_deauthwifi_drv_sta_deauthset_keywifi_drv_set_keyset_apwifi_drv_set_apset_operstatenl80211_register_mgmt_frames(NL80211_CMD_FRAME, process_mgmt_frame)bridge_rx(raw socket listen)vap_mode_stanl80211_cmd(NL80211_CMD_SET_INTERFACE, NL80211_IFTYPE_STA)nl80211_start_scan(NL80211_CMD_TRIGGER_SCAN)interface_rx(raw socket listen)Successwifi_runeloop_runeloop

Client AuthenticationWiFi HAL WrapperhostapWiFi DriverLinux SystemClient Deviceclient authentication (WPA2 and WPA3 handshakes)mlmeAuth Frameprocess_mgmt_frame(NL80211_ATTR_FRAME, frame = auth)wpa_supplicant_event(EVENT_RX_MGMT, event.frame = frame)send_mlme(auth)wifi_drv_send_mlme(auth)Auth FrameAssoc Req Frameprocess_mgmt_frame(NL80211_ATTR_FRAME, frame = assoc req)wpa_supplicant_event(EVENT_RX_MGMT, event.frame = assoc req)send_mlme(assoc resp)wifi_drv_send_mlme(assoc resp)Assoc Resp Framenl80211_event(NL80211_CMD_FRAME_TX_STATUS)wpa_supplicant_event(EVENT_TX_STATUS)non-mlmeAuth FrameAuth FrameAssoc Req FrameAssoc Resp Framenl80211_event(NL80211_CMD_NEW_STATION)wpa_supplicant_event(EVENT_TX_ASSOC)start 802.1x authenticationhapd_send_eapol(EAPOL 1/4)bridge_tx(EAPOL 1/4)EAPOL 1/4EAPOL 2/4bridge_rx (EAPOL 2/4)wpa_supplicant_event(EVENT_EAPOL_RX, event.frame = eapol)hapd_send_eapol(EAPOL 3/4)bridge_tx(EAPOL 3/4)EAPOL 3/4EAPOL 4/4bridge_rx (EAPOL 4/4)wpa_supplicant_event(EVENT_EAPOL_RX, event.frame = eapol)set_keywifi_drv_set_keyset_sta_flagswifi_drv_set_sta_flags

Epic details:

Approach followed:

  • Full Management frame approach(Highly recommended for SoC vendors,OEM's and Operators)
  • Event based approach(Only for Raspberry Pi4,Since there is no much support for full management from broadcom driver side we opted this approach.To continue using this approach,this should be discussed with Operators and RDK-B Architecture Review Board)

Step by step procedure:       

Include rdkb2023q2 release on top of SoC SDK.this is the recommended rdkb stable release for OneWifi (rdkb-2023q2-dunfell)

    



Integration segments:

Dependencies to build OneWifi


Systemd Service file:

    •    onewifi.service

Create platform layer for mediatek platform,please consider raspberry pi as reference


           Manifest entries:

    • Onewifi component entry in manifest file (OneWifi) and rdk-wifi-hal component entry in manifest (rdk-wifi-hal)

         

Layers to consider:

           1.meta-raspberrypi ( Or )meta-cmf-soc-<soc name>  ------- Firmware/drivers/kernel to be available

    • For proposing a new component,please create a bb file here

           2.meta-cmf-raspberrypi (Or) meta-cmf-<platformname> --------- RDK-B changes to specific to SOC platform 

    • All changes that need to be done for the primary recipe are handled in the form of bbappend 
    • Patches: Patches are recommended if the changes are very specific and tied with SOC platform code.

           3.meta-cmf-broadband ----------- RDK-B changes which are common for all RDK-B community members

    • All changes that need to be done for the primary recipe are handled in the form of bbappend
    • Patches: Patches are recommended if the changes are very specific and tied with SOC platform code.
    • All existing reference patches in Raspberry pi may not be applicable for real targets,Because of hardware limitation & functionality limitation we have added patches.


           Bug fixing or feature enhancement:

    • Bug fixing or feature enhancement done as part of OneWifi which are generic enough should come to OneWifi generic repo 

Flags defined in Onewifi:

    • Raspberry Pi has certain limitations on the driver side to support end to end use case of OneWifi and Build dependencies which are specific to comcast.to avoid such issues we have introduced a flag (_PLATFORM_RASPBERRYPI_) to keep it under conditional compilation.for Real targets we dont really need this flags

Bulk atomic HAL apis for common configuration


wifi_hal_sendDataFrame
wifi_hal_newApAssociatedDevice_callback_register
wifi_hal_apDeAuthEvent_callback_register
wifi_hal_apDisassociatedDevice_callback_register
wifi_hal_register_frame_hook
wifi_hal_disassoc
wifi_hal_send_mgmt_frame_response
wifi_hal_init
wifi_hal_getHalCapability
wifi_hal_setRadioOperatingParameters
wifi_hal_createVAP
wifi_hal_startScan
wifi_hal_connect
wifi_hal_get_default_country_code
wifi_hal_get_default_ssid
wifi_hal_get_default_keypassphrase
wifi_hal_get_default_wps_pin
wifi_hal_get_default_ssid
wifi_hal_get_default_radius_key
wifi_hal_setRadioOperatingParameters
wifi_hal_staConnectionStatus_callback_register
wifi_hal_scanResults_callback_register
wifi_hal_mgmt_frame_callbacks_register
wifi_hal_getRadioVapInfoMap
wifi_hal_delApAclDevice
wifi_hal_addApAclDevice
wifi_hal_kickAssociatedDevice
wifi_hal_setApWpsButtonPush
wifi_hal_setApWpsPin
wifi_hal_disconnect
wifi_hal_getRadioOperatingParameters
wifi_hal_getScanResults


Stats implementation:

      • This is vendor specific.we can use vendor based implementation from device specific HAL.pls refer this ticket for reference( REFPLTB-2510 - Getting issue details... STATUS )

wifi database:

      • rdkb-wifi.db

64 bit build support:

      • Comcast doesnt have 64 bit support in the current platforms.from RDK team side we have Raspberrypi 4 platform which support 64bit.we have supported Onewifi as part of this platform and fixed lot of alignment issues and warning treated as errors

Difference Between CcspWifiAgent and OneWiFi Apply settings

 CcspWifiAgent:

dmcli eRT setv Device.WiFi.Radio.2.X_CISCO_COM_ApplySetting bool true
dmcli eRT setv Device.WiFi.Radio.1.X_CISCO_COM_ApplySetting bool true 

  Onewifi

                       

#Any dmcli commands specific to SSID and AccessPoint execute the Below Access Point Related apply settings
dmcli eRT setv Device.WiFi.ApplyAccessPointSettings bool true

#Any dmcli executions specific to Radio level use the below Radio apply settings command
dmcli eRT setv Device.WiFi.ApplyRadioSettings bool true

Debugging tips:

                              

Below are the list of logs present in /rdklogs/logs for Debugging OneWiFi Issues.

For Additional in-depth Debugging one should enable below commands ,

        • touch /nvram/wifiMgrDbg
        • touch /nvram/wifiDbDbg
        • touch /nvram/wifiWebConfigDbg
        • touch /nvram/wifiHalDbg
        • touch /nvram/wifiCtrlDbg
        • touch /nvram/wifiMonDbg
        • touch /nvram/wifiDMCLI
        • touch /nvram/wifiLib
        • touch /nvram/wifiLibhostapDbg

check for the respective logs in /tmp,

        • tail -f wifiCtrl &
        • tail -f wifiHal &
        • tail -f wifiMgr &
        • tail -f wifiDMCLI &
        • tail -f wifiDb &

        • tail -f wifiWebConfig &
        • tail -f wifilibhostap &

Wi-Fi 7 segment:

                              Initial Headers: https://code.rdkcentral.com/r/plugins/gitiles/rdkb/components/opensource/ccsp/halinterface/+/490e08dc0edc9180a18c60eb4d6d3b0c85a1ebe3

                           Below things will be supported by Onewifi as part of Wi-Fi 7 which includes changes in onewifi ,rdk-wifi-hal & libhostap(for Wi-Fi 7 we use libhostap 2.11 version )

      1. 320 MHZ
      2. 4kQAM
      3. MLO

     

                        





  • No labels