Introduction

The custom operator development module provides an interface for you to use the programmable hardware resources provided by the development board to further meet your diverse operator needs. The current programmable backend includes Cadence Vision Q8 DSP, Mali A78 GPU。

The development of DSP is mainly divided into two steps:

  1. Use the tools and materials provided by Cadence to complete the operator development;

  2. Register the operator through the API provided by UCP and complete the deployment on the development board.

Its functional architecture is shown in the figure below:

P1architecture1

In the above architecture diagram, the DSP custom operator application generates the task handle of the corresponding operator through the interface provided by the custom module, registers the DSP operator to the DSP image to perform the compilation and deployment. UCP provides a service including modules such as task scheduling, session management, and engine management. After the task handle of the corresponding operator is generated, the operator task is submitted to the task queue through the UCP task scheduling interface and assigned to the DSP underlying hardware to implement the functional logic of the operator.

GPU development uses the native OpenCL interface, and its functional architecture is shown in the following figure:

P1architecture1