• English
  • 3.9.0

    • X86 Simulation

    The toolchain supports application development capabilities in an X86 simulation environment, allowing you to quickly complete program debugging and verify computational results in the simulation environment when using a development board is not convenient.

    C++ Inference

    Develop validation code using the UCP inference interface, which supports inference of quantized.bc model and hbm model. The UCP simulation library interface is fully consistent with the embedded interface, except for using different compilation configurations. For an example of how to use the UCP inference interface, please refer to Model Inference Application Development Guide.

    Command-Line Tool

    Use the X86 version of the hrt_model_exec tool to view model information and perform single-frame inference, supporting inference of quantized.bc model and hbm model. For a detailed introduction and usage examples of hrt_model_exec, please refer to The hrt_model_exec Tool Introduction.

    Python Inference

    • Use the HBRuntime interface encapsulated by the horizon_tc_ui package, which supports inference of quantized.bc model and hbm model. For inference examples, please refer to The HBRuntime Inference Library.

    • Use the hbdk API inference interface, which supports inference of quantized.bc model and hbm model. For a detailed introduction and usage examples of the API, please refer to HBDK Tool API Reference.

    Note

    • The J6 toolchain supports hbm instruction simulation on the X86 side, but the efficiency is low. Therefore, it is more recommended to use the quantized.bc model for inference, as its fixed-point part is identical to the hbm binary values. The floating-point part may have architectural differences, but the impact on accuracy is usually negligible.

    • Prior to performing inference on an hbm model in an x86 simulation environment using the UCP inference interface or the hrt_model_exec tool, the HB_UCP_SIM_PLATFORM_TYPE environment variable must be set to specify the target BPU architecture to be simulated. For detailed instructions on configuring this environment variable, please refer to Environment Variable.

    • When performing inference on quantized.bc using the UCP simulation library, GPU acceleration is supported. For configuration details, please refer to HBIR Model Inference Instructions.