Model Modification and HBIR Model Compilation

To pursue ultimate performance in those scenarios with enormous input size, the quantization and conversion of some inputs and outputs can be fused into data pre-processing. At this point you can choose to remove these nodes by using the hb_compile tool, the tool supports also the compilation of HBIR models at the same time.

Usage

How To Use:

hb_compile --config ${config_file} \
           --model ${model.bc} 

Parameters Introduction

PARAMETERDESCRIPTION
-h, --helpShow help information and exit.
-c, --config

Configuration file for the model compilation, in YAML format.

  • For removing nodes, the march, remove_node_type or remove_node_name parameters need to be specified correctly in the config file.
  • For compiling the HBIR model, the march parameter needs to be specified correctly in the config file.

The configuration of the parameters in the yaml file can be found in section Specific Parameter Information.

-m, --model The model to be modified, which suffix needs to be .bc .