Interactive sensitivity report generated from
sensitivity(use_sensitivity_v2=True).
Total outputs: 2
Sensitive ops count: 19
prefixes: None
types: None
output_names: None
| op_name | op_type | fake_stub_type | dtype | flops | clip_ATOL | round_ATOL | qint8_ATOL | qint16_ATOL | qint8-qint16_ATOL | fp16_ATOL | tuned_cumulative_ATOL | cumulative_ATOL | clip_L1 | round_L1 | qint8_L1 | qint16_L1 | qint8-qint16_L1 | fp16_L1 | tuned_cumulative_L1 | cumulative_L1 | clip_COSINE | round_COSINE | qint8_COSINE | qint16_COSINE | qint8-qint16_COSINE | fp16_COSINE | tuned_cumulative_COSINE | cumulative_COSINE |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| conv | horizon_plugin_pytorch.nn.qat.conv2d.Conv2d | output | qint8 | 5184(98.18%) | 0.045126 | 0.066827 | 0.066827 | 0.000212 | 0.066616 | None | None | None | 0.005964 | 0.006708 | 0.006708 | 2.5e-05 | 0.006683 | None | None | None | 0.999816 | 0.999663 | 0.999663 | 1.0 | -0.000337 | None | None | None |
| conv | horizon_plugin_pytorch.nn.qat.conv2d.Conv2d | weight | qint8 | 5184(98.18%) | 0.0 | 0.011085 | 0.011085 | 8.3e-05 | 0.011002 | None | None | None | 0.0 | 0.000933 | 0.000933 | 7e-06 | 0.000926 | None | None | None | 1.0 | 0.999993 | 0.999993 | 1.0 | -7e-06 | None | None | None |
| quant | horizon_plugin_pytorch.nn.qat.stubs.QuantStub | output | qint8 | 0(0%) | 0.000243 | 0.008408 | 0.008408 | 4e-05 | 0.008368 | None | None | None | 1.5e-05 | 0.000799 | 0.000799 | 3e-06 | 0.000796 | None | None | None | 1.0 | 0.999996 | 0.999996 | 1.0 | -4e-06 | None | None | None |
| _generated_add_1 | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint8 | 0(0%) | 0.276776 | 0.004774 | 0.276776 | 0.271611 | 0.005164 | None | None | None | 0.00736 | 0.001418 | 0.008688 | 0.007149 | 0.001539 | None | None | None | 0.998345 | 0.999996 | 0.998358 | 0.998405 | -4.7e-05 | None | None | None |
| ln.bias_add | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint8 | 0(0%) | 0.003934 | 0.003805 | 0.003934 | 0.000111 | 0.003823 | None | None | None | 0.000419 | 0.001391 | 0.001399 | 1.2e-05 | 0.001388 | None | None | None | 0.999999 | 0.999996 | 0.999997 | 1.0 | -3e-06 | None | None | None |
| mm | horizon_plugin_pytorch.nn.qat.matmul.Matmul | output | qint8 | 96(1.82%) | 1.271384 | 0.04984 | 1.271384 | 1.27012 | 0.001264 | None | None | None | 0.047924 | 0.005359 | 0.053253 | 0.047917 | 0.005336 | None | None | None | 0.944378 | 0.999665 | 0.944001 | 0.944397 | -0.000396 | None | None | None |
| _generated_sigmoid_0.func | horizon_plugin_pytorch.nn.qat.segment_lut.SegmentLUT | output | qint8 | 0(0%) | 1e-06 | 1e-06 | 1e-06 | 1e-06 | 0.0 | None | None | None | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | None | None | None | 1.0 | 1.0 | 1.0 | 1.0 | 0.0 | None | None | None |
| add1 | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint8 | 0(0%) | 1e-06 | 1e-06 | 1e-06 | 1e-06 | 0.0 | None | None | None | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | None | None | None | 1.0 | 1.0 | 1.0 | 1.0 | 0.0 | None | None | None |
| add2 | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint8 | 0(0%) | 1e-06 | 1e-06 | 1e-06 | 1e-06 | 0.0 | None | None | None | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | None | None | None | 1.0 | 1.0 | 1.0 | 1.0 | 0.0 | None | None | None |
| _generated_add_0 | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 1e-06 | 0.001182 | None | 0.001182 | None | None | None | None | 0.0 | 8.5e-05 | None | 8.5e-05 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.bias_quant | horizon_plugin_pytorch.nn.qat.stubs.QuantStub | output | qint16 | 0(0%) | 1e-06 | 1e-06 | None | 1e-06 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.input_mean.mean | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 1.623541 | 0.000516 | None | 1.623541 | None | None | None | None | 0.05206 | 6e-05 | None | 0.052117 | None | None | None | None | 0.93603 | 1.0 | None | 0.93603 | None | None | None | None |
| ln.mul | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.295171 | 0.001943 | None | 0.29558 | None | None | None | None | 0.019647 | 0.000308 | None | 0.019954 | None | None | None | None | 0.996204 | 1.0 | None | 0.996207 | None | None | None | None |
| ln.out_mul | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.000107 | 1.4e-05 | None | 0.000111 | None | None | None | None | 8e-06 | 4e-06 | None | 1.2e-05 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.rsqrt.rsqrt | horizon_plugin_pytorch.nn.qat.segment_lut.SegmentLUT | output | qint16 | 0(0%) | 0.000596 | 0.000658 | None | 0.000999 | None | None | None | None | 2.5e-05 | 9.9e-05 | None | 0.000124 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.sub | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 9.9e-05 | 0.000281 | None | 0.000281 | None | None | None | None | 7e-06 | 2.8e-05 | None | 3.5e-05 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.var_mean.mean | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.295171 | 0.001943 | None | 0.29558 | None | None | None | None | 0.019672 | 0.000331 | None | 0.019977 | None | None | None | None | 0.996204 | 1.0 | None | 0.996206 | None | None | None | None |
| ln.weight_mul | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.000107 | 1.4e-05 | None | 0.000111 | None | None | None | None | 8e-06 | 4e-06 | None | 1.2e-05 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.weight_quant | horizon_plugin_pytorch.nn.qat.stubs.QuantStub | output | qint16 | 0(0%) | 1.5e-05 | 1.5e-05 | None | 1.5e-05 | None | None | None | None | 7e-06 | 7e-06 | None | 7e-06 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| quant_grid | horizon_plugin_pytorch.nn.qat.stubs.QuantStub | output | qint16 | 0(0%) | 1e-06 | 0.003021 | None | 0.003021 | None | None | None | None | 0.0 | 0.00018 | None | 0.00018 | None | None | None | None | 1.0 | 0.999999 | None | 0.999999 | None | None | None | None |
| op_name | op_type | fake_stub_type | dtype | flops | clip_ATOL | round_ATOL | qint8_ATOL | qint16_ATOL | qint8-qint16_ATOL | fp16_ATOL | tuned_cumulative_ATOL | cumulative_ATOL | clip_L1 | round_L1 | qint8_L1 | qint16_L1 | qint8-qint16_L1 | fp16_L1 | tuned_cumulative_L1 | cumulative_L1 | clip_COSINE | round_COSINE | qint8_COSINE | qint16_COSINE | qint8-qint16_COSINE | fp16_COSINE | tuned_cumulative_COSINE | cumulative_COSINE |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| conv | horizon_plugin_pytorch.nn.qat.conv2d.Conv2d | output | qint8 | 5184(98.18%) | 0.065727 | 0.116902 | 0.116902 | 0.000303 | 0.11662 | None | None | None | 0.010741 | 0.00964 | 0.00964 | 4e-05 | 0.0096 | None | None | None | 0.999697 | 0.999256 | 0.999256 | 1.0 | -0.000744 | None | None | None |
| conv | horizon_plugin_pytorch.nn.qat.conv2d.Conv2d | weight | qint8 | 5184(98.18%) | 1e-06 | 0.025426 | 0.025426 | 0.000215 | 0.02521 | None | None | None | 0.0 | 0.002084 | 0.002084 | 1.7e-05 | 0.002067 | None | None | None | 1.0 | 0.99998 | 0.99998 | 1.0 | -2e-05 | None | None | None |
| quant | horizon_plugin_pytorch.nn.qat.stubs.QuantStub | output | qint8 | 0(0%) | 0.000417 | 0.012966 | 0.012966 | 0.000101 | 0.012954 | None | None | None | 2.6e-05 | 0.00128 | 0.00128 | 7e-06 | 0.001273 | None | None | None | 1.0 | 0.999992 | 0.999992 | 1.0 | -8e-06 | None | None | None |
| _generated_add_1 | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint8 | 0(0%) | 0.384483 | 0.005021 | 0.384483 | 0.379319 | 0.005164 | None | None | None | 0.010094 | 0.002029 | 0.011147 | 0.009775 | 0.002104 | None | None | None | 0.996868 | 0.999995 | 0.9969 | 0.996956 | -5.6e-05 | None | None | None |
| ln.bias_add | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint8 | 0(0%) | 0.004092 | 0.003901 | 0.004092 | 0.000187 | 0.003905 | None | None | None | 0.00074 | 0.002143 | 0.002157 | 1.8e-05 | 0.002138 | None | None | None | 0.999999 | 0.999995 | 0.999997 | 1.0 | -3e-06 | None | None | None |
| mm | horizon_plugin_pytorch.nn.qat.matmul.Matmul | output | qint8 | 96(1.82%) | 1.379092 | 0.105448 | 1.379092 | 1.377828 | 0.001264 | None | None | None | 0.050251 | 0.010952 | 0.06113 | 0.050223 | 0.010908 | None | None | None | 0.931682 | 0.999052 | 0.930595 | 0.931713 | -0.001118 | None | None | None |
| _generated_sigmoid_0.func | horizon_plugin_pytorch.nn.qat.segment_lut.SegmentLUT | output | qint8 | 0(0%) | 2e-06 | 2e-06 | 2e-06 | 2e-06 | 0.0 | None | None | None | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | None | None | None | 1.0 | 1.0 | 1.0 | 1.0 | 0.0 | None | None | None |
| add1 | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint8 | 0(0%) | 2e-06 | 2e-06 | 2e-06 | 2e-06 | 0.0 | None | None | None | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | None | None | None | 1.0 | 1.0 | 1.0 | 1.0 | 0.0 | None | None | None |
| add2 | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint8 | 0(0%) | 2e-06 | 2e-06 | 2e-06 | 2e-06 | 0.0 | None | None | None | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | None | None | None | 1.0 | 1.0 | 1.0 | 1.0 | 0.0 | None | None | None |
| _generated_add_0 | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 2e-06 | 0.002428 | None | 0.002428 | None | None | None | None | 0.0 | 0.000142 | None | 0.000142 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.bias_quant | horizon_plugin_pytorch.nn.qat.stubs.QuantStub | output | qint16 | 0(0%) | 2e-06 | 2e-06 | None | 2e-06 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.input_mean.mean | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 1.800912 | 0.000803 | None | 1.800912 | None | None | None | None | 0.0795 | 8.7e-05 | None | 0.07958 | None | None | None | None | 0.928139 | 1.0 | None | 0.928139 | None | None | None | None |
| ln.mul | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.599686 | 0.002366 | None | 0.599686 | None | None | None | None | 0.033098 | 0.00048 | None | 0.033577 | None | None | None | None | 0.992237 | 0.999999 | None | 0.992253 | None | None | None | None |
| ln.out_mul | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.000187 | 1.4e-05 | None | 0.000187 | None | None | None | None | 1.4e-05 | 6e-06 | None | 1.8e-05 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.rsqrt.rsqrt | horizon_plugin_pytorch.nn.qat.segment_lut.SegmentLUT | output | qint16 | 0(0%) | 0.001787 | 0.000951 | None | 0.001787 | None | None | None | None | 7.4e-05 | 0.000188 | None | 0.000188 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.sub | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.000176 | 0.000605 | None | 0.000605 | None | None | None | None | 1.2e-05 | 5.6e-05 | None | 6.6e-05 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.var_mean.mean | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.599686 | 0.002366 | None | 0.599686 | None | None | None | None | 0.033098 | 0.00048 | None | 0.033577 | None | None | None | None | 0.992237 | 0.999999 | None | 0.992253 | None | None | None | None |
| ln.weight_mul | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.000187 | 1.4e-05 | None | 0.000187 | None | None | None | None | 1.4e-05 | 6e-06 | None | 1.8e-05 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.weight_quant | horizon_plugin_pytorch.nn.qat.stubs.QuantStub | output | qint16 | 0(0%) | 1.5e-05 | 1.6e-05 | None | 1.5e-05 | None | None | None | None | 1e-05 | 1.1e-05 | None | 1e-05 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| quant_grid | horizon_plugin_pytorch.nn.qat.stubs.QuantStub | output | qint16 | 0(0%) | 2e-06 | 0.008613 | None | 0.008613 | None | None | None | None | 0.0 | 0.000485 | None | 0.000485 | None | None | None | None | 1.0 | 0.999998 | None | 0.999998 | None | None | None | None |
| op_name | op_type | fake_stub_type | dtype | flops | clip_ATOL | round_ATOL | qint8_ATOL | qint16_ATOL | qint8-qint16_ATOL | fp16_ATOL | tuned_cumulative_ATOL | cumulative_ATOL | clip_L1 | round_L1 | qint8_L1 | qint16_L1 | qint8-qint16_L1 | fp16_L1 | tuned_cumulative_L1 | cumulative_L1 | clip_COSINE | round_COSINE | qint8_COSINE | qint16_COSINE | qint8-qint16_COSINE | fp16_COSINE | tuned_cumulative_COSINE | cumulative_COSINE |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| _generated_sigmoid_0.func | horizon_plugin_pytorch.nn.qat.segment_lut.SegmentLUT | output | qint8 | 0(0%) | 0.0 | 0.006581 | 0.006581 | 2.6e-05 | 0.006556 | None | None | None | 0.0 | 0.003309 | 0.003309 | 1.3e-05 | 0.003296 | None | None | None | 1.0 | 0.999996 | 0.999996 | 1.0 | -4e-06 | None | None | None |
| add2 | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint8 | 0(0%) | 0.0 | 0.006581 | 0.006581 | 2.6e-05 | 0.006556 | None | None | None | 0.0 | 0.003309 | 0.003309 | 1.3e-05 | 0.003296 | None | None | None | 1.0 | 0.999996 | 0.999996 | 1.0 | -4e-06 | None | None | None |
| add1 | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint8 | 0(0%) | 0.0 | 0.004851 | 0.004851 | 1.9e-05 | 0.004832 | None | None | None | 0.0 | 0.002035 | 0.002035 | 8e-06 | 0.002027 | None | None | None | 1.0 | 0.999998 | 0.999998 | 1.0 | -2e-06 | None | None | None |
| conv | horizon_plugin_pytorch.nn.qat.conv2d.Conv2d | output | qint8 | 5184(98.18%) | 0.0 | 0.004851 | 0.004851 | 1.9e-05 | 0.004832 | None | None | None | 0.0 | 0.002035 | 0.002035 | 8e-06 | 0.002027 | None | None | None | 1.0 | 0.999998 | 0.999998 | 1.0 | -2e-06 | None | None | None |
| quant | horizon_plugin_pytorch.nn.qat.stubs.QuantStub | output | qint8 | 0(0%) | 0.000694 | 0.003375 | 0.003375 | 1.4e-05 | 0.003361 | None | None | None | 1e-06 | 0.000798 | 0.000798 | 3e-06 | 0.000794 | None | None | None | 1.0 | 1.0 | 1.0 | 1.0 | -0.0 | None | None | None |
| conv | horizon_plugin_pytorch.nn.qat.conv2d.Conv2d | weight | qint8 | 5184(98.18%) | 0.0 | 0.003242 | 0.003242 | 1.2e-05 | 0.003231 | None | None | None | 0.0 | 0.000761 | 0.000761 | 4e-06 | 0.000758 | None | None | None | 1.0 | 1.0 | 1.0 | 1.0 | -0.0 | None | None | None |
| _generated_add_1 | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint8 | 0(0%) | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | None | None | None | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | None | None | None | 1.0 | 1.0 | 1.0 | 1.0 | 0.0 | None | None | None |
| ln.bias_add | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint8 | 0(0%) | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | None | None | None | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | None | None | None | 1.0 | 1.0 | 1.0 | 1.0 | 0.0 | None | None | None |
| mm | horizon_plugin_pytorch.nn.qat.matmul.Matmul | output | qint8 | 96(1.82%) | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | None | None | None | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | None | None | None | 1.0 | 1.0 | 1.0 | 1.0 | 0.0 | None | None | None |
| _generated_add_0 | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.bias_quant | horizon_plugin_pytorch.nn.qat.stubs.QuantStub | output | qint16 | 0(0%) | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.input_mean.mean | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.mul | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.out_mul | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.rsqrt.rsqrt | horizon_plugin_pytorch.nn.qat.segment_lut.SegmentLUT | output | qint16 | 0(0%) | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.sub | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.var_mean.mean | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.weight_mul | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.weight_quant | horizon_plugin_pytorch.nn.qat.stubs.QuantStub | output | qint16 | 0(0%) | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| quant_grid | horizon_plugin_pytorch.nn.qat.stubs.QuantStub | output | qint16 | 0(0%) | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| op_name | op_type | fake_stub_type | dtype | flops | clip_ATOL | round_ATOL | qint8_ATOL | qint16_ATOL | qint8-qint16_ATOL | fp16_ATOL | tuned_cumulative_ATOL | cumulative_ATOL | clip_L1 | round_L1 | qint8_L1 | qint16_L1 | qint8-qint16_L1 | fp16_L1 | tuned_cumulative_L1 | cumulative_L1 | clip_COSINE | round_COSINE | qint8_COSINE | qint16_COSINE | qint8-qint16_COSINE | fp16_COSINE | tuned_cumulative_COSINE | cumulative_COSINE |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| _generated_sigmoid_0.func | horizon_plugin_pytorch.nn.qat.segment_lut.SegmentLUT | output | qint8 | 0(0%) | 0.0 | 0.006585 | 0.006585 | 2.6e-05 | 0.00656 | None | None | None | 0.0 | 0.003358 | 0.003358 | 1.3e-05 | 0.003345 | None | None | None | 1.0 | 0.999996 | 0.999996 | 1.0 | -4e-06 | None | None | None |
| add2 | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint8 | 0(0%) | 0.0 | 0.006585 | 0.006585 | 2.6e-05 | 0.00656 | None | None | None | 0.0 | 0.003358 | 0.003358 | 1.3e-05 | 0.003345 | None | None | None | 1.0 | 0.999996 | 0.999996 | 1.0 | -4e-06 | None | None | None |
| add1 | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint8 | 0(0%) | 0.0 | 0.00488 | 0.00488 | 1.9e-05 | 0.004861 | None | None | None | 0.0 | 0.002075 | 0.002075 | 8e-06 | 0.002067 | None | None | None | 1.0 | 0.999998 | 0.999998 | 1.0 | -2e-06 | None | None | None |
| conv | horizon_plugin_pytorch.nn.qat.conv2d.Conv2d | output | qint8 | 5184(98.18%) | 0.0 | 0.00488 | 0.00488 | 1.9e-05 | 0.004861 | None | None | None | 0.0 | 0.002075 | 0.002075 | 8e-06 | 0.002067 | None | None | None | 1.0 | 0.999998 | 0.999998 | 1.0 | -2e-06 | None | None | None |
| quant | horizon_plugin_pytorch.nn.qat.stubs.QuantStub | output | qint8 | 0(0%) | 0.00084 | 0.00347 | 0.00347 | 1.5e-05 | 0.003455 | None | None | None | 1e-06 | 0.000828 | 0.000828 | 3e-06 | 0.000825 | None | None | None | 1.0 | 1.0 | 1.0 | 1.0 | -0.0 | None | None | None |
| conv | horizon_plugin_pytorch.nn.qat.conv2d.Conv2d | weight | qint8 | 5184(98.18%) | 0.0 | 0.003387 | 0.003387 | 1.2e-05 | 0.003376 | None | None | None | 0.0 | 0.000788 | 0.000788 | 4e-06 | 0.000785 | None | None | None | 1.0 | 1.0 | 1.0 | 1.0 | -0.0 | None | None | None |
| _generated_add_1 | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint8 | 0(0%) | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | None | None | None | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | None | None | None | 1.0 | 1.0 | 1.0 | 1.0 | 0.0 | None | None | None |
| ln.bias_add | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint8 | 0(0%) | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | None | None | None | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | None | None | None | 1.0 | 1.0 | 1.0 | 1.0 | 0.0 | None | None | None |
| mm | horizon_plugin_pytorch.nn.qat.matmul.Matmul | output | qint8 | 96(1.82%) | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | None | None | None | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | None | None | None | 1.0 | 1.0 | 1.0 | 1.0 | 0.0 | None | None | None |
| _generated_add_0 | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.bias_quant | horizon_plugin_pytorch.nn.qat.stubs.QuantStub | output | qint16 | 0(0%) | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.input_mean.mean | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.mul | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.out_mul | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.rsqrt.rsqrt | horizon_plugin_pytorch.nn.qat.segment_lut.SegmentLUT | output | qint16 | 0(0%) | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.sub | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.var_mean.mean | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.weight_mul | horizon_plugin_pytorch.nn.qat.functional_modules.FloatFunctional | output | qint16 | 0(0%) | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| ln.weight_quant | horizon_plugin_pytorch.nn.qat.stubs.QuantStub | output | qint16 | 0(0%) | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |
| quant_grid | horizon_plugin_pytorch.nn.qat.stubs.QuantStub | output | qint16 | 0(0%) | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 0.0 | 0.0 | None | 0.0 | None | None | None | None | 1.0 | 1.0 | None | 1.0 | None | None | None | None |