ti@TI:~/edgeai-tidl-tools/examples/osrt_python/ort$ python3 onnxrt_ep.py -c -m dirtynet-v2 Available execution providers : ['TIDLExecutionProvider', 'TIDLCompilationProvider', 'CPUExecutionProvider'] Running 1 Models - ['dirtynet-v2'] Running_Model : dirtynet-v2 Running shape inference on model ../../../models/public/dirtynet_v2_opset9_fixed_batch1.onnx ========================= [Model Compilation Started] ========================= Model compilation will perform the following stages: 1. Parsing 2. Graph Optimization 3. Quantization & Calibration 4. Memory Planning ============================== [Version Summary] ============================== ------------------------------------------------------------------------------- | TIDL Tools Version | 11_00_08_00 | ------------------------------------------------------------------------------- | C7x Firmware Version | 11_00_00_00 | ------------------------------------------------------------------------------- | Runtime Version | 1.15.0 | ------------------------------------------------------------------------------- | Model Opset Version | 9 | ------------------------------------------------------------------------------- ============================== [Parsing Started] ============================== [TIDL Import] [PARSER] WARNING: Network not identified as Object Detection network : (1) Ignore if network is not Object Detection network (2) If network is Object Detection network, please specify "model_type":"OD" as part of OSRT compilation options ------------------------- Subgraph Information Summary ------------------------- ------------------------------------------------------------------------------- | Core | No. of Nodes | Number of Subgraphs | ------------------------------------------------------------------------------- | C7x | 100 | 1 | | CPU | 0 | x | ------------------------------------------------------------------------------- /home/ti/edgeai-tidl-tools/tools/AM67A/tidl_tools/tidl_graphVisualiser_runtimes.out: error while loading shared libraries: libcgraph.so.6: cannot open shared object file: No such file or directory [TIDL Import] WARNING: System command failed with return code : 32512. Skipping Runtimes GraphViz. ============================= [Parsing Completed] ============================= ==================== [Optimization for subgraph_0 Started] ==================== ----------------------------- Optimization Summary ----------------------------- --------------------------------------------------------------------------------- | Layer | Nodes before optimization | Nodes after optimization | --------------------------------------------------------------------------------- | TIDL_InnerProductLayer | 1 | 1 | | TIDL_EltWiseLayer | 10 | 10 | | TIDL_CLipLayer | 35 | 0 | | TIDL_FlattenLayer | 1 | 0 | | TIDL_ConvolutionLayer | 52 | 52 | | TIDL_PoolingLayer | 1 | 1 | --------------------------------------------------------------------------------- Total nodes in subgraph: 69 =================== [Optimization for subgraph_0 Completed] =================== /home/ti/edgeai-tidl-tools/tools/AM67A/tidl_tools/tidl_graphVisualiser.out: error while loading shared libraries: libcgraph.so.6: cannot open shared object file: No such file or directory [TIDL Import] WARNING: System command failed with return code : 32512. Skipping Graph Visualization. The soft limit is 10240 The hard limit is 10240 MEM: Init ... !!! MEM: Init ... Done !!! 0.0s: VX_ZONE_INFO: Globally Enabled VX_ZONE_ERROR 0.9s: VX_ZONE_INFO: Globally Enabled VX_ZONE_WARNING ============= [Quantization & Calibration for subgraph_0 Started] ============= -------- Running Calibration in Float Mode to Collect Tensor Statistics -------- [=============================================================================] 100 % ------------------ Fixed-point Calibration Iteration [1 / 5]: ------------------ [=============================================================================] 100 % ------------------ Fixed-point Calibration Iteration [2 / 5]: ------------------ [=============================================================================] 100 % ------------------ Fixed-point Calibration Iteration [3 / 5]: ------------------ [=============================================================================] 100 % ------------------ Fixed-point Calibration Iteration [4 / 5]: ------------------ [=============================================================================] 100 % ------------------ Fixed-point Calibration Iteration [5 / 5]: ------------------ [=============================================================================] 100 % ==================== [Quantization & Calibration Completed] ==================== ========================== [Memory Planning Started] ========================== ------------------------- Network Compiler Traces ------------------------------ Successful Memory Allocation Successful Workload Creation ========================= [Memory Planning Completed] ========================= Rerunning network compiler... ========================== [Memory Planning Started] ========================== ------------------------- Network Compiler Traces ------------------------------ Successful Memory Allocation Successful Workload Creation ========================= [Memory Planning Completed] ========================= /home/ti/edgeai-tidl-tools/tools/AM67A/tidl_tools/tidl_graphVisualiser.out: error while loading shared libraries: libcgraph.so.6: cannot open shared object file: No such file or directory [TIDL Import] WARNING: System command failed with return code : 32512. Skipping Graph Visualization. /home/ti/edgeai-tidl-tools/tools/AM67A/tidl_tools/tidl_graphVisualiser.out: error while loading shared libraries: libcgraph.so.6: cannot open shared object file: No such file or directory [TIDL Import] WARNING: System command failed with return code : 32512. Skipping Graph Visualization. ======================== Subgraph Compiled Successfully ======================== Completed_Model : 1, Name : dirtynet-v2 , Total time : 27832.56, Offload Time : 1875.30 , DDR RW MBs : 0, Output Image File : py_out_dirtynet-v2_defocus1.jpg, Output Bin File : py_out_dirtynet-v2_defocus1.bin MEM: Deinit ... !!! MEM: Alloc's: 26 alloc's of 301435757 bytes MEM: Free's : 26 free's of 301435757 bytes MEM: Open's : 0 allocs of 0 bytes MEM: Deinit ... Done !!! ti@TI:~/edgeai-tidl-tools/examples/osrt_python/ort$ python3 onnxrt_ep.py -m dirtynet-v2 Available execution providers : ['TIDLExecutionProvider', 'TIDLCompilationProvider', 'CPUExecutionProvider'] Running 1 Models - ['dirtynet-v2'] Running_Model : dirtynet-v2 libtidl_onnxrt_EP loaded 0x5babf8a68ca0 Final number of subgraphs created are : 1, - Offloaded Nodes - 100, Total Nodes - 100 The soft limit is 10240 The hard limit is 10240 MEM: Init ... !!! MEM: Init ... Done !!! 0.0s: VX_ZONE_INFO: Globally Enabled VX_ZONE_ERROR 0.16s: VX_ZONE_INFO: Globally Enabled VX_ZONE_WARNING , 0 5.450149 goldfish, Carassius auratus ,, 1 0.201713 hammerhead, hammerhead shark ,, 2 -1.042690 tiger shark, Galeocerdo cuvieri ,, 3 -2.319056 tench, Tinca tinca ,, 4 -5.133541 great white shark, white shark, man-eater, man-eating shark, Carcharodon carcharias , Saving image to ../../../output_images/ Saving output tensor to ../../../output_binaries/ Completed_Model : 1, Name : dirtynet-v2 , Total time : 1682.45, Offload Time : 1682.38 , DDR RW MBs : 0, Output Image File : py_out_dirtynet-v2_clean3.jpg, Output Bin File : py_out_dirtynet-v2_clean3.bin MEM: Deinit ... !!! MEM: Alloc's: 26 alloc's of 199267333 bytes MEM: Free's : 26 free's of 199267333 bytes MEM: Open's : 0 allocs of 0 bytes MEM: Deinit ... Done !!! ti@TI:~/edgeai-tidl-tools/output_binaries$ python3 read_dirty_result.py ===== 脏污分类模型推理结果 ===== 类别 0 | defocus | 概率: -2.3191 类别 1 | clean | 概率: 5.4501 类别 2 | water | 概率: -5.1335 类别 3 | mud | 概率: -1.0427 类别 4 | fog | 概率: 0.2017 ----------------------------------- Top1 结果：clean（概率：5.4501）