Available execution providers : ['TIDLExecutionProvider', 'TIDLCompilationProvider', 'CPUExecutionProvider'] Running 1 Models - ['besta'] Running_Model : besta Running shape inference on model ../../../models/public/yolov5s.onnx Preliminary subgraphs created = 5 Final number of subgraphs created are : 3, - Offloaded Nodes - 196, Total Nodes - 236 /home/leo/code/edgeai-tidl-tools-master/examples/osrt_python/ort/tidl_tools/tidl_graphVisualiser_runtimes.out: error while loading shared libraries: libcgraph.so.6: cannot open shared object file: No such file or directory ************** Frame index 1 : Running float import ************* /home/leo/code/edgeai-tidl-tools-master/examples/osrt_python/ort/tidl_tools/tidl_graphVisualiser.out: error while loading shared libraries: libcgraph.so.6: cannot open shared object file: No such file or directory **************************************************** ** ALL MODEL CHECK PASSED ** **************************************************** The soft limit is 2048 The hard limit is 2048 MEM: Init ... !!! MEM: Init ... Done !!! 0.0s: VX_ZONE_INIT:Enabled 0.6s: VX_ZONE_ERROR:Enabled 0.7s: VX_ZONE_WARNING:Enabled 0.1533s: VX_ZONE_INIT:[tivxInit:184] Initialization Done !!! ********** Frame Index 1 : Running float inference ********** ************** Frame index 1 : Running float import ************* /home/leo/code/edgeai-tidl-tools-master/examples/osrt_python/ort/tidl_tools/tidl_graphVisualiser.out: error while loading shared libraries: libcgraph.so.6: cannot open shared object file: No such file or directory INFORMATION: [TIDL_ResizeLayer] Resize_118 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. INFORMATION: [TIDL_ResizeLayer] Resize_140 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. **************************************************** ** 2 WARNINGS 0 ERRORS ** **************************************************** ********** Frame Index 1 : Running float inference ********** ************** Frame index 1 : Running float import ************* /home/leo/code/edgeai-tidl-tools-master/examples/osrt_python/ort/tidl_tools/tidl_graphVisualiser.out: error while loading shared libraries: libcgraph.so.6: cannot open shared object file: No such file or directory **************************************************** ** ALL MODEL CHECK PASSED ** **************************************************** ********** Frame Index 1 : Running float inference ********** ********** Frame Index 2 : Running fixed point mode for calibration ********** ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/leo/code/edgeai-tidl-tools-master/model-artifacts/besta/tempDir/228_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 9640.59 .... ..... ... .... ..... # 1 . .. T 9591.98 .... ..... ... .... ..... ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/leo/code/edgeai-tidl-tools-master/model-artifacts/besta/tempDir/228_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 7122.62 .... ..... ... .... ..... # 1 . .. T 7123.85 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/leo/code/edgeai-tidl-tools-master/model-artifacts/besta/tempDir/228_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 7126.32 .... ..... ... .... ..... # 1 . .. T 7126.64 .... ..... ... .... ..... ***************** Calibration iteration number 1 completed ************************ ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/leo/code/edgeai-tidl-tools-master/model-artifacts/besta/tempDir/228_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 7120.21 .... ..... ... .... ..... # 1 . .. T 7150.90 .... ..... ... .... ..... ***************** Calibration iteration number 2 completed ************************ ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/leo/code/edgeai-tidl-tools-master/model-artifacts/besta/tempDir/228_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 7168.20 .... ..... ... .... ..... # 1 . .. T 7163.76 .... ..... ... .... ..... ***************** Calibration iteration number 3 completed ************************ ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/leo/code/edgeai-tidl-tools-master/model-artifacts/besta/tempDir/228_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 7127.88 .... ..... ... .... ..... # 1 . .. T 7137.15 .... ..... ... .... ..... ***************** Calibration iteration number 4 completed ************************ ------------------ Network Compiler Traces ----------------------------- NC running for device: 1 Running with OTF buffer optimizations successful Memory allocation /home/leo/code/edgeai-tidl-tools-master/examples/osrt_python/ort/tidl_tools/tidl_graphVisualiser.out: error while loading shared libraries: libcgraph.so.6: cannot open shared object file: No such file or directory **************************************************** ** ALL MODEL CHECK PASSED ** **************************************************** ********** Frame Index 2 : Running fixed point mode for calibration ********** ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/leo/code/edgeai-tidl-tools-master/model-artifacts/besta/tempDir/326365404_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 6665.58 .... ..... ... .... ..... # 1 . .. T 6647.75 .... ..... ... .... ..... ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/leo/code/edgeai-tidl-tools-master/model-artifacts/besta/tempDir/326365404_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 3502.79 .... ..... ... .... ..... # 1 . .. T 3493.17 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/leo/code/edgeai-tidl-tools-master/model-artifacts/besta/tempDir/326365404_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 3507.26 .... ..... ... .... ..... # 1 . .. T 3513.30 .... ..... ... .... ..... ***************** Calibration iteration number 1 completed ************************ ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/leo/code/edgeai-tidl-tools-master/model-artifacts/besta/tempDir/326365404_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 3498.75 .... ..... ... .... ..... # 1 . .. T 3507.60 .... ..... ... .... ..... ***************** Calibration iteration number 2 completed ************************ ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/leo/code/edgeai-tidl-tools-master/model-artifacts/besta/tempDir/326365404_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 3488.07 .... ..... ... .... ..... # 1 . .. T 3495.94 .... ..... ... .... ..... ***************** Calibration iteration number 3 completed ************************ ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/leo/code/edgeai-tidl-tools-master/model-artifacts/besta/tempDir/326365404_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 3499.58 .... ..... ... .... ..... # 1 . .. T 3488.70 .... ..... ... .... ..... ***************** Calibration iteration number 4 completed ************************ ------------------ Network Compiler Traces ----------------------------- NC running for device: 1 Running with OTF buffer optimizations successful Memory allocation /home/leo/code/edgeai-tidl-tools-master/examples/osrt_python/ort/tidl_tools/tidl_graphVisualiser.out: error while loading shared libraries: libcgraph.so.6: cannot open shared object file: No such file or directory INFORMATION: [TIDL_ResizeLayer] Resize_118 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. INFORMATION: [TIDL_ResizeLayer] Resize_140 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. **************************************************** ** 2 WARNINGS 0 ERRORS ** **************************************************** ********** Frame Index 2 : Running fixed point mode for calibration ********** ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/leo/code/edgeai-tidl-tools-master/model-artifacts/besta/tempDir/output0_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 64.20 .... ..... ... .... ..... # 1 . .. T 56.35 .... ..... ... .... ..... ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/leo/code/edgeai-tidl-tools-master/model-artifacts/besta/tempDir/output0_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 68.55 .... ..... ... .... ..... # 1 . .. T 64.69 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/leo/code/edgeai-tidl-tools-master/model-artifacts/besta/tempDir/output0_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 68.72 .... ..... ... .... ..... # 1 . .. T 64.46 .... ..... ... .... ..... ***************** Calibration iteration number 1 completed ************************ ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/leo/code/edgeai-tidl-tools-master/model-artifacts/besta/tempDir/output0_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 70.52 .... ..... ... .... ..... # 1 . .. T 64.40 .... ..... ... .... ..... ***************** Calibration iteration number 2 completed ************************ ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/leo/code/edgeai-tidl-tools-master/model-artifacts/besta/tempDir/output0_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 68.99 .... ..... ... .... ..... # 1 . .. T 64.80 .... ..... ... .... ..... ***************** Calibration iteration number 3 completed ************************ ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/leo/code/edgeai-tidl-tools-master/model-artifacts/besta/tempDir/output0_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 68.09 .... ..... ... .... ..... # 1 . .. T 64.64 .... ..... ... .... ..... ***************** Calibration iteration number 4 completed ************************ ------------------ Network Compiler Traces ----------------------------- NC running for device: 1 Running with OTF buffer optimizations successful Memory allocation /home/leo/code/edgeai-tidl-tools-master/examples/osrt_python/ort/tidl_tools/tidl_graphVisualiser.out: error while loading shared libraries: libcgraph.so.6: cannot open shared object file: No such file or directory **************************************************** ** ALL MODEL CHECK PASSED ** **************************************************** Completed_Model : 1, Name : besta , Total time : 89329.31, Offload Time : 9685.48 , DDR RW MBs : 0, Output File : py_out_besta_2.jpg MEM: Deinit ... !!! MEM: Alloc's: 89 alloc's of 1044781908 bytes MEM: Free's : 89 free's of 1044781908 bytes MEM: Open's : 0 allocs of 0 bytes MEM: Deinit ... Done !!!