This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

SK-TDA4VM: 测试视频的替换问题

Part Number: SK-TDA4VM

你好,我在板子上用的是PROCESSOR-SDK-LINUX-SK-TDA4VM 08060103的版本。

请问怎么用自己的视频代替内置的视频?对视频有哪些要求?

  • 你好,我把视频转换为H.264的格式后,放进板子里,板子里一直跑不出来视频,并且一直卡住,ctrl+c也没法退出,只能断电退出。

    这是抓取的log

    libtidl_onnxrt_EP loaded 0x335ef270
    Final number of subgraphs created are : 1, - Offloaded Nodes - 289, Total Nodes - 289
    APP: Init ... !!!
    MEM: Init ... !!!
    MEM: Initialized DMA HEAP (fd=4) !!!
    MEM: Init ... Done !!!
    IPC: Init ... !!!
    IPC: Init ... Done !!!
    REMOTE_SERVICE: Init ... !!!
    REMOTE_SERVICE: Init ... Done !!!
    101.597246 s: GTC Frequency = 200 MHz
    APP: Init ... Done !!!
    101.600542 s: VX_ZONE_INIT:Enabled
    101.600550 s: VX_ZONE_ERROR:Enabled
    101.600553 s: VX_ZONE_WARNING:Enabled
    101.601435 s: VX_ZONE_INIT:[tivxInitLocal:130] Initialization Done !!!
    101.602555 s: VX_ZONE_INIT:[tivxHostInitLocal:93] Initialization Done for HOST !!!
    )0[1;67r[m[4l[?7h[H[J
    +--------------------------------------------------------------------------+
    | Object Detection[3;77H|
    +--------------------------------------------------------------------------+
    +--------------------------------------------------------------------------+
    | Input Src: /opt/edgeai-test-data/videos/video_0004.h264[6;77H|
    | Model Name: ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416[7;77H|
    | Model Type: detection[8;77H|
    +--------------------------------------------------------------------------+
    +--------------------------------------------------------------------------+[H[J
    +--------------------------------------------------------------------------+
    | Object Detection[3;77H|
    +--------------------------------------------------------------------------+
    +--------------------------------------------------------------------------+
    | Input Src: /opt/edgeai-test-data/videos/video_0004.h264[6;77H|
    | Model Name: ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416[7;77H|
    | Model Type: detection[8;77H|
    +--------------------------------------------------------------------------+
    +--------------------------------------------------------------------------+[H[J
    +--------------------------------------------------------------------------+
    | Object Detection[3;77H|
    +--------------------------------------------------------------------------+
    +--------------------------------------------------------------------------+
    | Input Src: /opt/edgeai-test-data/videos/video_0004.h264[6;77H|
    | Model Name: ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416[7;77H|
    | Model Type: detection[8;77H|
    +--------------------------------------------------------------------------+
    +--------------------------------------------------------------------------+[H[J
    +--------------------------------------------------------------------------+
    | Object Detection[3;77H|
    +--------------------------------------------------------------------------+
    +--------------------------------------------------------------------------+
    | Input Src: /opt/edgeai-test-data/videos/video_0004.h264[6;77H|
    | Model Name: ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416[7;77H|
    | Model Type: detection[8;77H|
    +--------------------------------------------------------------------------+
    +--------------------------------------------------------------------------+[H[J
    +--------------------------------------------------------------------------+
    | Object Detection[3;77H|
    +--------------------------------------------------------------------------+
    +--------------------------------------------------------------------------+
    | Input Src: /opt/edgeai-test-data/videos/video_0004.h264[6;77H|
    | Model Name: ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416[7;77H|
    | Model Type: detection[8;77H|
    +--------------------------------------------------------------------------+
    +--------------------------------------------------------------------------+[H[J
    +--------------------------------------------------------------------------+
    | Object Detection[3;77H|
    +--------------------------------------------------------------------------+
    +--------------------------------------------------------------------------+
    | Input Src: /opt/edgeai-test-data/videos/video_0004.h264[6;77H|
    | Model Name: ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416[7;77H|
    | Model Type: detection[8;77H|
    +--------------------------------------------------------------------------+
    +--------------------------------------------------------------------------+[H[J
    +--------------------------------------------------------------------------+

  • 请问h.264的格式是什么样的?是否有按照替换的视频格式配置width, height, frame rate等,执行命令是什么?

  • 配置了,高宽帧率都是按照要求来的,请问执行命令指什么?
  • 如何运行程序的?

  • 我的yaml是

    input0:
    source: /opt/edgeai-test-data/videos/video_0000_h264.h264
    format: h264
    width: 1280
    height: 720
    framerate: 30
    loop: True

    运行程序指令:

    /opt/edgeai-gst-apps/apps_python# ./app_edgeai.py ../configs/image_classification.yaml
  • input0:

    请尝试改成input1

    另外,demo里的视频能显示吗?除了对yaml文件做了修改,有修改过其他代码吗?

  • 改成input1没有用,demo里的视频是可以显示的,只是修改了yaml读取视频的路径,其他代码都没有修改。

  • 您的yalm文件里的video文件名是video_0000_h264.h264,但是log信息了的文件名是video_0004.h264,请确认一下video源文件。

  • yaml文件是我改回板子里自带的video_0000_h264.h264发给你的,我用我自己的视频video_0004.h264在PROCESSOR-SDK-LINUX-SK-TDA4VM 08060103的版本跑不起来,我换了其他版本可以跑在我自己的视频。

    请问PROCESSOR-SDK-LINUX-SK-TDA4VM 08060103版本是否能读取别的视频?

  • 我换了其他版本可以跑在我自己的视频。

    请问其他版本是哪个版本?

    另外,我把您的问题转给e2e论坛上的工程师,请回复一下他的问题,谢谢。

    Does the width and height of the video match what is defined in the input section? Could you share the yaml file being used?

     https://e2e.ti.com/support/processors-group/processors/f/processors-forum/1288866/tda4vm-how-to-display-own-h-264-video-source

  • 我用了有09.00.01.03 (12 Oct 2023)、09.00.00.08 (11 Aug 2023)、08.05.00.03 (22 Dec 2022)、08.04.00.10 (19 Sep 2022)都可以用我自己的视频。

    08.06.01.03 (31 May 2023)和08.06.00.11 (14 Mar 2023)这两个版本用不了自己的视频。

  • 感谢回复,另外请回复一下e2e工程师的问题,谢谢。

    Does the width and height of the video match what is defined in the input section? Could you share the yaml file being used?