SPRAD48 July   2022 TDA4VM

 

  1.   Abstract
  2.   Trademarks
  3. Introduction
  4. Summary of Changes
  5. Procedure to Apply the Changes
    1. 3.1 Do Not Skip Any of These Steps
    2. 3.2 Patch Information
  6. Build Instructions
    1. 4.1 PSDKRA Build Instructions
    2. 4.2 PSDKLA Build Instructions
  7. Demo Applications
    1. 5.1 Basic OpenVX Kernels
    2. 5.2 Capture - Display UseCase
      1. 5.2.1 Steps to Enable Demo
    3. 5.3 Single Camera VPAC Application Demo
      1. 5.3.1 Steps to Enable Demo
    4. 5.4 Multi Camera VPAC Application Demo
      1. 5.4.1 Steps to Enable Demo
  8. Run Instructions
  9. Basic Demo Applications
  10. Single Camera VPAC Application Demo
  11. Multi Camera VPAC Application Demo
  12. 10Limitations

Basic Demo Applications

  • Both the demo applications run one after the other and a GrayScale image is seen on the eDP/HDMI display from four cameras.
  • The images are such that each camera streams for 5 seconds and switches to another camera for streaming.
  • These switch occurs for 33 seconds in order to stream 1000 frames at 30 FPS.
  • In the UART terminal, you can see login prompt as shown below:
    j7-evm login:
  • On the EVM, Login using the below user id, no password.
    root
  • On the EVM, do the following steps to view the logs for the demo application.
    cd /opt/vision_apps
    
    source ./vision_apps_init.sh
  • You can see the below logs, thus confirming successful completion of demo applications on the R5F core.
    [MCU2_0] 19.869104 s: vx_tutorial_openVX_r5_demo: Tutorial Started !!!
    
    
    [MCU2_0] 19.869163 s: 1. vx_tutorial_basic_openvx_kernels: Tutorial Started !!!
    [MCU2_0] 19.483423 s: VX_TYPE_IMAGE: INPUT1, 128 x 128, 1 plane(s), 16384 BVX_DF_IMAGE_U8 VX_COLOR_SPACE_NONE VX_CHANNEL_RANGE_FULL VX_MEMORY_TYPE_NONE, 1 refs
    [MCU2_0] 19.884959 s: VX_TE_IMAGE: INPUT2, 128 x 128, 1 plane(s), 16384 B, VX_DF_IMAGE_UVX_COLOR_SPACE_NONE VX_CHANNEL_RANGE_FULL VX_MEMORY_TYPE_NONE, 1 refs
    [MCU2_0] 19.885063 s: VX_TYPE_IMAGE: INPU, 128 x 128, 1 plane(s), 16384 B, VX_DF_IMAGE_U8 VX_COLOR_SPACNONE VX_CHANNEL_RANGE_FULL VX_MEMORY_TYPE_NONE, 1 refs
    [MCU2_0] 19.885161 s: VX_TYPE_IMAGE: INPUT4, 128 x 128, 1lane(s), 16384 B, VX_DF_IMAGE_U8 VX_COLOR_SPACE_NONE VX_CHANNERANGE_FULL VX_MEMORY_TYPE_NONE, 1 refs
    [MCU2_0] 19.885255 s: VX_TYPE_IMAGE: ADD_OUTPUT, 128 x 128, 1 plane(s), 384 B, VX_DF_IMAGE_U8 VX_COLOR_SPACE_NONE VX_CHANNEL_RANGE_FULVX_MEMORY_TYPE_NONE, 1 refs
    [MCU2_0] 19.885349 s: VX_TYPE_IMAGE: SUB_OUTPUT, 128 x 128, 1 plane(s), 16384 B, VX__IMAGE_U8 VX_COLOR_SPACE_NONE VX_CHANNEL_RANGE_FULL VX_MEMORY_PE_NONE, 1 refs
    [MCU2_0] 19.885443 s: VX_TYPE_IMAGE: MUL_OUTPUT, 128 x 128, 1 plane(s), 16384 B, VX_DF_IMAGE_U8X_COLOR_SPACE_NONE VX_CHANNEL_RANGE_FULL VX_MEMORY_TYPE_NONE, refs
    [MCU2_0] 19.891545 s: VX_TYPE_GRAPH: graph_77, 3 nodes, VX_GRAPH_STATE_VERIFIED, avg perf 0.000000s, 0 parameters, 1 refs
    [MCU2_0] 19.891665 s: VX_TYPE_NODE: ADD, params, avg perf 0.000000s, VX_SUCCESS, 1 refs
    [MCU2_0] 19.891734 s: VX_TYPE_NODE: SUB, 4 params, avg perf 0.0000s, VX_SUCCESS, 1 refs
    [MCU2_0] 19.891800 s: VX_TYPEODE: MUL, 6 params, avg perf 0.000000s, VX_SUCCESS, 1 refs
    [MCU2_0] 19.891839 s: Executing graph ...
    [MCU2_0] 19.892790 s: Executing graph ... Done !!!
    [MCU2_0] 19.892890 s: VX_TYPE_GRAPH: graph_77, 3 nodes, VX_GRAPH_STATE_COMPLETED, avg perf 0.000878s, 0 parameters, 1 refs
    [MCU2_0] 19.892972 s: VX_TYPE_NODE: ADD, 4 params, avg perf 000146s, VX_SUCCESS, 1 refs
    [MCU2_0] 19.893041 s: VX_TYPE_NODE: SUB, 4 params, avg perf 0.000217s, VX_SUCCESS, 1efs
    [MCU2_0] 19.893104 s: VX_TYPE_NODE: MUL, 6 params, g perf 0.000178s, VX_SUCCESS, 1 refs
    [MCU2_0] 19.895757 s: Arithmetic Operation Success!! Final Output = 16
    [MCU2_0] 19.898018 s: 1. vx_tutorial_basic_openvx_kernels: Tutorial Done !!!
    
    
    [MCU2_0] 19.898083 s:
    [MCU2_0] 19.898118 s: 2. vx_tutorial_capture_display_usecase: Tutorial Started !!!
    [MCU2_0] 19.903933 s: ISS: Enumerating sensors ... !!!
    [MCU2_0] 19.904623 s: IPC: Echo status: mpu1_0[x] mcu2_0[smcu2_1[.] C66X_1[P] C66X_2[.] C7X_1[P] ]
    [MCU2_0] 19.904698 s: IPC: Echo status: mpu1_0[x] mcu2_0[s] mcu2_1[.] C661[P] C66X_2[P] C7X_1[P]
    [MCU2_0] 19.904769 s: IPC: Echo status: mpu1_0[x] mcu2_0[s] mcu2_1[P] C66X_1[P] C66X_2[P] C7X_1[P]
    [MCU2_0] 20.303851 s: ISS: Enumerating sensor... found 0 : IMX390-UB953_D3
    [MCU2_0] 20.303903 s: ISS: Enumerating sensors ... found 1 : AR0233-UB953_MARS
    [MCU2_0] 20.303935 s: ISS: Enumerating sensors ... found 2 : A820-UB953_LI
    [MCU2_0] 20.303963 s: ISS: Enumerating sensors ... found 3 : UB9xxx_RAW12_TESTPATTERN
    [MCU2_0] 20.303993 s: ISS: Enumerating sensors ... found 4 : UB96x_UYVYESTPATTERN
    [MCU2_0] 20.304023 s: ISS: Enumerating sensors ... found 5 : GW_AR0233_UYVY
    [MCU2_0] 20.304055 s: ISS: Querying sensor [IMX390-UB953_D3] ... !!!
    [MCU2_0] 0.3040966 s: ISS: Querying sensor [IMX390-UB953_D3] ... Done !!
    [MCU2_0] 20.304130 s: ISS: Initializing sensor [IMX390-UB953_D3], doing IM_SENSOR_CMD_PWRON ... !!!
    [MCU2_0] 20.304193 s: IMX390_PowerOn : chMask = 0x0
    [MCU2_0] 20.422832 s: IMX390_PowerOn : chMask = 0x1
    [MCU2_0] 20.304256 s: IMX390_PowerOn : chMask = 0x2
    [MCU2_0] 20.308533 s: IMX390_PowerOn : chMask = 0x3
    [MCU2_0] 20.304307 s: ISS: Initializing sensor [IMX390-UB953_D3], doing IM_SENSOR_CMD_CONFIG ... !!!
    [MCU2_0] 21.009703 s: Configuring IMX390 imager 0x40.. Please wait till it finishes
    [MCU2_0] 23.292703 s: Configuring IMX390 imager 0x42.. Please wait till it finishes
    [MCU2_0] 25.612702 s: Configuring IMX390 imager 0x44.. Please wait till it finishes
    [MCU2_0] 27.908702 s: Configuring IMX390 imager 0x46.. Please wait till it finishes
    [MCU2_0] 30.030586 s: ISS: Initialing sensor [IMX390-UB953_D3] ... Done !!!
    [MCU2_0] 30.0350 s: VX_TYPE_IMAGE: image_84, 1936 x 1100, 1 plane(s), 4294400 B, VX_DF_IMAGE_U16 VX_COLOR_SPACE_NONE VX_CHANNEL_RAN_FULL VX_MEMORY_TYPE_NONE, 1 refs
    [MCU2_0] 30.035393 s: X_TYPE_IMAGE: image_86, 1936 x 1100, 1 plane(s), 4294400 B, VX_DF_IMAGE_U16 VX_COLOR_SPACE_NONE VX_CHANNEL_RANGE_FULL _MEMORY_TYPE_NONE, 2 refs
    [MCU2_0] 30.036010 s: Display t Target done
    [MCU2_0] 30.099516 s: VX_TYPE_GRAPH: graph_83, 2 nodes, VX_GRAPH_STATE_VERIFIED, avg perf 0.00000, 1 parameters, 1 refs
    [MCU2_0] 30.099636 s: VX_TYPE_NO: node_105, 2 params, avg perf 0.000000s, VX_SUCCESS, 1 refs
    [MCU2_0] 30.099711 s: VX_TYPE_NODE: node_107, 2 pams, avg perf 0.000000s, VX_SUCCESS, 1 refs
    [MCU2_0] 3099749 s: ISS: Starting sensor [IMX390-UB953_D3] ... !!!
    [MCU2_0] 30.779672 s: ISS: Starting sensor [IMX390-UB953_] ... !!!
    [MCU2_0] 64.356354 s: VX_TYPE_GRAPH: graph_832 nodes, VX_GRAPH_STATE_COMPLETED, avg perf 0.033661s, 1 parameters, 1 refs
    [MCU2_0] 64.356461 s: VX_TYPE_NODEnode_105, 2 params, avg perf 0.027024s, VX_SUCCESS, 1 refs
    [MCU2_0] 64.356531 s: VX_TYPE_NODE: node_107, 2 params, avg perf 0.006114s, VX_SUCCESS, 1 refs
    [MCU2_0] 64.3587 s: ISS: Stopping sensor [IMX390-UB953_D3] ... !!!
    [MCU2_0 64.524676 s: ISS: Stopping sensor [IMX390-UB953_D3] ... Done !!!
    MCU2_0] 64.525212 s: exe_time = 33576843
    [MCU2_0] ========================================================
    [MCU2_0] 64.525253 s: : Capture Status:
    [MCU2_0] 64.525284 s: ========================================================
    [MCU2_0] 64.5323 s: : FIFO Overflow Count: 0
    [MCU2_0] 64.525352 s: : Spurious UDMA interrupt count: 0
    [MCU2_0] 64.525322 s: [Channel No] | Frame Queue Count | Frame De-queue Count | Frame Drop Count |
    [MCU2_0] 64.525431 s:       0               |            1008               |               1006                  |                  1               |
    [MCU2_0] 64.525456 s:       1               |            1008               |                1006                 |                  1               |
    [MCU2_0] 64.525480 s:       2               |            1008               |                1006                 |                  1               |
    [MCU2_0] 64.525504 s:       3               |            1008               |                1006                 |                  1               |
    [MCU2_0] 64.554650 s: ========================================================
    MCU2_0] 64.554762 s: ==========================================================
    [MCU2_0] 64.554795 s: overflCount: 0
    [MCU2_0] 64.554819 s: spuriousUdmaIntrCount: 0
    [MCU2_0] 64.554844 s: frontFIFOOvflCount: 0
    [MCU2_0] 64.554865 s: crcCount: 0
    [MCU2_0] 64.554883 s: eccCount: 0
    [MCU2_0] 64.554927 s: dataIdErrorCount: 00
    [MCU2_0] 64.554950 s: invalidAccessCount: 0
    [MCU2_0] 64.554963 s: invalidSpCount: 0
    [MCU2_0] 64.554995 s: strmFIFOOlCount[0]: 0
    [MCU2_0] 64.555021 s: strmFIFOOvflCount[1]: 0
    [MCU2_0] 64.555045 s: strmFIFOOvflCount[2]: 8
    [MCU2_0] 64.555070 s: strmFIFOOvflCount[3]: 18
    
    [MCU2_0] 64.555108 s: [Channel No] | Frame Queue Count | Frame De-queue Count | Frame Drop Count |
    [MCU2_0] 64.555160 s:       0               |            1008               |               1006                  |                  1               |
    [MCU2_0] 64.555210 s:       1               |            1008               |                1006                 |                  1               |
    [MCU2_0] 64.555260 s:       2               |            1008               |                1006                 |                  1               |
    [MCU2_0] 64.555310 s:       3               |            1008               |                1006                 |                  1               |
    [MCU2_0] 64.577499 s: ISS: De-initializing sensor [X390-UB953_D3] ... !!!
    [MCU2_0] 64.577590 s: ISS: De-inializing sensor [IMX390-UB953_D3] ... Done !!!
    [MCU2_0] 64.577652 s: 2. vx_tutorial_capture_display_usecase: Tutorial Done !!!
    [MCU2_0] 64.577688 s:
    
    
    [MCU2_0] 64.5713 s: vx_tutorial_openVX_r5_demo: Tutorial Done !!!