CLIP Text Encoder inference error on Genio-520

NeuroPilot NeuroPilot - GenAI
1

Hi,

I’m using the GAI-Deployment-Toolkit-v2.0.2_clip-text-v0.1 to convert clip_vit_large to DLA for inference on Genio520. I’m running into a NeuronCompilation_finish fail error during inference.

The logcat shows “Cannot create device for MVPU_2_5”. If I omit mvpu2.5 in the ncc-tflite command, the DLA conversion fails.

Does the Genio520 not support the CLIP Text Encoder? Or is there a fix for this MVPU_2_5 device error? Thanks!

07-22 13:53:50.911 13182 13182 W neuron : Cannot create device for MVPU_2_5

07-22 13:53:50.912 13182 13182 W neuron : Found an unsupported target: MVPU_2_5

07-22 13:53:50.912 13182 13182 W neuron : Fail to revise subCompiledResult

07-22 13:53:50.912 13182 13182 W neuron : Fail to preprocess target-specific data in APUSYS_2_0 device.

07-22 13:53:50.912 13182 13182 W neuron : Fail to revise dla::CompiledResult

07-22 13:53:50.912 13182 13182 W neuron : Fail to preprocess dla::CompiledGraph

07-22 13:53:50.912 13182 13182 W neuron : Fail to preprocess dla::CompiledNetwork

07-22 13:53:50.912 13182 13182 E neuron : Cannot prepare execution.

07-22 13:53:50.912 13182 13182 E neuron : Successfully open network but cannot start execution.

07-22 13:53:50.912 13182 13182 E neuron : NeuronModel_restoreFromCompiledNetwork - Failed to load compiled network from the given buffer

07-22 13:53:50.923 901 9613 I apuware_server: apusysSession_deleteInstance session from pid:13182 all released.

07-22 13:53:50.924 13182 13182 E neuron : Unknown extension type: EXTENSION

07-22 13:53:50.924 13182 13182 E neuron : Unsupported operation: EXTENSION

07-22 13:53:50.924 13182 13182 E neuron : Fail to convert model

07-22 13:53:50.924 13182 13182 E default : 2025-07-22 13:53:50,924 ERROR [default] NeuronCompilation_finish fail

07-22 13:53:50.924 13182 13182 E default : 2025-07-22 13:53:50,924 ERROR [default] load dla fail

07-22 13:53:50.924 13182 13182 I default : 2025-07-22 13:53:50,924 INFO [default] mExecutor: Done

2

Hi Lori Lin,

Thank you for your question on the MTK forum.

Since the G520 does not support MVPU, you will need to make some modifications to the Neuron SDK.

Please use the following version of the Neuron SDK:

20250423_Neuron_SDK_v1.2517.03_neuron-8.0-release.tar.gz

Then, modify the script located at:
/path/to/GAI-Deployment-Toolkit-v2.0.2_clip-text-v0.1/compile/compile.text_encoder.fp.sh

Change the architecture setting from mvpu2.5 to tflite_cpu, recompile, and try again:

${NCC_TFLITE} \
    --arch=${MDLA_VERSION},mvpu2.5 \
    -O3 \

should be changed to:

${NCC_TFLITE} \
    --arch=${MDLA_VERSION},tflite_cpu \
    -O3 \

Best regards

Jing