Hello,
I am trying to execute Whisper TFLite model on Genio-700 using stable delegate but it leads to apusys memory error.
i get the below log
[apusys][error]memAlloc: alloc mem(160/0/0/0x5) fail(Cannot allocate memory)
[apusys][error]construct: Cmd v2(0xaaaafc834160): alloc execInfo fail
ERROR: APUSysEngine::BuildCmd() failed
ERROR: Failed to build APUSys command.
ERROR: Fail to rewrite DLA
ERROR: Fail to run APUSysRewritePass
WARNING: Fail to run runtime CompiledGraph pipeline
ERROR: Cannot prepare execution.
ERROR: Neuron returned error NEURON_BAD_STATE at line 1393 while creating Neuron execution.
what is this apusys memory error? My understanding is that the model ops is consuming memory which is far greater than the apusys memory and hence the error.
Any way we can add rule to NPU to allow ops consuming large memory to CPU for execution?