NPU Deployment Issue — Whisper Model (Genio 510)

NeuroPilot NeuroPilot - Analytical AI
, , ,
2

Thanks for the detailed description of your workflow and setup.

Let me address your questions first:

  1. Do I need to use the C++ Runtime API from the SDK to run a .dla model on the MDLA NPU?
    Yes. For application-level integration on MDLA today, the supported way is to use the NeuroPilot Runtime API (C/C++).

  2. Can I run the DLA model using Python?
    Currently, MDLA inference is not supported through a Python API. So you cannot directly load and run the .dla model from Python at this time.

Recommended approach right now:

  • For analyzing model behavior and performance on hardware, you can use the neuronrt tool to:

    • Inspect how the model is mapped to the NPU,
    • Check performance characteristics and utilization on the Genio 510.

  • For development and integration, please refer to the NeuroPilot Runtime API (C/C++). That is the recommended way to:

    • Load your Whisper encoder .dla file,
    • Configure inputs/outputs,
    • Run inference on the MDLA NPU.

We plan to update and provide a Stable Delegate with Python API support. Once that is available, you will be able to perform NPU inference (including MDLA) directly from Python, which should make integration with Python-based workflows much easier.

Future updates will be published on the bulletin.