I would like to integrate analytical AI applications in python on Genio 1200 with Yocto and Ubuntu. I’ve found
in my python program, in spite of using “/usr/sbin/neuronrt” command, I am not able to launch neuron runtime and ONNX Runtime (missing NeuronExecutionProvider)
I am not able to find /usr/sbin/neuronrt and related neuron libraries in Ubuntu
Can you please tell me where to download these missing (python) packages and software component and how I can install them on my Genio 1200 with both Yocto and Ubuntu operating system ?
Here is a quick summary of the Analytical AI framework support on Genio 1200:
On Yocto: both Neuron Runtime and ONNX Runtime are supported.
On Ubuntu: only Neuron Runtime is supported; ONNX Runtime is currently not supported.
For more details about platform support, please refer to the AI Supporting Scope
To run Neuron Runtime on Ubuntu, you will need to install the mtk-neuropilot package from the Snap Store. This page describes how to install NeuroPilot on Ubuntu and walks through the AI workflow.
if 'NeuronExecutionProvider' not in available_providers:
print("Warning: NeuronEP not found. Ensure libonnxruntime_providers_neuron.so is in LD_LIBRARY_PATH.")
selected_providers = \['CPUExecutionProvider'\]
else:
$ python3 ./genio_onnx_inference.py
Available Providers: [‘XnnpackExecutionProvider’, ‘CPUExecutionProvider’]
Warning: NeuronEP not found. Ensure libonnxruntime_providers_neuron.so is in LD_LIBRARY_PATH.
Session creation failed: [ONNXRuntimeError] : 3 : NO_SUCHFILE : Load model from resnet50_optimized.onnx failed:Load model resnet50_optimized.onnx failed. File doesn’t exist
Neuron Runtime is an independent offline inference path that directly executes compiled .dla models on the NPU. The neuronrt command is the CLI tool of this path.
In contrast, online inference is handled by TFLite Interpreter or ONNX Runtime, which delegate execution to CPU / GPU / NPU backends.
For more details, you can check our software architecture page: Software Architecture
[Q2] Does Python ONNX Runtime on Yocto only support CPU?
Yes — on Genio 1200, ONNX Runtime currently supports the CPU backend only.
For the per-platform support matrix, please refer to Supporting Scope on Yocto
To collect performance numbers on the CPU backend, you can run:
[Q2] Does Python ONNX Runtime on Yocto only support CPU?
The current yocto on my Genio 1200 is scarthgap_k6.6_v25.1.1_genio-1200-evk. there seems to be no /usr/share/onnxruntime_benchmark on my genio ?
~# python3 /usr/share/onnxruntime_benchmark/onnxruntime_benchmark.py --auto
python3: can’t open file ‘/usr/share/onnxruntime_benchmark/onnxruntime_benchmark.py’: [Errno 2] No such file or directory
[Q3] neuronrt failure on Ubuntu (snap)
$ snap list mtk-neuropilot
Name Version Rev Tracking Publisher Notes
mtk-neuropilot 7.1+g20250723.e1f31314 10 latest/edge asaly12 -
$ snap info mtk-neuropilot
name: mtk-neuropilot
summary: APU firmware and demo app for Mediatek Genio 1200
publisher: Asal Mirzaieva (asaly12)
store-url: Install mtk-neuropilot on Linux | Snap Store
license: unset
description: |
Enables Mediatek Genio board’s APU and provides a standard “label_image”
demo app to test it.
commands:
Quick correction on my Q2 — I’ve also updated the original reply for the record.
To be precise, on Genio 1200, ONNX Runtime currently supports the CPU backend only. You can check the per-platform support matrix here: Supporting Scope on Yocto
If you are using the scarthgap_k6.6_v25.1.1_genio-1200-evk image, you can verify the CPU backend performance with: