How do we enable ORT-GenAI capabilities on Genio platform? Is it part of the sdk similar to onnxruntime libraries or is there a shared binary that we can get access to, since officially ORT-GenAI does not provide wheel files for aarch64 targets?
Are there any examples for using Phi-family models or TTS models using ORT-GenAI on Genio?
Thank you for your inquiry.
Currently, MediaTek does not have plans to support ORT-GenAI on the Genio platform.
For Generative AI (GAI) workloads, Genio platform offers support via the Neuropilot GAI Toolkit, which is based on the TensorFlow Lite (TFLite) framework. This toolkit is currently available only for Genio 520 and Genio 720 devices. Official support for other devices and broader model compatibility is not available at this time.
Please refer to the Neuropilot Official Documentation for the latest updates regarding GAI model support. Note that current support is partial, and the comprehensive GAI supporting list for Genio 520/720 is scheduled for release by the end of September 2025.
There are no official examples or validated workflows for using Phi-family models or TTS models via ORT-GenAI on Genio. All supported GAI models and toolchains are managed through the Neuropilot framework.
MediaTek will continue to update the official resources as new features and supported models become available.