How to obtain libmtk_llm.so for building inference main on Genio 720?

NeuroPilot NeuroPilot - GenAI
, ,
1

I am using Genio 720/520 (MT8391/mt8189) with GAI Deployment Toolkit v2.0.8 for Qwen2.5-0.5B. I need to build the inference main executable but libmtk_llm.so is missing from the toolkit. Could you provide the prebuilt libmtk_llm.so or the complete prebuilt main binary for Genio 720/520?"

3

Hi B_O_Long,

Thanks for reaching out!

libmtk_llm.so is generated during the build. Just run:

GAI-Deployment-Toolkit-v2.0.8_qwen2.5-0.5b-1.5b-7b-v0.1/inference/build_all.bat

For more details, refer to the section:
Building the Executable and Pushing to the Device

Best,
Jun