llama.cpp 是 Meta 的 LLaMA 模型(及其他模型)的纯 C/C++ 推理实现
MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.
鸿蒙系统上使用Qwen2.5-0.5B进行推理。
A retargetable MLIR-based machine learning compiler and runtime toolkit.