Wrote a custom C++ engine for MiniCPM-V 4.6 on Orange Pi AIPro (Ascend 310B) to bypass framework overhead
·
0 reactions
·
0 comments
·
23 views
Original article
r/LocalLLaMA
Anonymous · no account needed