Is there a LLM that will work with Rubik Pi 3's NPU?

Canonical Ubuntu
1

Hi, currently Ollama doesn’t work with the built-in NPU. I also find no LLM in A.I. Hub. How do I get acclerated LLM on Rubik Pi 3?

2

There’re examples on our docs portal:

1 Like