

Thank you!
Small tips:
- for the uninitiated: up and does arrows navigate the bash (session) history
- I did not like the verbosity of ollama server so instead of the aforementioned command, I did
chmod 777 /dev/
(not safe) because for some reason I was access denied andollama serve > /dev/null 2>&1 &
. Which basically means that all info, warning and errors will not be displayed. Not recommended in case you want to see what’s going on and in case of errors.
Looks impressive and it’s truly open-source.
However, I see it requires CUDA. Could it run anyway: