Should Open WebUI be an application? Or is next clouds AI implementation as good as Open WebUI? I was going to point Open Web UI to an Ollama instance on another machine in my home network.
You mean this: GitHub - open-webui/open-webui: User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
Not bad actually, I will check after finishing MeshCentral app.
1 Like
Packaging right now!
Done, it uses CPU if no GPU drivers are installed.
Was able to use my old Nvidia with 2g ram with small models (less than 1b) with this doc: GPU · syncloud/platform Wiki · GitHub
Thank you so much! This really simplifies having SynCloud as my front end and my gaming PC doing the compute without being exposed to the internet
1 Like
Let me know how it goes, I am thinking about adding GPU drivers into the image by default to simplify things going forward. So if you have any issues installing them I can give a new image, but it depends on GPU you have.