topic Integrate the "AI chatbot" feature with local LLMs and frameworks, e.g. Ollama, WebUI, etc. in Discussions

Integrate the "AI chatbot" feature with local LLMs and frameworks, e.g. Ollama, WebUI, etc.

ntsarb — Wed, 02 Apr 2025 11:07:56 GMT

Hello,

I noticed the "AI chatbot" feature in Firefox, which provides access to public cloud AI chatbots. However, it is now feasible to install a Large Language Model locally, e.g. using Ollama and other frameworks (e.g. WebUI), either on the same computer or on another computer at home (same LAN).

Wouldn't it be great to provide an integration feature of Firefox with our own LLM framework?

Regards

Re: Integrate the "AI chatbot" feature with local LLMs and frameworks, e.g. Ollama, WebUI, etc.

Picpic — Thu, 24 Apr 2025 20:57:53 GMT

Hello,
I confirm, it would be super nice to be able to connect to an ollama server 🙂

Re: Integrate the "AI chatbot" feature with local LLMs and frameworks, e.g. Ollama, WebUI, etc.

devurandom — Thu, 12 Jun 2025 22:55:38 GMT

See-also: https://connect.mozilla.org/t5/ideas/ai-ollama-integration/idi-p/85710

Re: Integrate the "AI chatbot" feature with local LLMs and frameworks, e.g. Ollama, WebUI, etc.

sf1tzp — Tue, 08 Jul 2025 08:10:31 GMT

There is an awesome suggestion in that thread ^

If you have Open WebUI (or SillyTavern or something) running, you can just put the URL into browser.ml.chat.provider in about:config.
The sidebar just loads and displays a webpage (ChatGPT or whatever) anyway.

You need to run a UI for Ollama at the moment but that feels like a reasonable compromise. It works for me at least.