topic Re: Integrate the "AI chatbot" feature with local LLMs and frameworks, e.g. Ollama, WebUI, etc. in Discussions

Integrate the "AI chatbot" feature with local LLMs and frameworks, e.g. Ollama, WebUI, etc.

ntsarb — Wed, 02 Apr 2025 11:07:56 GMT

Hello,

I noticed the "AI chatbot" feature in Firefox, which provides access to public cloud AI chatbots. However, it is now feasible to install a Large Language Model locally, e.g. using Ollama and other frameworks (e.g. WebUI), either on the same computer or on another computer at home (same LAN).

Wouldn't it be great to provide an integration feature of Firefox with our own LLM framework?

Regards

Re: Integrate the "AI chatbot" feature with local LLMs and frameworks, e.g. Ollama, WebUI, etc.

Picpic — Thu, 24 Apr 2025 20:57:53 GMT

Hello,
I confirm, it would be super nice to be able to connect to an ollama server 🙂

Re: Integrate the "AI chatbot" feature with local LLMs and frameworks, e.g. Ollama, WebUI, etc.

devurandom — Thu, 12 Jun 2025 22:55:38 GMT

See-also: https://connect.mozilla.org/t5/ideas/ai-ollama-integration/idi-p/85710

Re: Integrate the "AI chatbot" feature with local LLMs and frameworks, e.g. Ollama, WebUI, etc.

sf1tzp — Tue, 08 Jul 2025 08:10:31 GMT

There is an awesome suggestion in that thread ^

If you have Open WebUI (or SillyTavern or something) running, you can just put the URL into browser.ml.chat.provider in about:config.
The sidebar just loads and displays a webpage (ChatGPT or whatever) anyway.

You need to run a UI for Ollama at the moment but that feels like a reasonable compromise. It works for me at least.

Re: Integrate the "AI chatbot" feature with local LLMs and frameworks, e.g. Ollama, WebUI, etc.

robertwilliam_0 — Sat, 29 Aug 2026 09:24:44 GMT

I think local LLM integration would be a valuable addition to Firefox’s AI chatbot capabilities. Tools such as Ollama make it possible to run models locally, which could give users more control over their data and reduce the need to send sensitive prompts to cloud-based services.

It would be interesting if Firefox could connect to a locally running LLM through a configurable API endpoint, allowing users to choose their preferred model or framework. This could also make the AI chatbot useful in environments where privacy, offline access, or control over the underlying model is important.

A flexible integration layer supporting local and cloud-based models could give users much more choice while keeping privacy as a key advantage.