Let the AI model Firefox uses be directed to a local LLM server.

[GalacticViper]

I know public sentiment for AI is not great right now, but personally I don't see a problem with it and I like that Firefox is adding it, especially because it's not in your face the way other browsers have it.
I recently switched to Firefox from Edge because the AI push was too great with Copilot (and I thought that even though I was one of the few people who actually enjoyed using Copilot)
I immediately liked that Firefox let me pick from multiple different cloud provided AI models and I'm not stuck with using whichever one you pick for me.
I've started self-host my own local LLM server using Ollama and OpenWebUI, and I think it'd be great if I could select my own models to be used in Firefox from the list instead of just the major cloud provided ones.
Obviously not a priority feature, but something to think about nonetheless.

[Jon]

Thanks for submitting an idea to the Mozilla Connect community! Your idea is now open to votes (aka kudos) and comments.

[MATTILDA]

Utilizing notes for employee & patients 

[Dark_Ronius]

I'd love this to be enabled by default. If you're comfortable with and able to use about:config, you can actually enable this by:

*Browsing to about:config
*Search for "browser.ml.chat.hideLocalhost"
*Double click it to change it to "false"
*Restart Firefox

It defaults to localhost:8080, and seems to keep resetting to that whenever I switch AI models in the sidebar. I solved this by changing my Open WebUI port to 8080. And it works brilliantly after that, and integrates with all the in-browser AI features (e.g. summarise)

[lkiesow]

---

f you're comfortable with and able to use about:config, you can actually enable this

---

Kind of. But in a very limited way. You can only connect to your local machine. Not to an API that is running somewhere else (on your (home) server, on your companies' server, …).

I find that a bit weird since Mozilla always positions itself as privacy first, but here all suggestions are external companies. What I would like to see is to have a “Custom LLM” button at the end of the “Choose an AI chatbot…” dialog where I'm asked for an API endpoint and (optional) an API key. That would allow users to easily connect to custom LLMs regardless of where they are running.

[Mr_Jet]

Does Firefox AI same with duck.ai from duckduckgo..? Or its like lumo ai that have own server...? I mean base of my research I dont see a properly explanation of how the AI works just said the functions but not the real deal DDG AI said it that duck.AI is a middle man AI that remove IP And other telemetry that could Identify a person then duck.ai send he script to the LLM platform, then the LLM answer the duck.ai question once duck.ai receive the answer duck.ai show it to the user. So I was thinking if firefox Ai is same with it ...? But if so the Identifier will be removed if the firefox AI connect to some LLM platform...? But still the danger i see is that AI can summaries page and website and isnt that more danger than plain text ...? Duck.ai only view text promt then pass to LLM, while firefo. ai can see a page or website then summaries it using a LLM...? isnt that like fingerprinting with a style ...? 🤔🤔