cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

Share your feedback on the AI services experiment in Nightly

asafko
Employee
Employee

Hi folks, 

In the next few days, we will start the Nightly experiment which provides easy access to AI services from the sidebar. This functionality is entirely optional, and it’s there to see if it’s a helpful addition to Firefox. It is not built into any core functionality and needs to be turned on by you to see it. 

If you want to try the experiment, activate it via Nightly Settings > Firefox Labs (please see full instructions here). 

We’d love to hear your feedback once you try out the feature, and we’re open to all your ideas and thoughts, whether it’s small tweaks to the current experience or big, creative suggestions that could boost your productivity and make accessing your favorite tools and services in Firefox even easier.

Thanks so much for helping us improve Firefox!

3,364 REPLIES 3,364

avakining
Making moves

All generative "AI" is bad. I don't want it in my browser, OS, or anything I own.

Generative "AI" is a fad that is yet to be useful for anything -- it provides falsehoods as if they were fact and scrapes private data to train.

Adding "ai" features to Firefox not only misunderstands what people want their browsers to be for, it also detracts time and money from improving Firefox itself.

If this is kept, I will have to assume that FF is a lost cause and move to another browser.

Yes, depending on the model, hallucinations or misunderstanding can be quite frequent, but even then, some people find value in having an optional AI feature readily available for situations where this type of creativity is helpful.

This feature allows for people to configure any provider and model, so hopefully we can help increase interest in training without scraping private data.

This is a terrible standpoint to take. By adding this functionality despite openly admitting that the current available options have gross ethical problems you are not promoting the idea that any of these ethical issues should be resolved, you are signaling that you consider those ethical issues to be secondary to hopping on the bandwagon. Until they can be independently verified to address all basic ethical concerns regarding AI features, none of these things should come anywhere close to being integrated by default.


@Mardak wrote:

[...]

This feature allows for people to configure any provider and model, so hopefully we can help increase interest in training without scraping private data.


Yeah, but the ones you’ve specifically included as default options are models that do use irresponsibly scraped data. So, the message you’re sending is that you approve of rampant content theft.

This sucks.

If this feature is just for "some" people who find it helpful, then this can be an extension, not a base feature. Why is your stated goal here to "increase interest in [model] training"? So this "feature" is just advertising for the plagiarism machine? Why are you adding adverts for unethical technology into the base version of the browser?

"Hallucinations" and misunderstandings" is in and of itself a misunderstanding of how LLMs work. They aren't factbots. They don't "know" things. They predict what text sounds like a plausible sentence. That's ALL they do. If they ever tell you the truth it's purely by coincidence.

Liz
Making moves

real happy firefox is tanking its reputation for something that in your own words has a problem where "hallucinations or misunderstanding can be quite frequent".

i'm really hoping you get a good paycheck before this browser tanks for shattering user base trust.

Mardak, listen. Listen, man.

'Hallucinations' is a specifically chosen word meant to anthropomorphize an advanced autocorrect program. LLM chat bots do not know anything. There are no personalities or people involved. There is no hallucination. It is JUST predicting text, and that text is wrong over half the time. It is JUST a misinformation generation machine. The hype is already crashing. Stop while the hole you're digging isn't too deep.

And I shouldn't even need to say this, but there is no creativity in a LLM or an image generation program. None. There is no creativity. There is no helping people be creative. It is physically, at a base level, incapable of creativity. Arguing with that point demonstrates a misunderstanding of how these programs work.

Dan3000
Making moves

Please allow the usage of containers in the Sidebar. I don't want to be logged in to one of the AI API providers without isolating it to some specific container.

Currently the AI Chatbot in the sidebar reuses the same regular tab container, so if you want to also use a different account for the same provider, you can open that in a different container. Do you have a particular provider you're wanting to use with multiple accounts? I currently have a personal and work ChatGPT account that I use Firefox containers to access both at the same time, but I do currently need to keep in mind which one I log into in a container vs regular tab.

Or are you not using multiple accounts and dislike how the feature reuses your logged-in state from regular tabs? At least for ChatGPT in the US, this could be useful for using the logged-out experience.

I'm not sure if I understand, are you saying that the sidebar uses the container of the tab from which it was launched?

marcobassetto
Making moves

I can't use it as it currently breaks Sideberry

Same here 😞 That's a bummer. It would be nice if we could have sideberry on the left and the AI on the right.

Or just to have native horizontal tabs again 😉

What do you mean by native horizontal tabs? Turning on AI Chatbot with or without Sideberry still has the normal tabs at the top for me.

Oh yes I meant vertical tabs 😞

I thought of them as horizontal because it's still a horizontal bar 🙂

How is Sideberry broken? Or more that you need to keep switching between AI Chatbot and Sideberry sidebar panels? It seems like Sideberry at least has a keyboard shortcut to switch back to it.

I need to keep switching between the AI Chatbot and Sideberry sidebar. If there's a way to open/close the AI Chatbot with a button it would be nice

When you have a sidebar open whether it's Sideberry or AI Chatbot, there should be a dropdown towards the top to switch which sidebar is open as well as a close X button. You can also customize the toolbar to add a "Show sidebars" button to toggle your last sidebar open and close.

Alternatively, is the chatbot feature still useful for you if you change `browser.ml.chat.sidebar` so that the chatbot opens in a regular tab instead of sidebar? This would be useful for starting chats from the selected text and saved prompts, but not as useful for side-by-side comparisons. You can still also open the chatbot in the sidebar if you want a fresh chat without prompt.

k2662
Making moves

You can't run a local llm on the Ai chatbot UI. Can this feature be added?

Are you talking about running a LLM directly in Firefox or using local chatbot providers? There's existing configuration that others here have gotten llamafile or ollama working in the sidebar including passing in prompts. Firefox alt-text generation for pdfjs supports running various models including LLMs, so there's a path to doing it within Firefox, but currently it's quite slow. If people do want to try this out on Nightly, we can look into exposing this at least for advanced users with sufficient hardware.

k2662
Making moves

That would be nice, Thank you.

pod-person
Making moves

I just got this feature in Firefox 130 and made an account specifically to post my feedback:

No.

I would like to know specifically who asked for this feature in its current state. There are problems others have stated here about quality issues and environmental issues of generative AI, which are all valid, but in my opinion, the bigger issue here is that you are integrating privacy-intrusive LLMs into a browser that has a good reputation for its strong privacy standards. In layman's terms, by implementing this, you are eroding the ethos of your browser. This is a recipe for disaster and you need to pivot ASAP. The fact that you are even throwing around ideas of integrating AI with people's browsing activity is not good if it's going to be with proprietary models that run in the cloud. You implemented this feature in a time when Microsoft is getting absolutely flamed for their integration of AI into Windows and their poor handling of it from a security and privacy standpoint. What you should have done is taken a step back after news of that broke and thought "How can we implement AI in a way that's not invasive to the privacy of our users and doesn't get in the way for users who don't want it?"

In my opinion, here is what needs to be done in order to right this wrong:

  1. Remove functionality that connects to any chatbot not hosted on the user's own computer.
  2. Implement a LLM that runs entirely locally on the user's PC. No exceptions.
  3. Keep it OFF by default. If people want it, they'll know where to find it.
  4. Once it's more tightly integrated into Firefox, give users absolute control over what data is being processed by the locally-run LLM. Keep the amount of data it processes minimal. People will be up in arms if you don't.

If these things are done, the AI people will be happy and the privacy people will be happy.

You need to fix this as soon as possible otherwise Firefox is going to get a metric ton of bad PR. This is a disaster in the making.

If you are on a debian / apt machine, you can add a file to /etc/apt/preferences.d to revert and pin Firefox to version 129. Will either solve the problem or at least give you time to find other alternatives.

How is that easier than just leaving the feature turned off?

If the feature is present on the system, you need to monitor whether future updates will "magically" enable it against your will.  If the feature is never installed in the first place, that concern becomes a non-issue.

Aside from that, if there is a continuum between easy & convient vs private & secure, many of us will lean much further towards the security end of that spectrum.

I would also be wary of anyone trying to sell easy and convient.  They often don't fully understand the problem domain and are up to some shady marketing.

Refs:

The implication that staying with an older piece of software is more secure is laughable. By staying on 129, you would be missing out on security patches introduced from 130 onward. That much should be obvious, and yet you tout this as being more "secure".

Realistically, there are two ways you could be doing this if you wanted to do it right:

  1. Use a fork that has this feature removed
  2. Switch to an ESR release that comes from before 130

It's hypocritical to say that you want more security whilst deliberately running outdated software. Consider one of the above options and stop giving people advice that makes their systems worse.

Julia05
Making moves

Please don't add A.I. to the search engine. I specifically started using firefox to get away from the A.I. searches. If you start using A.I, I'm moving search engines again.

S_Akash
Making moves

I think it would be helpful to have a short description of each Chatbot, how they compare with each other, which of them Mozilla believes meets ethical standards (both for end user and everyone in general) and only include those by default which do.

Also a disclaimer about AI Chatbots in general would be helpful (or at least about the current generation). How they can help, some example use cases, what issues they have, what harms they might cause on a personal and societal level, and leave it to the user to then proceed to use the bot if they want.

 

I understand the need for Firefox to stay relevant (even if it has to do what other browsers shamelessly do even with large market shares), but providing additional information for the people who would read it is always a good thing in my personal opinion. 🙂

gively
Making moves

please add ai chat button on toolbar items.

barinov274
Making moves

Cool! I would like you to also add the ability to use local llms, for more privacy, such as the ability to select llamafile, or to refer to the ollama api. I would also like to have the ability to work with images on the page, using the "screenshot" function in the browser, or selecting from a file.

And in general, more AI - better. You could make the ability to recognize text on the picture, speech recognition, auto translation, creation of subtitles, etc. The main thing is to be able to run it all locally on your pc, and that the models are not loaded into the memory, until the user does not wish.

mobilex1122
Making moves

Good and bad idea. I would like it if there was option for Ollama selfhosted ai. (Or any other selfhosted options)

mawn
Making moves

can we edit the prompts after selecting the text? like instead of summay" => "translate"

QQueso
Making moves

strongly, strongly, STRONGLY against AI and chatbot inclusion to Firefox. They're inaccurate, their energy requirements are bad for the environment, and frankly they're just useless outside of a research setting.

fournm
Making moves

Incredibly strong disapprove, to the point of setting up a Connect account.

shatteredsword
Making moves

honestly mozilla is lucky that firefox doesn't really have any competition when it comes to privacy-based browsers. This would have been the end of it otherwise, and I'm not sure that they realize it.

Thanks. But don't waste time for these comment like this

Thanks. But don't waste time for these comment like this.

Noaiplease
Making moves

I do not want generative AI included in Firefox in any way. Not only do I find generative AI to be morally questionable at best, it is a feature that is often incorrect and actively worsens the user experience. If it is added in full I will be considering switching search engines.

askabaz
Making moves

Can you also provide DuckDuckGo AI Chat (https://duck.ai/ or https://duckduckgo.com/?q=Duck+Assist&ia=chat)? I tried to implement it by modifying the string "browser.ml.chat.provider" but it doesn't work.

Edit: I tried to set "browser.ml.chat.provider" to "https://duckduckgo.com/?q=&ia=chat&bang=true": It works but it is very easy to get the error "Search query entered was too long. Please shorten and try again.".

DDG AI Chat weirdly doesn't work if the search query ("q=" part in the URL) is empty. On a quick test, it seems to work for me setting it to https://duck.ai or https://duckduckgo.com/aichat.
The layout is slightly broken (weird horizontal scrollbar) but that seems to be DDG's fault, not Firefox.

EDIT: I see what you mean now. If I ask it to summarize info for example, I get that error message too. I don't know if there's a way to make it work by editing the config strings... 🤔