Share your feedback on the AI services experiment in Nightly

[asafko]

Hi folks, 

In the next few days, we will start the Nightly experiment which provides easy access to AI services from the sidebar. This functionality is entirely optional, and it’s there to see if it’s a helpful addition to Firefox. It is not built into any core functionality and needs to be turned on by you to see it. 

If you want to try the experiment, activate it via Nightly Settings > Firefox Labs (please see full instructions here). 

We’d love to hear your feedback once you try out the feature, and we’re open to all your ideas and thoughts, whether it’s small tweaks to the current experience or big, creative suggestions that could boost your productivity and make accessing your favorite tools and services in Firefox even easier.

Thanks so much for helping us improve Firefox!

[PrankishHarmon]

---

@lackey wrote:

a feature that users didn't request

---

Who are these users? This generalised statement sounds biased and echo-chamber-y. The once who don't want this kind of feature will be loudest and most enganged in this thread, not necessarily the majority of Firefox users.

[lackey]

I said users didn't request it.

If you want to see users not requesting it, just look at this whole forum before Mozilla announced the unwanted, un-requested AI feature. 

You're among them. 

[BlorgBlorgBlorg]

There are not any companies operating in the LLM space that meet ethical standards regarding privacy and environmental impact, as you are aware.  Asking anyway creates the illusion that you are open to this feedback, and puts the onus on the person who shared their concerns with you in good faith to waste their time answering.  It would be more honest to either not respond to AI critics at all, or directly tell them you (and Mozilla) don't care about their concerns.

[qu1j0t3]

there is no ethical way to train and run LLMs. it just so happens that the companies you've named are particularly vile.

[everentropy]

That is absolutely not the main concern, it's just the only one you're paying attention to.

[advpod]

No.

Stop adding dumb trendy features. Spend engineering effort on integrating features that have nothing to do with browsing the web into a web browser. If I wanted to use a chatbot, I would install a chatbot app onto my computer. Features that have nothing to do with browsing the web have no place being in a web browser.

[Mardak]

How many people install separate chatbot apps vs access from a web browser? It seems like many people who do use chatbots are already using a web browser and likely manually copy/pasting information from tab to tab.

Your point of non-browser usage is still interesting, so could you provide some more concrete examples?

[Kwonunn]

Then just make it possible for extensions to add sidebar tabs and offer this as an extension! Instead of genuinely adding something useful to Firefox you've just opened Pandora's Box.

[IBBoard]

---

@Mardak wrote:

Your point of non-browser usage is still interesting, so could you provide some more concrete examples?

---

Let's flip it around. Can you provide some concrete examples of where adding this to Firefox is necessary and beneficial over having a separate app or an extension or (heaven forbid) just visiting the chatbot's website directly?

So far there appears to be absolutely nothing compelling about including this. A big company like Mozilla must have a Product Manager. Someone must have seen a user story and said "Yes! This is a killer one that we must spend engineering effort on!". But the huge, overwhelming majority of responses here seem to show that it's a user story that's out of touch with its users.

So what was that user story? What makes it so important? What value is this supposed to unlock that simpler, more ethical, more privacy-preserving and less environmentally damaging approaches can't do?

[eladio77]

Amazing feature. I find the funtion, but when i have active the vertical tabs i can not see the Boton "Chat IA", only i can see it without "Vertical Tabs" active. Can you add the shortcut access to the Vertical Tab menu?

[Mardak]

If you're referring to the new "sidebar.revamp" (with "sidebar.verticalTabs"), you should now have the AI chatbot icon available as shortcut access in today's Nightly.

 

[mcortt]

Very nice! But please add a keyboard shortcut to open it as well.

Edit: I didn't see where you had replied to my earlier suggestion. Please disregard, sorry!

[eladio77]

Thanks..  is working ...

[nclm]

Please Mozilla, don’t get lost. AI chatbots is a very silly feature, and it makes it hard to take you seriously. I know investors love it these days when tech companies integrate anything “AI” in their product, but you’re Mozilla, we all expect you to behave differently and for the good of the users and the web. There is no demand for AI chatbots, only unsolicited offer from the tech world, please don’t be part of this! There is nothing ethical about about offering a feature that is consistently giving misinformation based on stolen data processed on energy and water wasting machines. It would be lovely if you could focus your ressources on actually improving the browser and on communication campaigns to get more users, not on jumping on the latest fad. Thank you ❤️

[Mardak]

Have you found any uses of AI chatbots for your own situation? It sounds like you correctly don't trust the responses, and others with similar concerns can still find value with these tools such as entertainment.

[AdventureGamer]

What is entertaining about weakening the privacy standards of one of the only browsers worthy of respect in the whole internet? I love you Firefox. Please, please, please don't ruin what you have. You'll force me off my only & favorite browser. To be frank, if Firefox becomes Chrome with a coat of paint, I'll bail I swear to god - and I won't be the only one. What will investors say then? You're the last bastion of integrity in the whole game. Don't throw that away...

[Mardak]

Part of the reason for Firefox providing choices is so people can switch to those with better privacy standards. Do you have suggestions for existing providers that should be in the list or are you suggesting that Mozilla should have a service with better privacy?

[BlorgBlorgBlorg]

As you are aware, providers with ethical privacy standards do not exist. It would be more honest to either not respond to AI critics at all, or directly tell them you (and Mozilla) don't care about their concerns.

[MageBunkshelf]

If the matter is choice then make this an extension or don't make it at all. I choose to not associate with this kind of AI tech on ethical grounds. If Mozilla will continue with this plan to integrate this into Firefox then I will choose a different browser, and I say that as a Firefox advocate for over a decade.

[Lenyberry]

It's extremely clear that what everyone here is suggesting is that adding "AI" to your product degrades the privacy standards your users expect. Is it worth destroying your reputation?

[wwahammy]

I would advocate that users avoid Firefox going forward because you can't trust what abusive features they're going to add.

[fournm]

Respectfully, I expect better of Mozilla than encouraging environmental harm for entertainment.

[MageBunkshelf]

So if the reponses these bots give are "correctly" not to be trusted, do you think that some people finding the prompt results "entertaining" is worth the mass data scraping, the plagiarism and theft, and the considerable energy cost required to run these machines? If we're still talking about whether they have a use in the first place when the negatives are staring us in the face, why is this being added as a core feature to the base version of the browser?

If someone at Mozillla is dead-set on making this, then at minimum make it an extension so that people can opt-in to having it on their computer in the first place, rather than directing a mass audience to use an external private tool based on stolen data that *correctly* shouldn't be trusted.

[Lenyberry]

Firefox is a web browser, not a game. People don't want Firefox to entertain them, they want it to do the job they downloaded it for: enable them to browse the internet with relative privacy. Chatbot integration degrades the privacy protection of the browser in, frankly, unacceptable ways.

Those who wish to use a chatbot for entertainment can use the standard web browser functionality to navigate to one on the web.

[wutongtaiwan]

I want the AI chatbot feature, it's free, unlimited and no account login, and there are no geographical restrictions, and I don't want to be blocked because I'm in China

[Mardak]

Are you able to download and run a https://llamafile.ai as that would be free, unlimited and no account login. It runs on your computer, so you don't need internet access to chat, but it could be slow depending on your hardware.

[wutongtaiwan]

It would be even better if AI could be used for search, enabling an open-source AI model locally, and when searching, the AI aggregates the search results and answers them in the form of a human conversation, just like a chatbot

[Mardak]

Are you suggesting the chatbot to look at the search result page content or would you expect Firefox/chatbot visit some linked pages for you? There are AI services that do this like https://perplexity.ai that you could configure as a custom provider and also supports passing in your custom prompts.

[wutongtaiwan]

I want the chatbot to look at the content of the search results page, summarize it based on the content, and answer in human language

[Mardak]

Something like this?

[wutongtaiwan]

yes

[piradata]

Loved the feature, I always have a open tab just for chatgpt, so its a big win, and its nice that it can be disabled or opt in/out for people that don't like it.

What I miss is just a way to simply open the chat on the sidebar, the only way I found is to right click and chose one option in 'Summarize', 'Simplify Language' or 'Quiz Me', but neither of these options can be used to just open a plain clear new chat, and if I close the sidebar, there is no way to open it again on the previous conversation.

What i would suggest, is simply a button on the bookmark toolbar, to simply open close the chat, that would suffice already 🙂

[Mardak]

You can Customize toolbar to add a sidebar toggle button, and the chatbot will open a plain new chat. If you are logged in to some chat providers, you should be able to access previous conversations as well. Potentially Firefox could restore the last conversation, but others might prefer a clear chat, so maybe we could restore when reopening as well as provide a button to start new?

The improved sidebar also has a button to open/close the AI chatbot (as well as other sidebar tools).

[francois79]

Hey

Thanks for the work done.

I do not understand why you plug only onto private llm services where some of them are using private llm 

My ideal is to be able to connect to llm model server such as https://github.com/ollama/ollama
Or https://github.com/vllm-project/vllm
Best through proxies https://github.com/BerriAI/litellm

Is it possible?

[Mardak]

You can configure a custom provider to any url including those running on a local server such as your own computer. At a glance, it looks like there's various web UIs for ollama that can be separately installed, so you could at least have a private chatbot in the sidebar, but I'm not sure if any of them currently accepts passing in prompts. https://llamafile.ai is another llm model server that has a built in web chat interface that accepts ?q=prompt urls.

Potentially Firefox can directly interface with these services to render a custom Firefox chatbot or power non-chatbot experiences instead of currently requiring a web chat interface.

[SpidFightFR-Dev]

Hey guys, i just tried to nightly version, with AI stuff.

Honestly it's good, but it would better fit the standards of privacy Mozilla displays if it was possible to download and run models (E.G: 7b llama3 or Mixtral models) from the web browser (considering the pc running firefox is powerful enough). In a similar fashion of GPT4All.

It would allow for a less-powerfull yet completely offline model execution.

Just food for thoughts, it's similar to the "localhost" approach with locallama, it's not very practical on windows for example, it would require a docker instance running on wsl to make something clean.

Peace - Spid. ✌️

[Mardak]

I believe GPT4All exposes an inference http API but not a chatbot page that could be shown in the Firefox sidebar. Currently Firefox is rendering (potentially local) server-provided html in the sidebar, but we could build our own Firefox chat interface to show the results of inference -- potentially handled directly within Firefox similar to translations and alt-text or a server of your choice such as GPT4All running your preferred model.

Are there any particular use cases that you think must be handled with a local model?

[Anonymous]

This whole thing flies in the face of the Mozilla Manifesto.

[Mardak]

Are there privacy-focused models that you would recommend? This chatbot feature is compatible with locally running llamafile with models that can be trained on data you find acceptable. Even if the quality of these models aren't comparable yet, hopefully we can help others try them out and contribute to these efforts so that we can get them to a quality level to include by default in Firefox.

[ffffff]

I believe the bigger issue to people isn't a perceived lack of ability to use models that are:

• Locally running
• Open source
• Trained on data you find acceptable

Rather, the core issue is that it seems Mozilla is promoting and incentivizing people to run models that are:

• Running on computers they don't own and have no control over
• Closed, proprietary, and in the hands of companies with horrible reputations
• Trained on data that people often find unacceptable or believe was unethically sourced

Furthermore, these models also:

• Consistently fail at delivering information in a safe and trustworthy manner
• Save data you provide them to use in furthering their objectives at the cost of user privacy

Even the Mozilla manifesto—I know it's not a rigid set of internal rules or anything, but just for the sake of argument—boldly states:

• 4. Individuals’ security and privacy on the internet are fundamental and must not be treated as optional.
  
  Throwing unaware users at OpenAI doesn't seem like a good way of protecting their privacy.

Then there are additional concerns, such as the tight coupling with the browser (due to reasonable limitations or not is beside the point), or the fact that Mozilla is, in a manner, endorsing and enabling these companies and their practices.

So it's understandable that this feature just isn't right to a lot of people.

I understand Firefox must remain a competitive browser if it wants to regain market share. I am aware that many are implementing similar features, and nobody wants to fall behind. I know that many users are, in fact, quite excited about this feature. Maybe the developers are, as well. Hell, even I admit I'd love to have a somehow technomagically ethically-sourced and ran LLM helping me around the web.

However, I imagine this is a very sensitive topic for a significant amount of people. There is a lot of frustration with current AI trends and big tech, especially among the most tech-aware users. I think it's safe to assume that if this reaches stable as it is, there will be much valid complaining and criticism towards Mozilla. Either you already knew this, or you didn't think far enough ahead.

Sadly, I'm not sure what's the right answer here. I sincerely hope you folks manage to figure it out.

But asking...

---

@Mardak wrote:

Are there privacy-focused models that you would recommend?

---

...with all respect, seems very tone-deaf considering all this.