Chrome looks set to ship an LLM Prompt API to the web platform.

[techienotnetie@social.vivaldi.net]

@wcbdata @firefoxwebdevs @Vivaldi We have been disabling Gemini (GLIC) at compile-time for a while (and we needed to redo that recently after the Chromium team removed all the ifdefs). Several others features are disabled by overriding the "Is this feature enabled?" logic, and in this case, AFAICT this particular API depends on a component that is already disabled that way. (Actually disabling the code for most of those features when building would require hundreds of large and small patches, which would be a maintenance nightmare; I just tried that last week.)

[sterpeto@social.vivaldi.net]

@firefoxwebdevs w3m and lynx our only hopes.

[rafaelmartins@mastodon.social]

@firefoxwebdevs it is too late to pretend that you care...

[wcbdata@vis.social]

@TechieNotNetie @firefoxwebdevs @Vivaldi Excellent - thank you!

[firefoxwebdevs@mastodon.social]

@rafaelmartins I raised these same concerns in a podcast two years ago, before I joined Mozilla https://offthemainthread.tech/episode/chromes-llm-ai-api-omg/

So if this is pretend, then wow I'm really committing to the bit.

[marc_eu@veganism.social]

@yoasif @yokhai
'None' is incorrect.

I just did a fresh install of FF. AI is off by default.

FF has local LLM's like for translation. More will follow (can't find the article about that now).

But yes, *as an option* you can also add third-party LLM's (online).

And link previews:
"Optionally, you can also use AI to read the beginning of the page and generate a few bullet points. To prioritize your privacy, the AI works on your device. This means you’ll need at least 3 GB of available RAM to use the optional AI."

Keywords: 'optional' and 'local'.

On-device AI models in Firefox | Firefox Help

Learn what on-device AI models are and how you can manage them.

(support.mozilla.org)

Preview webpages in Firefox with link preview | Firefox Help

Learn how to preview links in Firefox, use AI-generated key points and manage link preview settings.

(support.mozilla.org)

[yoasif@mastodon.social]

@marc_eu @yokhai None of the LLMs that could serve Google's "Prompt API" proposal to the web platform is local in Firefox.

Context matters.

[marc_eu@veganism.social]

@yoasif @yokhai
Yeah context.

If you would have read what I was responding to, then you could have known what the context of my response was.

You are the one who jumps out of context.

But let's end it here. Agree to disagree.

#noAI #firefox

[yoasif@mastodon.social]

@marc_eu @yokhai You said that Mozilla is focusing on local LLMs, which is obviously not true, and it doesn't even make contextual sense, since none of the local LLMs in Firefox can serve a prompt API, since they don't respond to prompts.

It isn't "agree to disagree" -- your response was to a comment about chatbots that could respond to prompts - unlike the local LLMs that do not.

[rafaelmartins@mastodon.social]

@firefoxwebdevs this is a corporate account, not a personal account. of course there are people at mozilla that care about stuff, but either they are a minority, or they are not loud enough. mozilla as a corporation let me down enough times, I trust you guys less than I trust microsoft, google or apple at this point, and my level of confidence on them is very, very low.

[michi101@mastodon.social]

@firefoxwebdevs I get the interop trouble, but sad that you can only access the local models more and more devices have by shipping an app to the app store