So Tree Tabs built in? I've used them for so long, I don't know how other manage without them. Yet I know no one else who uses them, even after I show them. Be interesting see how well the new built in ones work.
If you're here because of the AI headline, this is important to read.
We’re looking at how we can use local, on-device AI models -- i.e., more private -- to enhance your browsing experience further. One feature we’re starting with next quarter is AI-generated alt-text for images inserted into PDFs, which makes it more accessible to visually impaired users and people with learning disabilities.
They are implementing AI how it should be. Don't let all the shitty companies blind you to the fact what we call AI has positive sides.
The term is so overused and abused that I'm not clear what they're even promising. Are they localizing a LLM? Are they providing some kind of very fancy macroing? Are they linking up with ChatGPT somehow or integrating with Co-pilot? There's no way to tell from the verbage.
And that's not even really Mozilla's fault. It's just how the term AI can mean anything from "overhyped javascript" to "multi-billion dollar datacenter full of fake Scarlett Johansson voice patterns".
there are language models that are quite feasible to run locally for easier tasks like this. “local” rules out both ChatGPT and Co-pilot since those models are enormous. AI generally means machine learned neural networks these days, even if a pile of if-else used to pass in the past.
not sure how they’re going to handle low-resource machines, but as far as AI integrations go this one is rather tame
Eh, I don't particularly care too much either way. It seems to be solving problems with the 80/20 approach: 80% of the benefit for 20% of the effort. However, getting that last 20% is probably way more difficult than just building purpose-built solutions from the start.
So I'm guessing we'll see a lot more "decent but not quite there" products, and they'll never "get there."
So it might be fun to play with, but it's not something I'm interested in using day-to-day. Then again, maybe I'm completely wrong and it's the best thing since sliced bread, but as someone who has worked on very basid NLP projects in the past (distantly related to modern LLMs), I just find it hard to look past the limitations.
It is. Unfortunately it does tend to use up a lot of RAM and requires either a fairly fast CPU or better yet, a decent graphics card. This means it's at least somewhat problematic for use on lower spec or ultraportable laptops, especially while on battery power.
That's all fine and good but Firefox on Android is currently in a sorry state. No per-site process isolation, buggy, can't keep tabs open, slow, choppy, drains battery. Had to uninstall it on my brand new Galaxy S24+ and my Pixel 6 Pro because it was draining so much battery. When are you going to finally stop ignoring Firefox Android, Mozilla?
I do not know why browser makers like Opera or Brave(and now apparently Firefox) is going hey ho over AI. I don't see a proper benefit of integration of local AI for most people as of now.
As for vertical tabs, Waterfox got it just now. It is basically a fork of Tree Style Tabs and very basically implemented. I am honestly happy with TST on Firefox and while a native integration might be a bit faster(my browser takes just that few extra seconds to load the right TST panel on my slow laptop), it'll likely be feature incomplete when compared to TST.
It depends. I really liked Mozillas initiative for local translation - much better for data privacy than remote services. But conversational/generative AI, no thank you.
AI-generated alt-text for images inserted into PDFs
Sounds more like classification so far. Things like summarising web-pages would be properly generative, LLMs in general could be useful to interrogate your browsing history. Doing feature extraction on it, sorting it into a graph of categories not by links, but concepts could be useful. And heck if a conversational interface falls out of that I'm not exactly opposed, unlike the stuff you see on the net it's bound to quote its sources, it's going to tell you right-away that "a cat licking you is trying to see whether you're fit for consumption" doesn't come from the gazillion of cat behaviour sites you've visited, but reddit. Firefox doesn't have an incentive to keep you in the AI interface and out of some random webpage.
This is what Mozilla should have done a LONG time ago - focussed on browser features, ease of use, compatibility and speed. Make a better browser if you want to win a browser war.
We’re looking at how we can use local, on-device AI models -- i.e., more private -- to enhance your browsing experience further. One feature we’re starting with next quarter is AI-generated alt-text for images inserted into PDFs, which makes it more accessible to visually impaired users and people with learning disabilities. The alt text is then processed on your device and saved locally instead of cloud services, ensuring that enhancements like these are done with your privacy in mind.
IMO if everything’s going to have AI ham fisted into it, this is probably the least shitty way to do so. With Firefox being open source, the code can also be audited to ensure they’re actually keeping their word about it being local-only.
Nope, they can use your NPU, GPU or CPU whatever you have.. the performance will vary quite a bit though. Also, the larger the model the more memory it needs to run well.
With it being local it’s probably a small and limited model. I took a couple courses on machine learning years ago (before it got rebranded as “AI”), and you’d be surprised at how well a basic image recognition model can run on the lowest-spec macbook from 2012.
Tbh the inversion of typical intuition that is LLMs taking orders of magnitudes more memory than computer vision can mess people unfamiliar up on estimates of the hardware required
While I dislike corporate ai as much as the next guy I am quite interested in open source, local models. If i can run it on my machine, with the absolute certainty that it is my llm, working for my benefit, that's pretty cool. And not feeding every miniscule detail about me to corporate.
I mean that's that thing. They're kind of black boxes so it can be hard to tell what they're doing, but yeah local hardware is the absolute minimum. I guess places like huggingface are at least working to try and apply some sort of standard measures to the LLM space at least through testing...
