Opera, the innovative web browser, has just introduced a groundbreaking feature.
The browser now has the ability to download and run Large Language Models (LLMs) directly on your personal computer.
This exciting development opens up a whole new dimension of possibilities for users, ushering in a potential new age of browser-based AI integration.
What are LLMs and why do they matter?
LLMs are complex AI models trained on massive amounts of text data. They have the ability to generate remarkably human-like text, translate languages, write different kinds of creative content, and answer your questions comprehensively.
Some popular examples include:
Opera’s local LLM initiative
Opera is now roviding access to a vast selection of third-party LLMs directly within the browser. Users can explore a library of over 150 models across more than 50 families. The availability of popular options such as Meta’s Llama, Google’s Gemma, and Vicuna places significant AI power within the hands of everyday users.
Downloading and using LLMs in Opera is a three-step process:
- Ensure you’re on the right Opera version: Downloading LLMs locally requires either the “Opera One” version (for developers) or a browser that gives you access to Opera’s experimental “AI Feature Drops Program.”
- Discover your LLM: Navigate to Opera’s LLM library and browse the available models. There’s something for everyone, with models specializing in different tasks.
- Download and activate: Once you’ve selected your desired LLM, initiate the download process. Keep in mind that these models can take up several gigabytes of hard drive space. Once downloaded, activate your chosen LLM within the browser.
By running an LLM locally, you get:
- Enhanced privacy: Running the model locally means your data and interactions don’t leave your device, offering greater security.
- Offline functionality: Use the LLM even when an internet connection is unavailable.
- Customization options: Experiment with different models that suit your specific needs and preferences.
Opera’s ability to run LLMs locally opens a world of new possibilities in AI-powered browsing experiences. As these models continue to evolve, we can expect even more creative and useful integrations that augment the way we interact with the web.
Stay tuned for further developments in this exciting space as Opera continues to push the limits.
Featured image credit: Opera
