Opera Introduces Local Large Language Model Downloads in Browser
Opera, the renowned web browser company, has unveiled a groundbreaking feature that allows users to download and utilize Large Language Models (LLMs) directly on their local devices. This innovative functionality is initially being rolled out to Opera One users who are part of the developer stream updates, granting them access to a vast selection of over 150 models from more than 50 families.
Extensive Model Selection
The available models encompass a wide range, including Meta’s Llama, Google’s Gemma, and Vicuna. These models are being offered to users through Opera’s AI Feature Drops Program, which aims to provide early access to cutting-edge AI capabilities.
Ollama Open-Source Framework
To facilitate the local execution of these models, Opera has integrated the Ollama open-source framework into its browser. Currently, the accessible models are a subset of Ollama’s extensive library. However, the company has expressed its intention to expand the selection by incorporating models from various sources in the future.
Image Credits: Opera
Storage Considerations
It is important to note that each model variant can occupy more than 2GB of storage space on the user’s local system. Opera advises users to be mindful of their available storage to prevent running out of space. The company has not implemented any measures to optimize storage during the model download process.
“Opera has now for the first time ever provided access to a large selection of 3rd party local LLMs directly in the browser. It is expected that they may reduce in size as they get more and more specialized for the tasks at hand,” Jan Standal, VP, Opera told The Zero Byte in a statement.
Image Credits: Opera
Alternative Online Tools
While this feature is valuable for users who wish to test various models locally, there are alternative online tools available for those looking to save storage space. Platforms like Quora’s Poe and HuggingChat offer the opportunity to explore different models without the need for local downloads.
Opera’s AI Journey
Opera has been actively exploring AI-powered features since the previous year. In May, the company introduced Aria, an AI assistant located in the browser’s sidebar, and later expanded its availability to the iOS version in August. Furthermore, in January, Opera announced its plans to develop an AI-powered browser with its own engine for iOS, following the EU’s Digital Market Acts (DMA) requirement for Apple to allow mobile browsers to use engines other than WebKit.
5 Comments
Privacy just got an upgrade, and Opera’s the chef cooking with local LLM downloads!
Opera’s making moves with local LLM downloads – who knew privacy could get an upgrade?
Opera’s stepping up its game with local LLM downloads, privacy enthusiasts rejoice!
Opera just threw a privacy parade, and guess who’s leading the march? Local LLM downloads!
Privacy’s got a new best friend and its name? Opera, with its fresh take on local LLM downloads!