Qualcomm, a renowned mobile technology company, is increasing its commitment to AI development for Arm-based Snapdragon chips. In an effort to empower developers, the business has launched a ground-breaking initiative: the Qualcomm AI Hub. This complete platform provides developers with access to a large repository of over 75 rigorously curated AI models, as well as the necessary tools to harness the powerful on-device AI capabilities built into Qualcomm’s chips.
The AI Hub is a game changer for developers who want to leverage the capabilities of on-device large language models (LLMs) across a range of Snapdragon SoCs. Qualcomm has extensively examined and verified these models, which span a variety of areas such as mobile, Windows on Arm, and IoT. The notable models include Stable Diffusion, Whisper, ControlNet, Baichuan 7B, LlaMA 2, and the crown jewel, LLaVA.
Webinar: Generative AI at the edge
LLaVA is a formidable multimodal LLM with over 7 billion parameters, representing a quantum leap in on-device AI computation. This model is designed to accept both textual and visual inputs and is optimised for Snapdragon 8 Gen 3 CPUs, which can support models with up to 10 billion parameters. Meanwhile, Snapdragon 8 Gen 2 CPUs provide comprehensive support for models with up to 7 billion attributes. In comparison, Google’s Gemini Nano, a powerful competitor, comes in two configurations with 1.8 billion to 3.6 billion parameters.
The Qualcomm AI Hub is more than just a collection of AI models; it’s a dynamic ecosystem that aims to speed the creation of cutting-edge AI solutions. Developers can access a wealth of tools, including training programs, tutorials, and extensive documentation. These tools are extremely useful for optimising applications that rely significantly on machine learning, deep learning, and computer vision.
With the generative AI revolution in full gear and the competition to embrace this transformative technology gaining traction, Qualcomm’s proactive approach is admirable. By providing developers with the required tools and resources, the company is positioning itself as a leader in the rapidly evolving AI landscape.
In essence, Qualcomm’s AI Hub ushers in a new era of innovation, allowing developers to fully realise the potential of on-device AI processing. As the demand for AI-powered solutions grows, Qualcomm’s constant commitment to aiding AI development emphasises its critical role in determining the future of mobile technology.