Published on November 8, 2023, 4:12 pm
Qualcomm has recently unveiled two powerful new processors that excel in generative AI, catering to laptops and phones respectively. As the potential applications of artificial intelligence continue to expand across various media formats, having faster processing capabilities on our own devices is becoming increasingly important.
The Snapdragon X Elite is Qualcomm’s latest laptop processor, boasting exceptional CPU performance for Windows laptops, as well as impressive GPU speed. On the other hand, for phones, the Snapdragon 8 Gen 3 outperforms its predecessor with a 30% increase in speed while consuming 20% less energy from the battery.
While CPU and GPU specifications are crucial, Qualcomm emphasizes the AI processing power with its latest chip release. These chips have been optimized by Qualcomm, enabling several generative AI models to run locally on Snapdragon laptops and phones. Comparing against competitors like Intel, AMD, and Apple, Qualcomm claims outstanding results.
In terms of AI performance, the new Snapdragon X Elite chips provide an impressive 45 TOPS (trillions of operations per second) on INT4 AI benchmark tests. Additionally, they achieve a rate of 30 tokens per second on Meta’s advanced Llama 2 AI model. According to Qualcomm’s claims, this is 4.5 times faster than competitors. Meanwhile, the Snapdragon 8 Gen 3 can process up to 20 tokens per second and offers real-time segmentation for object separation in images and stable diffusion for image generation within a second.
Moreover, the Snapdragon X Elite has the capability to execute generative AI models with 13-billion parameters on-device. For phones powered by the Snapdragon 8 Gen 3, it can handle models with up to 10 billion parameters. Durga Malladi – Qualcomm’s senior vice president and general manager of technology planning and edge solutions – stated that the Snapdragon 8 Gen 3 is the first chip supporting multi-modal capabilities (including images and text) for phones.
Apart from raw performance, Qualcomm emphasizes the enhanced security and privacy offered by its on-device AI processing. By utilizing multi-modal AI apps, which involve user biometrics and personal data, queries and results are kept secure without the need to upload them to cloud-based AI platforms. Local AI processing provides lower latency, reduced energy consumption, and cost benefits, overcoming a few of the growing pains experienced with rapidly adopting cloud-based AI technology.
Qualcomm explains that this synergy of technology is achievable due to optimization efforts for Snapdragon processors. Many popular AI models have been optimized specifically for these processors, utilizing the CPU, GPU, NPU (neural processor), and sensing hub working in unison to deliver considerably faster results compared to the previous generation. Additionally, the new chips support superfast LPDDR5X memory to eradicate processing bottlenecks.
With increasing demand for AI capabilities, Qualcomm’s Snapdragon X Elite for laptops and Snapdragon 8 Gen 3 for phones are ready to enhance image generation speed, accelerate text processing, and provide increased security through on-device processing. It will be interesting to witness what the first laptops and phones equipped with Qualcomm’s innovative chips can achieve with these enhanced capabilities.