MediaTek is set to revolutionize the world of generative AI on smartphones with its next-generation chipset. Unlike previous AI apps that relied on cloud-based computing, MediaTek’s new chipset will bring on-device generative AI processing directly to Android phones. This breakthrough will provide numerous benefits, including seamless performance, improved privacy and security, lower latency, and the ability to operate in areas with limited connectivity.
The upcoming MediaTek chip will utilize three key tactics to enhance the generative AI experience. Firstly, it will feature a dedicated software stack optimized for running the Llama 2 model developed by Meta. Llama 2 is an open-source large language model that aims to challenge existing models like OpenAI’s GPT and Google’s PaLM 2. By harnessing Llama 2’s capabilities, MediaTek aims to deliver exceptional performance for generative AI apps.
Additionally, MediaTek’s flagship chip will incorporate a souped-up AI Processing Unit (APU) that leverages transformer backbone acceleration. Transformers are neural network architectures used to create large language models like GPT, which powers popular AI apps such as ChatGPT. This enhanced APU will significantly optimize the processing power and efficiency of generative AI applications.
Furthermore, MediaTek’s new chip will tap into the DRAM module to elevate the user experience of Llama-based generative AI apps. With more DRAM, phones can run multiple apps simultaneously in the background without any performance issues. MediaTek plans to enhance the performance and speed of AI-generated content by offloading processing requirements to local hardware.
While the exact capabilities of Llama 2-based apps are still to be unveiled, it is expected that they will offer similar functionalities to existing text-based natural language models like ChatGPT and Bard. This includes processing queries, providing answers, summarizing or expanding text, and more.
This partnership with Meta isn’t MediaTek’s first foray into the realm of AI. In July, the company collaborated with Unity’s China division to explore generative AI applications in the gaming segment. MediaTek anticipates that smartphones equipped with their new chip and Llama 2 apps will hit the market by the end of this year, offering users a glimpse into the future of on-device generative AI processing.
In conclusion, MediaTek’s next-generation chipset holds the promise of revolutionizing generative AI on Android phones. By bringing processing power directly to the device, users can expect heightened performance, enhanced privacy and security, improved latency, and the ability to utilize AI apps even in areas with limited connectivity. This exciting development paves the way for a new era of on-device generative AI that will surely transform our smartphone experiences.
