[News Terms] After AI Servers, Next is 'On-Device AI'

Samsung Electronics' premium smartphone 'Galaxy S 24,' scheduled to be unveiled on January 17 next year, will feature a function that provides real-time translation of phone calls. When a smartphone user speaks comfortably in their native language, the Galaxy AI translates it into the other party's language regardless of the smartphone model, and then interprets the other party's speech back to the user. Although there have been translation applications available on smartphones before, this is the world's first time such a feature is built into the smartphone itself.

[Image source=Yonhap News]

This integration of AI into digital devices to offer users new information technology (IT) experiences is called 'on-device Artificial Intelligence.' While traditional cloud-based AI relies on external servers or the cloud for data and computation support, on-device AI is embedded directly within the device to provide AI services independently. This technology offers advantages such as no dependency on network connectivity, enhanced security, and faster information processing speeds.

The IT industry has already been attempting to enhance product competitiveness by incorporating on-device AI into devices. Samsung Electronics is also set to introduce the first on-device AI laptop, the 'Galaxy Book4,' soon. The Galaxy Book4 will be equipped with Intel's latest CPU, Meteor Lake, which includes an NPU (Neural Processing Unit), enabling AI computations without requiring a network connection.

Google has integrated the large language model (LLM) 'Gemini' into its latest smartphone, the 'Pixel 8 Pro.' Through Gemini, the phone can predict and suggest the next part of a message while composing texts and summarize recorded content. Using generative AI, it can adjust the position and size of subjects in photos and even alter human facial expressions. Apple announced the next-generation AI chip 'M3' last October, signaling the dawn of the on-device AI era. It is expected that the 'iPhone 16' series, scheduled for release next fall, will include on-device AI features.

Industry experts anticipate that on-device AI will become a new growth engine. It is expected to be embedded in various devices such as smartphones, autonomous vehicles, and drones, performing functions like real-time conversation translation, location recognition, and operation control, thereby significantly expanding the market. Market research firm Canalys predicts that about 60% of all PCs released in 2027 will be on-device AI products.