"Conversational AI and Personalized Experiences"... Samsung's Vision for 'Multimodal AI'

Park Jisun, Vice President of Samsung Electronics MX Division
Real-time Requests and Responses While Sharing Screens with AI
"Proactively Operating Like Air in Everyday Life"

"In the future, communicating with artificial intelligence (AI) will involve sharing the scenes unfolding before your eyes and speaking as if conversing with a friend, without the hassle of typing everything out."

On the 10th, at the Samsung Electronics press room in Jung-gu, Seoul, an official introduced the new foldable smartphones Galaxy Z Fold7 and Flip7 during the Samsung Electronics Galaxy new product media briefing. Photo by Yonhap News

Park Jisun, Vice President of the AI Team at Samsung Electronics' MX Division, explained this on July 9 (local time) in New York, United States, while discussing the multimodal AI featured in the Galaxy Z Fold7 and Flip7. Multimodal AI refers to technology that can simultaneously understand and process different types of information, such as text, images, voice, and video.

Vice President Park stated, "AI equipped with multimodal capabilities and the ability to understand user intent will become the new standard for user experience going forward."

Previously, in January, Samsung introduced mobile AI capable of natural, conversational interaction in the Galaxy S25 series. In April, with the integration of Google’s Gemini Live into the Galaxy S25, users were able to use their camera to show their surroundings or objects, ask questions, and receive real-time answers.

Vice President Park said, "The Fold7 and Flip7 combine advanced hardware innovations with powerful multimodal AI, delivering an even more immersive and sophisticated AI experience to users."

She added, "Samsung Electronics has worked for a long time to deliver powerful multimodal AI. In addition to the mobile AI technology leadership we have built up over the years, close collaboration with industry partners such as Qualcomm and Google has also been essential."

According to joint research conducted by Samsung Electronics and the Goldsmiths Institute of Management at the University of London, about 45% of AI users responded that they use voice commands as frequently as typing. Additionally, approximately 60% of respondents said they want their smartphones to proactively perform tasks they need, using their usage patterns, without requiring explicit commands.

Vice President Park commented, "More users want mobile AI to proactively handle what they need according to the situation," and explained, "The 'Now Brief' feature introduced in the Galaxy S25 series was developed to meet this demand."

Now Brief analyzes users’ smartphone usage patterns and data to provide personalized, tailored information briefings. It not only sets up automated routines based on behavioral patterns but also recommends helpful actions to users by considering health information, travel plans, schedules, and more.

Vice President Park emphasized, "The newly introduced One UI 8 will further enhance the existing personalized AI experience by better understanding user intent."

She also stated that future AI will go beyond device personalization and evolve into ambient intelligence that seamlessly integrates into users’ daily lives and operates proactively according to the situation.

Vice President Park predicted, "AI equipped with multimodal capabilities and the ability to understand user intent will ultimately evolve into ambient intelligence, organically operating across all moments of users’ daily lives, seamlessly moving beyond the boundaries of devices and apps."

In conclusion, she said, "Users will be able to enjoy a fully personalized AI experience not only on Galaxy smartphones, but also on watches, rings, extended reality (XR) devices, and even a wide range of home appliances and TVs."