SonyD AI Completes Development of AI CCTV Solution with Proprietary VLM and Blockchain Integration

Sonyde announced on the 5th that its subsidiary Sonyde AI has completed the development of an ‘AI CCTV solution’ that integrates its own visual language model (VLM) technology and blockchain security technology into the on-device AI ‘Brainbot’.

Brainbot improves the processing speed of CCTV data without relying on a central server through on-device AI technology. It can maintain stable performance even in the event of network failures. In particular, by applying proprietary VLM technology and blockchain security technology, it enhances object and situation recognition capabilities and strengthens the privacy protection of data stored in the cloud during central monitoring.

The AI CCTV solution was developed to database human movements to easily analyze the causes of accidents and incidents. For this, VLM technology, which learns videos and images and generates results for application, is essential. When VLM technology is applied, CCTV can recognize objects in real time, detect abnormal behavior, and perform more sophisticated analysis.

Sonyde AI has independently developed a multimodal AI model VLM that can understand and search videos. Based on this, it can identify various people and objects in videos and even understand their actions. VLM enhances large language models (LLM) with image and video processing capabilities.

While AI technology has so far been led by LLMs, future AI technology is expected to evolve toward algorithms that mimic human learning methods such as VLM, enabling AI to autonomously create data. Sonyde AI’s VLM implements a ‘secure inference-capable VLM with enhanced security’ by applying ClarePixel’s RGBIR image sensor technology, which can process images in the infrared spectrum that distinguishes temperature, along with blockchain security technology.

Through VLM implementation, searches such as ‘Find a person holding a weapon’ or ‘Find a person jaywalking at the crosswalk’ or ‘Summarize what is happening in this video in text’ can accurately find the desired scenes and present the video content in text form. This enables searching situations where accidents occurred using data captured by CCTV.

Blockchain security technology guarantees data integrity and rapidly enhances CCTV security by managing access rights in a decentralized manner.

A Sonyde AI official stated, “Our AI CCTV solution is expected to be widely applied not only to government and local government crime prevention and security CCTVs, police vehicle searches, smart city infrastructure projects, and private security companies, but also to extensively replace existing CCTV systems in places requiring crime prevention and real-time monitoring. By applying blockchain security technology to our AI CCTV solution, it is possible to build a more reliable security environment.”

Meanwhile, according to market research firm Nextmsc, the domestic AI CCTV market size is expected to grow at a compound annual growth rate (CAGR) of 19.9% from 2024 to 2030, reaching approximately 4 trillion KRW, with AI CCTV solutions equipped with blockchain security technology anticipated to enter various new markets.