Kakao Brain Unveils Korean Super Large AI Language Model 'KoGPT'

[Asia Economy Reporter Kang Nahum] 'The era of ultra-large AI where AI thinks and writes like humans.'

Kakao Brain has released the Korean language-specialized artificial intelligence (AI) language model ‘KoGPT’, based on the ‘GPT-3’ model, to the largest open-source community GitHub.

On the 16th, Kakao Brain CEO Kim Ildu introduced the future direction and major research of Kakao Brain at the Kakao developer conference ‘if (kakao) 2021’, sharing this news.

OpenAI’s language model GPT-3 is an AI model that enables natural language communication between humans and AI, and is recognized as a technology that has raised the limits of deep learning and opened the next generation AI era.

By applying the GPT model, it can perform sentiment analysis by making judgments on its own without additional training. For example, it can determine whether comments on a movie review are positive or negative and can summarize the content briefly.

Kakao Brain’s KoGPT is a Korean language-specialized version of the GPT-3 model. It was built based on 6 billion parameters and 200 billion tokens of Korean language data. In particular, KoGPT understands Korean lexically and contextually and shows users the desired results. It performs all tasks that can be utilized with language, such as ▲judging the positivity or negativity of a given sentence ▲summarizing long sentences into one line ▲predicting conclusions after sentence inference.

Kakao Brain plans to prepare English and Japanese models as well as Korean in the future and open-source them. They also plan to prepare Southeast Asian languages such as Vietnamese and Malaysian so that more places can benefit from AI technology.

CEO Kim said, “We plan to increase the size and performance of GPT technology by 100 times,” adding, “Since GPT handles large-scale data, it requires high-level resources and investment. By opening GPT as open source, we will improve technology accessibility for general universities and startups.”

Meanwhile, on the first day of the conference, Kakao’s major community CEOs including CEO Kim participated as presenters to share their business experiences and technical know-how. Also, Kakao C-level executives such as the Chief Product Officer (CPO), Chief Business Officer (CBO), and Chief Technology Officer (CTO) introduced the status, strategies, and directions of major services and businesses including KakaoTalk Wallet, KakaoTalk Channel, Kakao View, and eum mm.