N3N Achieves First Place Worldwide in Korea for 'Open LLM Leaderboard 2' Under 11B

N3N (CEO Nam Young-sam) achieved the world's first place in the under 11B category of the "Open LLM Leaderboard Season 2" as of 5 PM on November 8. N3N's self-developed LLM recorded an average score of 32.02 points, surpassing leading global AI companies.

Launched in June this year, the "Open LLM Leaderboard Season 2" was newly established with a major overhaul of the evaluation criteria and methods from Season 1. The revamped evaluation method significantly increased the difficulty level, with major global big tech companies such as Microsoft (29.67 points, 17th place), Google (28.86 points, 22nd place), and Meta (28.2 points, 29th place) remaining in relatively high rankings.

However, among major domestic AI companies, Upstage scored 19.63 points at 278th place, KAIST AI scored 19.18 points at 293rd place, and TwoDigit, which held first place for about 50 days in Season 1, scored 18.49 points at 311th place, facing difficulties. In this Season 2, there were few notable achievements among domestic companies.

The overall first-place score for under 11B in Season 1 reached 76.76 points, but in Season 2 it dropped significantly to 32.02 points. This is due to the increased evaluation difficulty and restructured evaluation criteria in Season 2. For example, the MMLU (Massive Multitask Language Understanding) metric used in Season 1 was replaced by the more challenging and enhanced MMLU-PRO in Season 2.

Regarding this, Kim Seung-seop, AI Team Leader at N3N, stated, "N3N has independently built the entire AI development process from creating training datasets to data evaluation and modeling based on this, and through this achievement, we have confirmed that our technological capabilities are world-class."

Additionally, Nam Young-sam, CEO of N3N, emphasized, "This achievement objectively proves that N3N's AI technology is superior not only compared to major domestic AI companies but also to global big tech companies," adding, "It will serve as an opportunity to increase client trust in the AI services that N3N will provide in the future."

He also added, "This achievement was made based on N3N's proprietary infrastructure 'Jikji Labs,' and it was an opportunity to confirm the infrastructure capabilities that can support world-class AI model training."

Meanwhile, N3N's AI Computing Infra specialized brand Jikji Labs recently successfully completed the 'AI Computing Industry Week' event held both online and offline from October 23 to 25. Going forward, N3N plans to launch global AI services next year based on the infrastructure of Jikji Labs.