Upstage joins forces with NIA to build a Korean-style Open LLM leaderboard
2023/9/5Upstage and NIA jointly build a Korean-style Open LLM leaderboard... Expanding the scope of the AI ecosystem, including 1T Club
‘Open-Ko LLM Leaderboard’ launched this month to prove the performance and innovation of domestic LLMs using AI HUB data
“We will strive to increase domestic LLM performance and diversity and expand the artificial intelligence ecosystem with the Korean-style Open LLM leaderboard.”
(Upstage = 2023/9/5) Upstage, which is attracting attention in the global AI industry by building the world's best open LLM model, is expanding the domestic AI ecosystem by jointly building a Korean-style Open LLM leaderboard with NIA.
Domestic AI startup Upstage (CEO Kim Seong-hoon) announced on the 5th that it signed an 'AI Hub Data Utilization Business Agreement' with the National Information Society Agency (NIA) to build a Korean-style Open LLM leaderboard. The two companies held an agreement ceremony at the NIA Seoul office in Gwanghwamun with key executives including Upstage CEO Kim Seong-hoon and NIA Director Hwang Jong-seong in attendance.
According to this agreement, Upstage will utilize Korean data in various fields provided by AI Hub, NIA's artificial intelligence learning data provision platform, and launch the 'Open-Ko LLM Leaderboard' within this month to contribute to the development of the domestic AI industry ecosystem. We plan to build it.
The 'Open-Ko LLM Leaderboard', the Korean version of the Hugging Face Open LLM Leaderboard that evaluates the Open LLM model, is a platform that evaluates and ranks the performance of LLMs developed based on the Korean language, based on existing reasoning and common sense skills and language. In addition to four indicators, including comprehensive understanding ability and prevention of hallucinations, additional criteria such as ethics and expert knowledge are established to evaluate the model based on reliable data such as NIA and academia.
Upstage ranked first in the Open LLM leaderboard operated by Hugging Face last August, with its generative AI model recording world-class performance. By collaborating with NIA to jointly build a leaderboard, Upstage plans to not only develop a high-quality LLM that can capture Korean cultural sentiments based on AI Hub data, but also contribute to creating an ecosystem for the independence of LLM in Korea. am.
THROUGH THIS COOPERATION, NIA ALSO JOINED UPSTAGE'S 1T CLUB AND PROMISED TO PROVIDE QUALITY DATA. UPSTAGE'S 1T CLUB WAS LAUNCHED LAST MONTH AND IS COLLABORATING WITH PARTNERS WHO CONTRIBUTE MORE THAN 100 MILLION WORDS OF KOREAN DATA IN VARIOUS FORMS SUCH AS TEXTS, BOOKS, AND ARTICLES, AND THROUGH THIS, EXPANDS THE SCOPE OF THE AI ECOSYSTEM FOR DEVELOPING ARTIFICIAL INTELLIGENCE GIANT LANGUAGE MODELS. I'M DOING IT.
Upstage's 1T Club stands for '1 Trillion Token Club', and partners can use LLM's API, which Upstage produces in-house, at a discounted price and share in the profits generated by LLM's API business. . Upstage plans to use the data provided by partner companies only for model training purposes and make every effort to protect security and personal information so that the original text cannot be extracted.
Kim Seong-hoon, CEO of Upstage, said, “Through the agreement with NIA, we have been able to solve the problem of lack of Korean language data and provide a competitive artificial intelligence platform in domestic and overseas markets.” He added, “Through the Korean Open LLM leaderboard with NIA, we have been able to improve the performance of domestic LLMs.” “We will prove our capabilities and innovation, and strive to develop and disseminate artificial intelligence,” he said.
NIA collects and processes data from various fields through AI Hub and provides it to artificial intelligence developers free of charge. NIA plans to build about 1,300 types of data by 2025, which will contribute to the growth and revitalization of the domestic artificial intelligence industry.
NIA Director Hwang Jong-seong said, “Through the agreement with Upstage, a globally recognized AI startup, AI Hub’s data can be utilized in the domestic and overseas artificial intelligence markets.” He added, “Through the Korean-style Open LLM leaderboard, the level of domestic LLMs can be “We will increase diversity and work harder to build an artificial intelligence ecosystem,” he said.
※ Photo caption: Upstage, which is attracting attention in the global AI industry by building the world's best open LLM model, is working with NIA to expand the domestic AI ecosystem by establishing a Korean-style Open LLM leaderboard. Pictured are Upstage CEO Kim Seong-hoon and NIA Director Hwang Jong-seong (from left).
-
Upstage | Keunkyo Kim, PR Director | keunkyo@upstage.ai Upstage | Sungbeom Bae, PR Manager | sungbae@upstage.ai
Download press release
-
Upstage, founded in October 2020, offers a no-code/low-code solution called "Upstage AI Pack" to help clients innovate in AI. This solution applies the latest AI technologies to various industries in a customized manner. Upstage AI Pack includes OCR technology that extracts desired information from images, recommendation technology that considers customer information and product/service features, and natural language processing search technology that enables meaning-based search. By using the Upstage AI Pack, companies can easily utilize data processing, AI modeling, and metric management. They can also receive support for continuous updates, allowing them to use the latest AI technologies conveniently. Additionally, Upstage offers practical, AI-experienced training and a strong foundation in AI through an education content business. This helps cultivate differentiated professionals who can immediately contribute to AI business.
Led by top talents from global tech giants like Google, Apple, Amazon, Nvidia, Meta, and Naver, Upstage has established itself as a unique AI technology leader. The company has presented excellent papers at world-renowned AI conferences, such as NeurIPS, ICLR, CVPR, ECCV, WWW, CHI, and WSDM. In addition, Upstage is the only Korean company to have won double-digit gold medals in Kaggle competitions. CEO Sung Kim, an associate professor at Hong Kong University of Science and Technology, is a world-class AI guru who has received the ACM Sigsoft Distinguished Paper Award four times for his research on bug prediction and automatic source code generation. He is also well-known as a lecturer for "Deep Learning for Everyone," which has recorded over 7 million views on YouTube. Co-founders include CTO Hwal-suk Lee, who led Naver's Visual AI/OCR and achieved global success, and CSO Eun-jeong Park, who led the modelling of the world's best translation tool, Papago.
