Upstage

View Original

UPSTAGE-QANDA-KT DEVELOPS A MATH-SPECIFIC LANGUAGE MODEL THAT SURPASSES CHATGPT


2024/1/8
  • UPSTAGE-QANDA DEVELOPS OPEN AI AND MATH GPT THAT SURPASSES MS AS PART OF KT STRATEGIC PARTNERSHIP

  • GPT-4 surpasses MS ToRA 13B performance... Achieves first place among models under 13B size

  • CONQUER THE DIFFICULT AREA OF LLM MATHEMATICS THROUGH ORGANIC COOPERATION BETWEEN UPSTAGE, QANDA, AND KT


(Upstage = 2024/1/8) Upstage (CEO Seong-Hoon Kim) announced that 'MathGPT (tentative name)', a mathematics domain specialized program jointly developed with Masspresso (CEO Lee Yong-jae), the operator of the AI-based learning platform 'Qanda', and KT, is part of Open AI. It was announced on the 8th that it had achieved a new world record, beating ChatGPT and Microsoft (MS) models.

Last November, Upstage and Qanda began developing MathGPT as part of a strategic partnership with KT. Upstage learned Qanda's high-quality mathematical data and fine-tuned the natural language-based language model to solve complex mathematical problems through logical reasoning and programming.

Accordingly, the two companies developed MathGPT with the 13B parameter and achieved an encouraging report card, surpassing the best-in-class MS 'ToRA 13B' in a representative benchmark test that evaluates the mathematical abilities of language models such as 'MATH' and 'GSM8K'. This is a new record, ranking first for models under 13B.

ACHIEVING THE HIGHEST PERFORMANCE SIMULTANEOUSLY IN TWO MEASURES, THE MATH BENCHMARK, WHICH CONSISTS OF 12,500 DIFFICULT MATH PROBLEMS, AND THE GSM8K BENCHMARK, WHICH TESTS ARITHMETIC OPERATIONS WITH 8,500 ELEMENTARY SCHOOL MATH PROBLEMS, IS AN UNPRECEDENTED ACHIEVEMENT IN RECENT TIMES IN THE WORLD. ALL.

In particular, MathGPT surpassed ChatGPT performance in the benchmark test average and even surpassed GPT-4 in the MATH benchmark. In the difficult mathematical domain, a domestically developed small-sized model has set a meaningful mark by beating big tech companies such as OpenAI and MS.

THIS ACHIEVEMENT WAS LARGELY DUE TO THE ORGANIC COOPERATION BETWEEN UPSTAGE, QANDA, AND KT. THANKS TO KT'S FULL INFRASTRUCTURE SUPPORT THROUGH STRATEGIC PARTNERSHIPS, QANDA'S UNRIVALED MATH-SPECIFIC KNOW-HOW, HIGH-QUALITY LEARNING DATA, AND ITS OWN LANGUAGE MODEL 'SOLAR' HAVE SURPASSED GLOBAL BIG TECH TO CREATE THE WORLD'S NO. 1 LLM. UPSTAGE'S MODELING TECHNOLOGY COMBINED TO PRODUCE THE BEST RESULTS.

Upstage, which has confirmed visible results in the education field through MathGPT, will move forward to reorganize the LLM market with Solar at the forefront. We plan to focus on strengthening our global structure as a stepping stone for full-fledged overseas expansion beyond the domestic market, covering various industries such as finance, distribution, medical care, and entertainment.

KIM SEONG-HOON, CEO OF UPSTAGE, SAID, “IT IS MEANINGFUL TO DEVELOP A WORLD-CLASS MATH-SPECIFIC LANGUAGE MODEL THAT WILL SURPASS CHATGPT THROUGH COOPERATION WITH QANDA AND KT.” HE ADDED, “IN THE FUTURE, UPSTAGE WILL WORK IN VARIOUS AREAS BASED ON THE WORLD’S NO. 1 LLM TECHNOLOGY.” “WE WILL LEAD GENERATIVE AI INNOVATION,” HE SAID.

LEE YONG-JAE, CEO OF QANDA, SAID, “THE TECHNOLOGY AND KNOW-HOW OF THE THREE COMPANIES, QANDA, UPSTAGE, AND KT, WERE COMBINED TO CREATE MEANINGFUL RESULTS THAT SURPASSED THOSE OF GLOBAL BIG TECH.” HE ADDED, “THROUGH QANDA’S AI TUTOR, WE ARE PROVIDING EDUCATIONAL EXPERIENCES TO STUDENTS NOT ONLY IN ASIA BUT AROUND THE WORLD. “WE WILL INNOVATE,” HE SAID.

※ Photo caption: 'MathGPT (tentative name)', a mathematics domain specialized program jointly developed by Upstage with Qanda and KT, has achieved a new world record, beating OpenAI's ChatGPT and the Microsoft (MS) model.

← Back to Newsroom