A liberal arts undergraduate, Becoming the world's 24th Kaggle Grand Master EP.1 My driving force
2022/03/18⏱ 15mins -
Jamie (Content Marketer)
이 글은 <업스테이지 토크_학부 문과생이 세계 랭킹 24위 캐글 그랜드 마스터가 되기까지>를 재구성하여 작성되었습니다.
-
✔️ THOSE WHO ARE CURIOUS ABOUT AI PRODUCT DESIGN
✔️ Those who are curious about the role and work of a designer in a technology-oriented company
✔️ Those who are curious about the upstage design team’s work method, culture, and talent
-
YUNSU KIM, WHO BECAME THE YOUNGEST KAGGLE GRAND MASTER IN KOREA, INTRODUCES THE STUDY SECRETS AND DRIVING FORCE THAT ENABLED HIM TO BECOME THE KAGGLE GRAND MASTER IN A SHORT PERIOD OF TIME. CHECK OUT THE EFFORTS HE HAS MADE FROM THE TIME HE FIRST ENCOUNTERED AI TO WHERE HE IS TODAY.
-
✔️ What the Global Residency team does
✔️ 3 THINGS THAT HELPED ME WHEN I FIRST STARTED STUDYING AI
✔️ When is the Kaggle Challenge?
✔️ The purpose of participating in the Kaggle competition and what has been achieved
✔️ The driving force behind becoming a Kaggle Grand Master
entering
안녕하세요. 오늘은 캐글 이야기를 해보려고 합니다. 요즘 AI 분야에 관한 관심과 흥미가 나날이 커지고 있죠. 데이터 사이언스와 AI 관련 서적이 끊임없이 출간되고, 수많은 교육 플랫폼과 유튜브엔 관련 영상들이 앞다퉈 올라오고 있습니다. (업스테이지 김성훈 대표님(a.k.a 성 킴)의 <모두를 위한 딥러닝 강좌>도 AI 필수 입문 강좌인 거 아시죠?) 그만큼 전공자, 비전공자를 막론하고 AI 공부 열풍이 퍼지고 있는 듯합니다.
Upstage, a leading company in the field of AI, is also sparingly investing in nurturing AI talents who will take off on the global stage. We are producing the best talents in the AI field through the 'Global Residency (GR)' program.
📌 Purpose of Upstage Global Residency Program
WE RESEARCH AND DEVELOP AI TECHNOLOGIES WITH PRACTICAL LEADERS WHO HAVE CREATED THE WORLD'S BEST AI SERVICES. (IMPLEMENTATION AND SERVICE OF VARIOUS LATEST DEEP LEARNING MODELS)
TOGETHER WITH LEADER SEONG-HOON KIM, THE WORLD'S BEST KAGGLE GRAND MASTER, WE PARTICIPATE IN INTERNATIONAL AI COMPETITIONS SUCH AS KAGGLE AND CHALLENGE OURSELVES TO OVERCOME DIFFICULT TASKS.
WE CONDUCT WORLD-CLASS AI RESEARCH WITH PROFESSORS AND DOCTORAL STUDENTS AT HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY, KAIST, AND SEOUL NATIONAL UNIVERSITY.
This episode was written based on upstage talk by Upstage Yunsu Kim, who joined the GR program and became the 6th Grand Master in Korea as part of the upstage AI challenges team. After first encountering Python in a liberal arts class, Yunsu Kim, a talented person from the Department of Humanities who entered the field of artificial intelligence in earnest, captured the process and effort of becoming the Kaggle Grand Master.
In 2021, Kim Yun-soo's name was proudly ranked sixth on the Kaggle Grand Masters list, which was only five in Korea. The upstage AI challenges team also has Korea's third grandmaster, Kim Seong-hoon. Following him last year, we all celebrated the birth of the upstage Kaggle Grand Master.
WHAT WAS THE SECRET TO BEING ABLE TO BECOME THE KAGGLE GRAND MASTER, YOONSU, WHO WAS NOT AN AI MAJOR? THOSE WHO ARE NEW TO AI, AS WELL AS THOSE WHO ARE AIMING TO CHALLENGE THE KAGGLE COMPETITION, PLEASE PAY ATTENTION TO YUNSU'S STORY.
[Figure 1] Youngest domestic grandmaster, upstage AI challenges team Yunsu Kim
3 THINGS THAT HELPED ME WHEN I FIRST STARTED STUDYING MACHINE LEARNING AND AI
After being introduced to the liberal arts class, I started self-taught with interest in programming. As a non-major, when I first started studying AI, three things helped me a lot: English, Google, and Coursera . These three things have been a great organic help to my studies.
First, it is 'English' . Most of the AI technology, papers, and coding-related materials are in English, so I really felt the importance of language. Of course, since I was from a foreign language high school, I had a certain level of English, so the language burden was somewhat less. English is very helpful when studying in a specialized field, so if you build up your skills, it will definitely help you in your technical studies.
Next is 'Googling '. When I faced a problem I didn't know, I was able to find the answer more quickly through a Google search. Google was the best teacher. Searching in English can help you get more quality information and is more efficient because it gives you more options for answering code errors. In the field of artificial intelligence, the latest technology is pouring out every moment, so quick information update is essential. That is why there is no teacher as good as a search engine that provides a lot of information.
Last but not least is Coursera . Coursera, an online lecture platform, provides high-quality lectures in various fields. Among them, I took Python for Machine Learning, Deep Learning, and Data Science by Professor Andrew Ng. As many lectures are conducted in English, it seems that if you can listen in English, you will have more lecture options.
When is the Kaggle Contest Challenge?
For the first few months, I took Coursera classes and worked on personal projects. After that, I went straight to the Kaggle competition. It was about 9 months (January 2019) after I started listening to Professor Andrew Ng's lecture in April 2018. I quickly learned the theory through online lectures, and spent most of my time in Kaggle competitions to learn machine learning in practice. Everyone has a different learning style, so there is no right answer that everyone should be like this. However, as I spent a lot of time concentrating on the competition, it seems that I was able to improve my skills and competency more quickly through failures and successes. As Kaggle is a competition where real companies have to come up with solutions to the challenges facing them, it was also possible to focus on areas that could be solved with artificial intelligence.
Kaggle is divided into real competitions and tutorial competitions. Before participating in the full-scale Kaggle competition, I participated in three tutorial competitions to have time to adapt and practice. In the first competition, of course, the result was not satisfactory. However, as the frequency of participation in competitions increases, you gain a sense of the techniques commonly used in Kaggle. From that moment on, I was able to show a better performance. So in a year and a half, I participated in 8-10 competitions solo, winning 6 silver medals.
Another big turning point comes when it comes to Kaggle's performance. Joining the 2020 upstage AI challenges team. During my internship, I won my first gold medal in Kaggle with my teammates, and became the Grand Master in August 2021. In the AI challenges team, we were able to set the record for the highest ranking of 22 (top 0.013%) by constantly raising our capabilities.
[Figure 2] Yunsu Kim’s journey to becoming a Kaggle Grand Master
If you want to know more about Yunsu Kim's AI study process, check out [Upstage Talks] Until Undergraduate Liberal Arts Student Becomes 24th Kaggle Grand Master in the World !
Purpose of Participating in Kaggle Contest and What You Get
If there is one thing that has been gained through active participation in Kaggle competitions, it is 'growth as an AI developer' . As I said above, I was able to test my skills to my heart's content through actual practice.
Kaggle has several mechanisms to motivate participation. One of them is raising the leaderboard rankings and tiers . It's like an RPG game. Just as you invest a lot of time in the game to increase your ranking, Kaggle will need to continue investing in order to increase your rank. I was able to feel satisfaction and fun while experiencing the experience of raising the ranking so that I could work hard. This little fun naturally led to interest and passion for the latest technology. Contemplating different approaches to solving problems, more trials and efforts were made. After that, you will feel that your skills are gradually filling up, and it is a fun structure where you can show your value as a developer by taking a high ranking in the Kaggle contest where you can prove your skills externally, so many people seem to be actively participating.
There are other benefits to participating in Kaggle competitions. Discussions, a place where great developers all over the world share their code and ideas, can give you tons of insights and new programming ideas . Developers share their questions and difficulties while solving problems, and other developers will post their own alternatives and answers. In it, you can find different problem approaches and definitions to broaden your perspective on problems. This is a very helpful part for the growth of novice developers. Also, since there are various problem domains presented in the contest, if you participate in various contests (Vision, NLP, Tabular, etc.), you can learn SOTA skills for each field. As such, for developers, Kaggle competitions seem to function as a place of learning and growth.
📌 What is Kaggle Grand Master?
To become a Grandmaster, you must earn 5 gold medals. It must contain at least one Solo Medal. (Kaggle can participate solo or as a team) The total number of participants in the Kaggle competition is about 170,000. Of these, there are only 248 grandmasters worldwide. That's a great title that only a few people can get. The Kaggle competition is divided into a total of 5 grades (tiers). Novice → Contributor → Expert → Master → Grand Master (highest grade)
[Figure 3] Kaggle Ranking 18th Grandmaster Seonghoon Kim, Ranking 21st Grandmaster Yunsu Kim Source :https://www.kaggle.com/rankings (As of 2/11/2022)
The driving force behind becoming a Kaggle Grad Master
There are four main factors that have made me a Kaggle Grand Master. Passion, time, equipment, great team .
First, it is ' passion' that comes from fun. As I said before, I was able to participate in a fun way because there is a ranking system that returns just as much as my efforts. Of course, it is not easy to achieve good results in a short period of time. Even if you experience many failures, I believe that good results can be achieved in the end if you have the motivation and passion to participate consistently.
Second, 'time' . In order to focus on one Kaggle competition, you need time and space to devote a month or two to Kaggle alone. There is no standard on how much time you should invest each day. In my case, I invested most of my daily life in Kaggle until I became a Grandmaster. Of course, it seems important to find a balance by setting your own standards in parallel with other work.
The third is ' equipment' . Equipment is important when participating in image competitions or competitions that deal with large data. It can be difficult to reach the top without equipment that can perform well enough. For example, it takes one day to complete one experiment with one GeForce RTX 2080 Ti. On the other hand, if you have 4 RTX 3090s, you can finish it in 4 hours. When a large amount of GPU memory is required, it is sometimes difficult to properly learn. However, it does not seem necessary to have all the equipment when starting out. I started with a single 2080 Ti, AMD Ryzen CPU, and 64GB of RAM. If equipment is hard to come by, Google Colab TPUs may be an option. Joining the upstage GR team has helped me a lot to achieve a more satisfactory performance with good equipment.
Last but not least is a ' great team member '. You can participate in the competition either solo or as a team. Each has its pros and cons. Participating solo has the advantage of greatly improving skills because you have to solve all problems by yourself, and participating in a team has the advantage of allowing various ideas and attempts to be made by putting your head together with your teammates. Disadvantages would be the opposite side of advantages. There are pros and cons like this, so it is important to try various challenges according to your personal preference. I like both, and I was able to win my first gold medal by playing as a team. In the upstage AI challenges team, I was able to learn a lot by collaborating with team leader Kim Seong-hoon (aka Lime Robot_World's highest ranking 12th, Korea's third Kaggle Grand Master) and colleagues. This experience has helped me a lot in improving my machine learning knowledge and competency, as well as making good Kaggle competitions.
[Figure 4] Upstage AI challenges Team Kaggle Grand Master Yunsu Kim’s study tips and driving force
concluding
So far, we have shared the story of Kaggle Grand Master Yunsu Kim. From my first encounter with AI, I joined the upstage AI challenges team to explore the journey to becoming a Kaggle Grandmaster. Upstage always cheers for Yoonsu, who has put a lot of effort into studying AI as a non-major. If you are curious to know more about Yunsu's story, please check out Yunsu's story and upstage talk containing various study methods.
-
Upstage is developing AI products such as OCR Pack and Recommendation Pack to create a more beneficial world with AI under the mission of 'Making AI beneficial'.
The upstage AI challenges team, which participates in AI competitions and produces outstanding results, is with the best AI talents with excellent results in various international AI competitions including Kaggle, led by Kim Seong-hoon (lime robot), the third grandmaster in Korea. . Experience new opportunities for growth with them right now.