We are interested in developing non-English LLMs and transferring knowledge from large language models to smaller ones.

• Development of Solar-based Self-Introduction Correction LLM Model using SFT 2024.02 ~ 2024.03
• Development of Gemma 2B Korean Pre-trained Model 2024.04 ~ 2024.07
• Application of Quantization to LLM Model using llama.cpp 2024.05 ~ 2024.05
• Development of Llama3-8b Model using Chat-Vector and Orpo 2024.05 ~ 2024.06
• Development of Korean LLAVA Model using Chat-Vector 2024.06 ~ 2024.07
• Development of Korean Financial LLM Leaderboard 2024.07 ~ 2024.08

• Machine Learning / Deep Learning
• LLM Pretrain / Fine-Tuning
• Quantization / Knowledge Distillation

⚡ Skills ⚡

💻 Programming Language

📚 Stacks

🛠 Tools

• 🏅 2023 인공지능콘텐츠융합창작랩 AI 융합 콘텐츠 공모전(AI+ 콘텐츠 결과 부문) - 1nd placed [overview]