tebmer / awesome-knowledge-distillation-of-llms Goto Github PK
View Code? Open in Web Editor NEWThis repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.