qwen2.5-7b-to-1.5b-gkd-paper100k-step1500-seed10

Description

qwen2.5-7b-to-1.5b-gkd-paper100k-step1500-seed10 is an open-weight text-generation model with roughly 7B parameters published by huggingFacing on the Hugging Face Hub. It has 434 downloads. Runs with transformers.

Categories

• Productivity

Tags

• qwen2
• text-generation
• qwen2.5
• knowledge-distillation
• gkd
• liftkd
• ablation
• conversational

Capabilities

• Text generation
• Conversational
• Library: transformers
• 7B parameters