StdMoE_1b14b_1T_EmoAnnealed

Description

StdMoE_1b14b_1T_EmoAnnealed is an open-weight text-generation model with roughly 1B parameters published by allenai on the Hugging Face Hub. It has 278 downloads. Runs with transformers.

Categories

• Coding
• Productivity

Tags

• emo
• text-generation
• moe
• mixture-of-experts
• modularity
• ablation
• midtraining
• conversational

Capabilities

• Text generation
• Conversational
• Library: transformers
• 1B parameters