StdMoE_1b14b_1T_Preanneal

Description

StdMoE_1b14b_1T_Preanneal is an open-weight text-generation model with roughly 1B parameters published by allenai on the Hugging Face Hub. It has 289 downloads. Runs with transformers.

Categories

• Coding
• Productivity

Tags

• emo
• text-generation
• moe
• mixture-of-experts
• baseline
• pre-annealing
• conversational
• custom_code

Capabilities

• Text generation
• Conversational
• Library: transformers
• 1B parameters