Q-50M-Base

Description

Q-50M-Base is an open-weight text-generation model with roughly 50M parameters published by q-project on the Hugging Face Hub. It has 235 downloads. Runs with transformers.

Categories

• Coding

Tags

• q
• text-generation
• causal-lm
• custom-architecture
• pretrained
• base-model
• grouped-query-attention
• qk-norm

Capabilities

• Text generation
• Library: transformers
• 50M parameters