gdn-1.3b-pas-fa-layer12-50b

Description

gdn-1.3b-pas-fa-layer12-50b is an open-weight text-generation model with roughly 1.3B parameters published by startlux-models on the Hugging Face Hub. It has 199 downloads. Runs with transformers.

Categories

• Writing

Tags

• gated_deltanet
• text-generation
• fla
• gated-deltanet
• hybrid-linear-attention
• linear-attention
• massive-activations

Capabilities

• Text generation
• Library: transformers
• 1.3B parameters