HiLS-Attention-7B

Description

HiLS-Attention-7B is an open-weight text-generation model with roughly 7B parameters published by tencent on the Hugging Face Hub. It has 371 downloads. Runs with transformers.

Categories

• Writing

Tags

• olmo_hils
• text-generation
• long-context
• sparse-attention
• efficient-attention
• pretraining
• olmo3
• hils-attention

Capabilities

• Text generation
• Library: transformers
• 7B parameters