Ternary-Bonsai-8B-gguf

Description

Ternary-Bonsai-8B-gguf is an open-weight text-generation model with roughly 8B parameters published by prism-ml on the Hugging Face Hub. It has 397,136 downloads. Runs with gguf.

Community Metrics

Categories

• Productivity

Tags

• ternary
• 1.58-bit
• llama-cpp
• q2_0
• on-device
• prismml
• bonsai
• text-generation

Capabilities

• Text generation
• Conversational
• GGUF quantised builds
• Library: gguf
• 8B parameters

Information