Ternary-Bonsai-2-27B-gguf

Description

Ternary-Bonsai-2-27B-gguf is an open-weight text-generation model with roughly 27B parameters published by prism-ml on the Hugging Face Hub. It has 1,516,960 downloads. Runs with llama.cpp.

Community Metrics

Categories

• Productivity

Tags

• llama.cpp
• ternary
• 2-bit
• llama-cpp
• cuda
• metal
• on-device
• hybrid-attention

Capabilities

• Text generation
• Conversational
• GGUF quantised builds
• Library: llama.cpp
• 27B parameters

Information