Bonsai-2-27B-Ternary-CRACK-GGUF

Description

Bonsai-2-27B-Ternary-CRACK-GGUF is an open-weight text-generation model with roughly 27B parameters published by dealignai on the Hugging Face Hub. It has 1,434 downloads. Runs with llama.cpp.

Community Metrics

Categories

• Productivity

Tags

• llama.cpp
• ternary
• 2-bit
• llama-cpp
• cuda
• metal
• on-device
• hybrid-attention

Capabilities

• Text generation
• Conversational
• GGUF quantised builds
• Library: llama.cpp
• 27B parameters

Information