zephyr-7b-beta-nf4-fp16-upscaled-GGUF

Description

zephyr-7b-beta-nf4-fp16-upscaled-GGUF is an open-weight text-generation model with roughly 7B parameters published by MaziyarPanahi on the Hugging Face Hub. It has 844 downloads. Runs with transformers.

Categories

• Productivity

Tags

• mistral
• quantized
• 2-bit
• 3-bit
• 4-bit
• 5-bit
• 6-bit
• 8-bit

Capabilities

• Text generation
• Conversational
• GGUF quantised builds
• Library: transformers
• 7B parameters