T3qInex12-7B-GGUF

Description

T3qInex12-7B-GGUF is an open-weight text-generation model with roughly 7B parameters published by MaziyarPanahi on the Hugging Face Hub. It has 265 downloads. Runs with transformers.

Categories

• Research

Tags

• mistral
• quantized
• 2-bit
• 3-bit
• 4-bit
• 5-bit
• 6-bit
• 8-bit

Capabilities

• Text generation
• GGUF quantised builds
• Library: transformers
• 7B parameters