Mistral-Small-24B-Instruct-2501-quantized.w4a16

Description

Mistral-Small-24B-Instruct-2501-quantized.w4a16 is an open-weight text-generation model with roughly 24B parameters published by RedHatAI on the Hugging Face Hub. It has 4,305 downloads.

Community Metrics

Categories

• Productivity
• Design

Tags

• mistral
• mistral-small
• w4a16
• int4
• vllm
• conversational
• compressed-tensors
• text-generation

Capabilities

• Text generation
• Conversational
• 24B parameters

Information