Mistral-Medium-3.5-128B-W4A16-KV8

Description

Mistral-Medium-3.5-128B-W4A16-KV8 is an open-weight text-generation model with roughly 128B parameters published by SinclairSchneider on the Hugging Face Hub. It has 690 downloads. Runs with transformers.

Categories

• Productivity
• Design

Tags

• mistral3
• image-text-to-text
• mistral
• compressed-tensors
• w4a16
• gptq
• int4
• fp8-kv-cache

Capabilities

• Text generation
• Conversational
• Library: transformers
• 128B parameters