DeepSeek-R1-Distill-Llama-70B-quantized.w4a16

Description

DeepSeek-R1-Distill-Llama-70B-quantized.w4a16 is an open-weight text-generation model with roughly 70B parameters published by RedHatAI on the Hugging Face Hub. It has 918 downloads. Runs with transformers.

Categories

• Productivity
• Design

Tags

• llama
• text-generation
• deepseek
• int4
• vllm
• llmcompressor
• conversational
• compressed-tensors

Capabilities

• Text generation
• Conversational
• Library: transformers
• 70B parameters