Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w4a16

Description

Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w4a16 is an open-weight text-generation model with roughly 70B parameters published by RedHatAI on the Hugging Face Hub. It has 266 downloads. Runs with transformers.

Categories

• Productivity
• Design

Tags

• llama
• text-generation
• nvidia
• llama3.1
• w4a16
• int4
• vllm
• conversational

Capabilities

• Text generation
• Conversational
• Library: transformers
• 70B parameters