Nemotron-3.5-Lightning-30B-A3B-W4A16

Description

Nemotron-3.5-Lightning-30B-A3B-W4A16 is an open-weight text-generation model with roughly 30B parameters published by aleada on the Hugging Face Hub. It has 374 downloads. Runs with transformers.

Categories

• Productivity
• Design

Tags

• nemotron_h
• text-generation
• quantized
• compressed-tensors
• gptq
• w4a16
• vllm
• ampere

Capabilities

• Text generation
• Conversational
• Library: transformers
• 30B parameters