NVIDIA-Nemotron-3.5-Lightning-30B-A3B-UD-Q4_K_XL-layers

Description

NVIDIA-Nemotron-3.5-Lightning-30B-A3B-UD-Q4_K_XL-layers is an open-weight text-generation model with roughly 30B parameters published by meshllm on the Hugging Face Hub. It has 2,546 downloads. Runs with mesh-llm.

Categories

• Productivity

Tags

• mesh-llm
• layer-package
• skippy
• distributed-inference
• local-inference
• openai-compatible
• text-generation
• imatrix

Capabilities

• Text generation
• Conversational
• GGUF quantised builds
• Library: mesh-llm
• 30B parameters