Qwen1.5-MoE-A2.7B-imatrix-GGUF

Description

Qwen1.5-MoE-A2.7B-imatrix-GGUF is an open-weight text-generation model with roughly 2.7B parameters published by liodon-ai on the Hugging Face Hub. It has 446 downloads. Runs with gguf.

Categories

• Productivity

Tags

• local-llm
• llama.cpp
• lm-studio
• quantized
• ollama
• imatrix
• sub-4-bit
• qwen2_moe

Capabilities

• Text generation
• Conversational
• GGUF quantised builds
• Library: gguf
• 2.7B parameters