QTensor-TinyLlama-1.1B-Asymmetric-v2

Description

QTensor-TinyLlama-1.1B-Asymmetric-v2 is an open-weight text-generation model with roughly 1.1B parameters published by trentzap on the Hugging Face Hub. It has 329 downloads. Runs with transformers.

Categories

• Productivity

Tags

• qtensor_llama
• text-generation
• qtensor
• quantization
• svd
• int4
• awq
• lora

Capabilities

• Text generation
• Conversational
• Library: transformers
• 1.1B parameters