INT4 LoRA fantastic-tuning vs QLoRA: A user inquired about the distinctions concerning INT4 LoRA high-quality-tuning and QLoRA in terms of precision and speed. One more member explained that QLoRA with HQQ requires frozen quantized weights, doesn't use tinnygemm, and utilizes dequantizing alongside torch.matmul "Automation isn't replacing tr