INT4 LoRA fantastic-tuning vs QLoRA: A user inquired about the dissimilarities among INT4 LoRA high-quality-tuning and QLoRA in terms of precision and speed. A further member explained that QLoRA with HQQ will involve frozen quantized weights, would not use tinnygemm, and makes use of dequantizing together with torch.matmulLLM inference within a fo