A individual contribution was famous in which a user created a fused GEMM for int4, which can be successful for teaching with fixed sequence lengths, delivering the fastest solution.LORA overfitting considerations: One more user queried whether drastically decreased schooling decline in comparison with validation decline signals overfitting, regard