Releasing HQQ Llama-3.1-70b 4-bit quantized version! Check it out at
mobiuslabsgmbh/Llama-3.1-70b-instruct_4bitgs64_hqq
.
Achieves 99% of the base model performance across various benchmarks! Details in the model card.https://huggingface.co/mobiuslabsgmbh/Llama-3.1-70b-instruct_4bitgs64_hqq
mobiuslabsgmbh/Llama-3.1-70b-instruct_4bitgs64_hqq
.
Achieves 99% of the base model performance across various benchmarks! Details in the model card.https://huggingface.co/mobiuslabsgmbh/Llama-3.1-70b-instruct_4bitgs64_hqq
huggingface.co
mobiuslabsgmbh/Llama-3.1-70b-instruct_4bitgs64_hqq · Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.