inference-optimization/Llama-3.1-8B-Instruct-NVFP4
5B • Updated • 24 • 1
nvfp4-llama3.1-8b-ablations
-
-
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ-BlockSize16
5B • Updated • 12 • 1 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ
5B • Updated • 24 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ-SmoothQuant
5B • Updated • 24 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-SmoothQuant
5B • Updated • 22