Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

quantization-aware-training

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

54

Base only

Active filters: quantization-aware-training

QUASAR-QAT/Qwen3.8-27B-QUASAR-NVFP4

Image-Text-to-Text • 28B • Updated 2 days ago • 36k • 122

mmaccrate/gemma-4-E2B-it-QAD-GGUF

Text Generation • 5B • Updated 2 days ago • 167 • 2

QUASAR-QAT/gemma-4-12B-it-QUASAR-Q4_0-GGUF

Image-Text-to-Text • 12B • Updated 8 minutes ago • 22 • 2

QUASAR-QAT/Muse-Glimmer-30B-QUASAR-NVFP4

Image-Text-to-Text • 30B • Updated about 19 hours ago • 19 • 2

QUASAR-QAT/Qwen3.5-4B-QUASAR-NVFP4

Image-Text-to-Text • 5B • Updated 1 day ago • 72 • 1

QUASAR-QAT/gemma-4-E4B-it-QUASAR-Q4_0-GGUF

Image-Text-to-Text • 7B • Updated 17 minutes ago • 25 • 1

QUASAR-QAT/gemma-4-E4B-it-QUASAR-W4A16-G64

Any-to-Any • 8B • Updated 25 minutes ago • 9 • 1

QUASAR-QAT/gemma-4-12B-it-QUASAR-W4A16-G64

Any-to-Any • 12B • Updated 25 minutes ago • 7 • 1

QUASAR-QAT/Muse-Glimmer-30B-QUASAR-Q4_0-GGUF

Text Generation • 28B • Updated about 19 hours ago • 16 • 1

QUASAR-QAT/Muse-Glimmer-30B-QUASAR-NVFP4-W4A4

Image-Text-to-Text • 30B • Updated about 19 hours ago • 14 • 2

Thomaschtl/qwen3-0.6b-qat-test

Text Generation • Updated Jun 3, 2025

Thomaschtl/qwen3-06b-qat-test

Text Generation • Updated Jun 3, 2025 • 1

Thomaschtl/test2

Text Generation • Updated Jun 4, 2025 • 5

Thomaschtl/test3

Text Generation • 0.2B • Updated Jun 4, 2025 • 6

tokenlabsdotrun/Llama-3.1-8B-Unsloth-FP8_INT4-QAT

Text Generation • Updated Jan 19 • 4

shivnathtathe/T4NT-0.5B

Text Generation • Updated Mar 24 • 12 • 2

Venugopalan2610/BCJR-QAT-Llama-3.2-1B-2bit

jpcurada/SmolLM2-1.7B-Scheduled-QAT-Linear-INT4

Text Generation • 2B • Updated May 5 • 9

jpcurada/SmolLM2-1.7B-Scheduled-QAT-Linear-GGUF

Text Generation • 2B • Updated May 5 • 26 • 1

KEVIN04087/edgevl-ovc-scannet

ForeverBlue/Qwen3-VL-2B-GRACE-W4G128

Image-Text-to-Text • 2B • Updated 29 days ago • 35 • 1

ForeverBlue/Qwen3-VL-2B-GRACE-W8G128

Image-Text-to-Text • 2B • Updated 29 days ago • 37 • 1

Debanjan24/volumetric-ptv3-qat-8bit

ForeverBlue/LLaVA-1.5-7B-GRACE-W4G128

Image-Text-to-Text • 7B • Updated Jun 3 • 5 • 1

ForeverBlue/LLaVA-1.5-7B-GRACE-W4G128-AWQ

Image-Text-to-Text • 1B • Updated 30 days ago • 21 • 1

boxwrench/gemma-4-qat-mtp-assistant-heads

0.4B • Updated Jun 6 • 200 • 4

sprapp/sprapp-smollm2-360m-ternary

Text Generation • Updated Jun 8

sprapp/miny-360m-ternary

Text Generation • Updated Jun 9

sprapp/meeny

Text Generation • Updated Jun 10

antoniosmich/Orbination-Whisper-AI

Automatic Speech Recognition • Updated Jun 28 • 1