Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,055

Base only

Active filters: ggml

unsloth/Z-Image-Turbo-GGUF

Text-to-Image • 6B • Updated Jan 8 • 464k • 270

unsloth/FLUX.2-klein-9B-GGUF

Image-to-Image • 9B • Updated Jan 16 • 305k • 357

unsloth/LTX-2.3-GGUF

Image-to-Video • 21B • Updated Apr 20 • 335k • 579

Serveurperso/Qwen3-TTS-GGUF

Text-to-Speech • 0.9B • Updated 17 days ago • 245k • 51

unsloth/FLUX.2-klein-4B-GGUF

Image-to-Image • 4B • Updated Jan 16 • 292k • 225

unsloth/Z-Image-GGUF

Text-to-Image • 6B • Updated Jan 28 • 106k • 198

Serveurperso/OmniVoice-GGUF

Text-to-Speech • 0.6B • Updated 17 days ago • 37.5k • 67

microsoft/VibeVoice-ASR-BitNet

Automatic Speech Recognition • 0.3B • Updated Jul 24 • 51.4k • 201

HoppouAI/Breeze-TTS-2.cpp

Text-to-Speech • 3B • Updated 30 days ago • 13.8k • 21

unsloth/Qwen-Image-Layered-GGUF

Image-Text-to-Image • 20B • Updated Jan 9 • 104k • 69

Serveurperso/ACE-Step-1.5-GGUF

0.7B • Updated 14 days ago • 69.2k • 96

LocalAI-io/Llama-3-Kimodo-GGML

8B • Updated 9 days ago • 202k • 6

imYChaudhary22/zenvoice-hinglish-prime-ggml

Updated 4 days ago • 2

afrideva/tau-0.5B-instruct-GGUF

Text Generation • 0.6B • Updated Mar 25, 2024 • 283 • 1

unsloth/FLUX.2-dev-GGUF

Image-to-Image • 32B • Updated Dec 10, 2025 • 115k • 93

Pomni/whisper-large-v3-russian-ties-podlodka-v1.2-ggml-allquants

Automatic Speech Recognition • Updated Feb 20 • 8

continuum-ai/qwen3-coder-30b-a3b-compacted-19b-256k

Text Generation • 20B • Updated Apr 11 • 1.22k • 4

cstr/qwen3-forced-aligner-0.6b-GGUF

Automatic Speech Recognition • 0.9B • Updated Aug 2 • 3.63k • 5

cstr/kokoro-voices-GGUF

Text-to-Speech • 131k • Updated Aug 3 • 2.96k • 3

evilfreelancer/whisper-podlodka-turbo-GGUF

Updated May 1 • 3

cstr/madlad400-3b-mt-GGUF

Translation • 3B • Updated Aug 5 • 5.07k • 1

Nic22Of2003/Qwen3.5-2B-Uncensored-HauhauCS-Aggressive-IQ4_NL

Text Generation • 2B • Updated May 10 • 685 • 3

mudler/locate-anything.cpp-gguf

Object Detection • 4B • Updated Jun 11 • 5.12M • 15

FunAudioLLM/SenseVoiceSmall-GGUF

Automatic Speech Recognition • 0.2B • Updated Jun 21 • 4.69k • 14

mudler/ced-gguf

Audio Classification • 85.7M • Updated Jun 21 • 538k • 4

ilintar/trellis2-gguf

Image-to-3D • 0.2B • Updated Jul 27 • 97.5k • 10

kdes70/whisper-large-v3-ru-podlodka-ggml

Updated Jul 5 • 1

realrebelai/LingBot-30B-3B_GGUF_ComfyUI

Text-to-Video • 30B • Updated Jul 12 • 385 • 13

LocalAI-io/TRELLIS.2-4B-GGUF

Image-to-3D • 0.5B • Updated Jul 16 • 11.4k • 13

LocalAI-io/TRELLIS-image-large-GGUF

Image-to-3D • 73.7M • Updated Jul 16 • 1.53k • 2