Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

174

Base only

Active filters: affine

lukaskremla/Qwen3.8-27B-3bit-MLX-TextOnly

Text Generation • 3B • Updated 7 days ago • 3.37k • 5

lukaskremla/Qwen3.8-27B-2bit-MLX-TextOnly

Text Generation • 3B • Updated 7 days ago • 3.23k • 3

lukaskremla/Qwen3.8-27B-3bit-MLX

Image-Text-to-Text • 4B • Updated 7 days ago • 1.02k • 2

lukaskremla/Qwen3.8-27B-4bit-MLX-TextOnly

Text Generation • 4B • Updated 7 days ago • 735 • 1

abnormalmapstudio/Qwen3-Next-80B-A3B-Thinking-6bit-mlx

Text Generation • Updated Sep 15, 2025 • 1

abnormalmapstudio/Qwen3-Next-80B-A3B-Thinking-8bit-mlx

Text Generation • Updated Sep 15, 2025

carlorrr/affine-0004-improved

Text Generation • 4B • Updated Oct 30, 2025 • 9

lyraresearchlabs/Affine-S3-GAME

Reinforcement Learning • 4B • Updated Dec 29, 2025 • 4

james-unicorn/affine-train-1

Text Generation • 4B • Updated Jan 26 • 7

james-unicorn/affine-2-5C5iKrLBTwNTuQdC1VB54tbjHVidxyjkh49AcYJ3zgqtkqgH

Text Generation • 4B • Updated Jan 27 • 6

rautaditya/Qwen3-4B-Instruct-MLX-4bit

Text Generation • 0.6B • Updated Mar 28 • 17

Deviad/DeepSeek-V4-Flash-MLX-Q4Q8

Text Generation • 56B • Updated Apr 29 • 224

lemuralabs/DeepSeek-V4-Flash-5bit-mlx

Text Generation • 53B • Updated 17 days ago • 717

lemuralabs/DeepSeek-V4-Flash-6bit-mlx

Text Generation • 62B • Updated 17 days ago • 804

ekryski/SmolLM2-360M-Instruct-4bit

96.4M • Updated May 27 • 13

ekryski/Soprano-1.1-80M-4bit

24.7M • Updated May 27 • 17

ekryski/Nemotron-H-4B-Base-8K-4bit

1B • Updated May 27 • 11

ekryski/FastVLM-0.5B-4bit

0.3B • Updated May 27 • 22

ekryski/Qwen3.5-0.8B-2bit

0.4B • Updated May 26 • 23

majentik/MERaLiON-3-3B-ASR-MLX-8bit

Automatic Speech Recognition • 1B • Updated about 3 hours ago • 27

ekryski/SmolLM-360M-Instruct-4bit

96.4M • Updated May 27 • 7

ekryski/Llama-3.1-Nemotron-Nano-VL-8B-V1-4bit

3B • Updated May 27 • 47 • 1

ekryski/OLMo-2-0425-1B-Instruct-4bit

0.6B • Updated May 27 • 27

ekryski/starcoder2-3b-4bit

0.6B • Updated May 27 • 40

ekryski/granite-3.0-2b-instruct-4bit

0.6B • Updated May 27 • 19 • 1

ekryski/internlm2-chat-1_8b-4bit

0.5B • Updated May 27 • 15

ekryski/Nemotron-Nano-12B-v2-VL-4bit

4B • Updated May 28 • 30

ekryski/fish-audio-s2-pro-4bit

1B • Updated May 27 • 21

ekryski/diar_streaming_sortformer_4spk-v2.1-4bit

30.2M • Updated May 27 • 10

lemuralabs/Step-3.7-Flash-OptiQ-3.7bpw-mlx

Image-Text-to-Text • 30B • Updated 17 days ago • 225 • 3