majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-IQ4_XS
Image-Text-to-Text • 25B • Updated • 435
Gemma 4 — quantized (GGUF + MLX)
Quantized GGUF and MLX packs of the Gemma 4 family (dense and MoE variants) for local inference.
-
-
majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-Q2_K
Image-Text-to-Text • 25B • Updated • 238 -
majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-Q3_K_M
Image-Text-to-Text • 25B • Updated • 189 -
majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-Q4_K_M
Image-Text-to-Text • 25B • Updated • 242 • 1 -
majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-Q5_K_M
Image-Text-to-Text • 25B • Updated • 270 -
majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-Q8_0
Image-Text-to-Text • 25B • Updated • 160 • 1 -
majentik/gemma-4-26B-A4B-it-RotorQuant-MLX-2bit
Image-Text-to-Text • 26B • Updated • 212 -
majentik/gemma-4-26B-A4B-it-RotorQuant-MLX-4bit
Image-Text-to-Text • 26B • Updated • 114 -
majentik/gemma-4-26B-A4B-it-RotorQuant-MLX-8bit
Image-Text-to-Text • 26B • Updated • 169 • 1 -
majentik/gemma-4-26B-A4B-RotorQuant-GGUF-IQ4_XS
Image-Text-to-Text • 25B • Updated • 386 -
majentik/gemma-4-26B-A4B-RotorQuant-GGUF-Q2_K
Image-Text-to-Text • 25B • Updated • 189 -
majentik/gemma-4-26B-A4B-RotorQuant-GGUF-Q3_K_M
Image-Text-to-Text • 25B • Updated • 246 -
majentik/gemma-4-26B-A4B-RotorQuant-GGUF-Q4_K_M
Image-Text-to-Text • 25B • Updated • 400 • 5 -
majentik/gemma-4-26B-A4B-RotorQuant-GGUF-Q5_K_M
Image-Text-to-Text • 25B • Updated • 126 -
majentik/gemma-4-26B-A4B-RotorQuant-GGUF-Q8_0
Image-Text-to-Text • 25B • Updated • 120 -
majentik/gemma-4-26B-A4B-RotorQuant-MLX-2bit
Image-Text-to-Text • 26B • Updated • 155 -
majentik/gemma-4-26B-A4B-RotorQuant-MLX-4bit
Image-Text-to-Text • 26B • Updated • 52 -
majentik/gemma-4-26B-A4B-RotorQuant-MLX-8bit
Image-Text-to-Text • 26B • Updated • 55 -
majentik/gemma-4-31B-it-RotorQuant-GGUF-IQ4_XS
Image-Text-to-Text • 31B • Updated • 361 -
majentik/gemma-4-31B-it-RotorQuant-GGUF-Q2_K
Image-Text-to-Text • 31B • Updated • 135 -
majentik/gemma-4-31B-it-RotorQuant-GGUF-Q3_K_M
Image-Text-to-Text • 31B • Updated • 144 -
majentik/gemma-4-31B-it-RotorQuant-GGUF-Q4_K_M
Image-Text-to-Text • 31B • Updated • 152 -
majentik/gemma-4-31B-it-RotorQuant-GGUF-Q5_K_M
Image-Text-to-Text • 31B • Updated • 232 -
majentik/gemma-4-31B-it-RotorQuant-GGUF-Q8_0
Image-Text-to-Text • 31B • Updated • 153 • 1 -
majentik/gemma-4-31B-it-RotorQuant-MLX-2bit
Image-Text-to-Text • 31B • Updated • 51 -
majentik/gemma-4-31B-it-RotorQuant-MLX-4bit
Image-Text-to-Text • 31B • Updated • 82 • 2 -
majentik/gemma-4-31B-it-TurboQuant-MLX-8bit
Image-Text-to-Text • 31B • Updated • 174 • 3 -
majentik/gemma-4-31B-RotorQuant-GGUF-IQ4_XS
Image-Text-to-Text • 31B • Updated • 350 -
majentik/gemma-4-31B-RotorQuant-GGUF-Q2_K
Image-Text-to-Text • 31B • Updated • 138 -
majentik/gemma-4-31B-RotorQuant-GGUF-Q3_K_M
Image-Text-to-Text • 31B • Updated • 122 -
majentik/gemma-4-31B-RotorQuant-GGUF-Q4_K_M
Image-Text-to-Text • 31B • Updated • 142 -
majentik/gemma-4-31B-RotorQuant-GGUF-Q5_K_M
Image-Text-to-Text • 31B • Updated • 141 -
majentik/gemma-4-31B-RotorQuant-GGUF-Q8_0
Image-Text-to-Text • 31B • Updated • 112 • 1 -
majentik/gemma-4-31B-TurboQuant-MLX-2bit
Image-Text-to-Text • 31B • Updated • 64 • 1 -
majentik/gemma-4-31B-TurboQuant-MLX-4bit
Image-Text-to-Text • 31B • Updated • 126 • 2 -
majentik/gemma-4-31B-TurboQuant-MLX-8bit
Image-Text-to-Text • 31B • Updated • 59 • 1 -
majentik/gemma-4-E2B-it-RotorQuant-GGUF-IQ4_XS
Image-Text-to-Text • 5B • Updated • 404 • 1 -
majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q2_K
Image-Text-to-Text • 5B • Updated • 177 -
majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q3_K_M
Image-Text-to-Text • 5B • Updated • 129 -
majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q4_K_M
Image-Text-to-Text • 5B • Updated • 175 • 2 -
majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q5_K_M
Image-Text-to-Text • 5B • Updated • 145 • 2 -
majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q8_0
Image-Text-to-Text • 5B • Updated • 217 • 2 -
majentik/gemma-4-E2B-it-RotorQuant-MLX-2bit
Image-Text-to-Text • 5B • Updated • 54 -
majentik/gemma-4-E2B-it-RotorQuant-MLX-4bit
Image-Text-to-Text • 5B • Updated • 42 • 1 -
majentik/gemma-4-E2B-it-TurboQuant-MLX-8bit
Image-Text-to-Text • 5B • Updated • 43