Public EXL3 trellis quantizations of thinkingmachines/Inkling-Small from 2.0 through 5.0 bpw.
0xSero
0xSero
AI & ML interests
Quantizing, benchmarking, training, and building.
Recent Activity
published a model about 10 hours ago
0xSero/deepseek-v4-flash-0731-spark updated a model about 11 hours ago
0xSero/deepseek-v4-flash-0731-spark updated a model about 12 hours ago
0xSero/DeepSeek-V4-Flash-0731-EXL3-3.0bpwOrganizations
Gemma — REAP
REAP-pruned Gemma-4 MoE.
Proven REAPs
Benchmarked REAP checkpoints with >=500 all-time downloads. GLM/Qwen/MiniMax/DeepSeek/Kimi/gemma.
MiniMax — REAP
REAP-pruned & quantized MiniMax-M2.1 / M2.7.
Trinity — REAP
REAP-pruned & quantized Trinity-Large-Thinking.
Datasets — observations & calibration
REAP layerwise observations, calibration sets, and training data.
Qwen — REAP
REAP-pruned & quantized Qwen3.5 / 3.6 / Coder variants.
GLM — REAP
REAP-pruned & quantized GLM-4.x / 5 / 5.1 (+ Flash fine-tunes).
DeepSeek — REAP
REAP-pruned & quantized DeepSeek-V4-Flash / V3.2.
Nemotron — REAP
REAP-pruned & quantized NVIDIA Nemotron-3-Super.
Other models
Hy3, Kimi-K2.5, INTELLECT-3, NousCoder.
Inkling-Small EXL3 Quantization Suite
Public EXL3 trellis quantizations of thinkingmachines/Inkling-Small from 2.0 through 5.0 bpw.
Qwen — REAP
REAP-pruned & quantized Qwen3.5 / 3.6 / Coder variants.
Gemma — REAP
REAP-pruned Gemma-4 MoE.
GLM — REAP
REAP-pruned & quantized GLM-4.x / 5 / 5.1 (+ Flash fine-tunes).
Proven REAPs
Benchmarked REAP checkpoints with >=500 all-time downloads. GLM/Qwen/MiniMax/DeepSeek/Kimi/gemma.
DeepSeek — REAP
REAP-pruned & quantized DeepSeek-V4-Flash / V3.2.
MiniMax — REAP
REAP-pruned & quantized MiniMax-M2.1 / M2.7.
Nemotron — REAP
REAP-pruned & quantized NVIDIA Nemotron-3-Super.
Trinity — REAP
REAP-pruned & quantized Trinity-Large-Thinking.
Other models
Hy3, Kimi-K2.5, INTELLECT-3, NousCoder.
Datasets — observations & calibration
REAP layerwise observations, calibration sets, and training data.