All Supported Models

29681 AI models · 198875 quantization formats tracked

N

No Quest

2 models

gemma-2bfr

2B 8K ctx
FP16
4GB file 6.03GB

LLamandementFineTuneAvecNotation16QGguf

Unknown 8K ctx
FP16
0GB file 2GB
N

Noah Adamson

1 models

silma-ai.SILMA-Kashif-2B-Instruct-v1.0-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
N

Noah The G

1 models

Qwen2.5-Coder-1.5B-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB
N

Nobody Who

5 models

Google_Gemma3-1B-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

Google_Gemma3-270M-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB

Qwen_Qwen3-0.6B-GGUF

0.6B 8K ctx
Q4_K_M
0.34GB file 2.35GB

Qwen_Qwen3-1.7B-GGUF

1.7B 8K ctx
Q4_K_M
0.96GB file 2.99GB

Qwen_Qwen3-4B-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
N

Noctrex

106 models

AI21-Jamba-Mini-1.7-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

AI21-Jamba2-Mini-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

DavidAU-Llama-3.2-8X3B-MOE-Dark-Champion-Instruct-uncensored-abliterated-18.4B-MXFP4_MOE-GGUF

3B 8K ctx
FP4
3GB file 5.05GB

DeepSeek-MoE-16B-Chat-MXFP4_MOE-GGUF

16B 8K ctx
FP4
16GB file 18.26GB

dolphin-2.7-mixtral-8x7b-MXFP4_MOE-GGUF

7B 8K ctx
FP4
7GB file 9.11GB

Dolphin-Xgen-RL-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q3_M
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_NL
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

ERNIE-4.5-21B-A3B-PT-MXFP4_MOE-GGUF

21B 8K ctx
FP4
21GB file 23.34GB

ERNIE-4.5-21B-A3B-Thinking-MXFP4_MOE-GGUF

21B 8K ctx
FP4
21GB file 23.34GB

GLM-4.5-Air-Derestricted-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

GLM-4.5-Air-REAP-82B-A12B-MXFP4_MOE-GGUF

82B 8K ctx
FP4
82GB file 85.34GB

GLM-4.7-Flash-Claude-Opus-4.5-High-Reasoning-Distill

Unknown 8K ctx
FP4
0GB file 2GB

GLM-4.7-Flash-i1-MXFP4_MOE_XL-exp-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

GLM-4.7-Flash-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

GLM-4.7-Flash-REAP-23B-A3B-MXFP4_MOE-GGUF

23B 8K ctx
FP4
23GB file 25.38GB

GLM-4.7-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

GLM-4.7-REAP-218B-A32B-MXFP4_MOE-GGUF

218B 8K ctx
FP4
218GB file 223.57GB

Granite-4.0-H-Small-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

Granite-4.0-H-Tiny-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

GroveMoE-Inst-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

Huihui-gpt-oss-120b-abliterated-MXFP4_MOE-GGUF

120B 8K ctx
FP4
120GB file 123.97GB

Huihui-gpt-oss-20b-abliterated-v2-MXFP4_MOE-GGUF

20B 8K ctx
FP4
20GB file 22.33GB

Huihui-Granite-4.0-H-Micro-abliterated-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

Huihui-Granite-4.0-H-Tiny-abliterated-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

Huihui-LFM2-8B-A1B-abliterated-MXFP4_MOE-GGUF

8B 8K ctx
FP4
8GB file 10.13GB

Huihui-Ling-mini-2.0-abliterated-i1-GGUF

1B 8K ctx
Q3_M
0.44GB file 2.46GB
Q4_K_M
0.56GB file 2.58GB
Q4_NL
0.56GB file 2.58GB
Q4_XS
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
FP4
1GB file 3.02GB
Q8_0
1.06GB file 3.08GB

Huihui-Ling-mini-2.0-abliterated-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

Huihui-MiroThinker-v1.0-30B-abliterated-MXFP4_MOE-GGUF

30B 8K ctx
FP4
30GB file 32.49GB

Huihui-MiroThinker-v1.0-8B-abliterated-GGUF

8B 8K ctx
Q3_K_M
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Huihui-MiroThinker-v1.5-30B-abliterated-MXFP4_MOE-GGUF

30B 8K ctx
FP4
30GB file 32.49GB

Huihui-MoE-12B-A4B-abliterated-MXFP4_MOE-GGUF

12B 8K ctx
FP4
12GB file 14.2GB

Huihui-MoE-23B-A4B-abliterated-MXFP4_MOE-GGUF

23B 8K ctx
FP4
23GB file 25.38GB

Huihui-MoE-4.8B-A1.7B-abliterated-MXFP4_MOE-GGUF

4.8B 8K ctx
FP4
4.8GB file 6.88GB

Huihui-MoE-60B-A3B-abliterated-MXFP4_MOE-GGUF

60B 8K ctx
FP4
60GB file 62.98GB

Huihui-Orchestrator-8B-abliterated-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Huihui-Qwen3-Next-80B-A3B-Instruct-abliterated-MXFP4_MOE-GGUF

80B 8K ctx
FP4
80GB file 83.31GB

Huihui-Qwen3-Next-80B-A3B-Thinking-abliterated-MXFP4_MOE-GGUF

80B 8K ctx
FP4
80GB file 83.31GB

Huihui-QwenLong-L1.5-30B-A3B-abliterated-MXFP4_MOE-GGUF

30B 8K ctx
FP4
30GB file 32.49GB

Huihui-Ring-mini-2.0-abliterated-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

Huihui-Tongyi-DeepResearch-30B-A3B-abliterated-MXFP4_MOE-GGUF

30B 8K ctx
FP4
30GB file 32.49GB

HyperNova-60B-MXFP4_MOE-GGUF

60B 8K ctx
FP4
60GB file 62.98GB

INTELLECT-3.1-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

kanana-1.5-15.7b-a3b-instruct-MXFP4_MOE-GGUF

15.7B 8K ctx
FP4
15.7GB file 17.96GB

Kimi-Linear-48B-A3B-Instruct-MXFP4_MOE-GGUF

48B 8K ctx
FP4
48GB file 50.79GB

LFM2-24B-A2B-MXFP4_MOE-GGUF

24B 8K ctx
FP4
24GB file 26.39GB

LFM2-8B-A1B-MXFP4_MOE-GGUF

8B 8K ctx
FP4
8GB file 10.13GB
Q8_XL
8.5GB file 10.63GB

Ling-Coder-lite-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

Ling-flash-2.0-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

Ling-lite-1.5-2507-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

Ling-Mini-2.0-Identity-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

Ling-mini-2.0-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

LLaDA-MoE-7B-A1B-Instruct-MXFP4_MOE-GGUF

7B 8K ctx
FP4
7GB file 9.11GB

LLaDA-MoE-7B-A1B-Instruct-TD-MXFP4_MOE-GGUF

7B 8K ctx
FP4
7GB file 9.11GB

Llama-3.3-8B-Instruct-128k-abliterated-GGUF

8B 8K ctx
Q3_M
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Llama-4-Scout-17B-16E-Instruct-MXFP4_MOE-GGUF

17B 8K ctx
FP4
17GB file 19.28GB

Llama3.2-ColdBrew-4x3B-Argon-test1-MXFP4_MOE-GGUF

3B 8K ctx
FP4
3GB file 5.05GB

MiniMax-M2.5-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

MiniMax-M2.5-REAP-139B-A10B-MXFP4_MOE-GGUF

139B 8K ctx
FP4
139GB file 143.28GB

MiniMax-M2.5-REAP-172B-A10B-MXFP4_MOE-GGUF

172B 8K ctx
FP4
172GB file 176.82GB

MiroThinker-1.7-mini-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

MiroThinker-v1.0-30B-MXFP4_MOE-GGUF

30B 8K ctx
FP4
30GB file 32.49GB

MiroThinker-v1.5-30B-MXFP4_MOE-GGUF

30B 8K ctx
FP4
30GB file 32.49GB

Mistral-7B-Instruct-v0.3-abliterated-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

Mistral-7B-Instruct-v0.3-BF16-GGUF

7B 8K ctx
BF16
14GB file 16.11GB

Mistral-Small-4-119B-2603-MXFP4_MOE-GGUF

119B 8K ctx
FP4
119GB file 122.95GB
BF16
238GB file 241.95GB

Mixtral-8x7B-Instruct-v0.1-MXFP4_MOE-GGUF

7B 8K ctx
FP4
7GB file 9.11GB

Moonlight-16B-A3B-Instruct-MXFP4_MOE-GGUF

16B 8K ctx
FP4
16GB file 18.26GB

Nemotron-3-Nano-30B-A3B-MXFP4_MOE-GGUF

30B 8K ctx
FP4
30GB file 32.49GB

Nemotron-3-Nano-Omni-30B-A3B-Reasoning-MXFP4_MOE-GGUF

30B 8K ctx
FP4
30GB file 32.49GB
BF16
60GB file 62.49GB

Nemotron-Cascade-14B-Thinking-MXFP4-GGUF

14B 8K ctx
FP4
14GB file 16.23GB

Nemotron-Cascade-2-30B-A3B-MXFP4_MOE-GGUF

30B 8K ctx
FP4
30GB file 32.49GB

Olmo-3-7B-Instruct-abliterated-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

OLMoE-1B-7B-0125-Instruct-MXFP4_MOE-GGUF

1B 8K ctx
FP4
1GB file 3.02GB

openPangu-Embedded-1B-V1.1-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q4_NL
0.56GB file 2.58GB
Q4_XS
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

openPangu-Embedded-7B-DeepDiver-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

openPangu-Embedded-7B-V1.1-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

OpenThinker-Agent-v1-abliterated-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_NL
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

P1-30B-A3B-MXFP4_MOE-GGUF

30B 8K ctx
FP4
30GB file 32.49GB

Phi-3.5-MoE-instruct-MXFP4_MOE-GGUF

3.8B 8K ctx
FP4
3.8GB file 5.86GB

Phi-mini-MoE-instruct-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

Pristine-8B-A1B-MXFP4_MOE-GGUF

8B 8K ctx
FP4
8GB file 10.13GB

PromptCoT-2.0-SelfPlay-30B-A3B-MXFP4_MOE-GGUF

30B 8K ctx
FP4
30GB file 32.49GB

Qwen3-30B-A3B-CoderThinking-YOYO-linear-MXFP4_MOE-GGUF

30B 8K ctx
FP4
30GB file 32.49GB

Qwen3-30B-A3B-Deepseek-Distill-Instruct-2507-MXFP4_MOE-GGUF

30B 8K ctx
FP4
30GB file 32.49GB

Qwen3-30B-A3B-Mixture-2507-MXFP4_MOE-GGUF

30B 8K ctx
FP4
30GB file 32.49GB

Qwen3-30B-A3B-YOYO-V5-GGUF

30B 8K ctx
Q4_NL
16.88GB file 19.37GB
FP4
30GB file 32.49GB

Qwen3-42B-A3B-2507-Thinking-Abliterated-uncen-TOTAL-RECALL-v2-Medium-MASTER-CODER-MXFP4_MOE-GGUF

42B 8K ctx
FP4
42GB file 44.69GB

Qwen3-Coder-Next-MXFP4_MOE-GGUF

57B 8K ctx
FP4
57GB file 59.93GB

Qwen3-Coder-Next-REAM-MXFP4_MOE-GGUF

57B 8K ctx
FP4
57GB file 59.93GB

Qwen3-Coder-Next-REAP-48B-A3B-MXFP4_MOE-GGUF

48B 8K ctx
FP4
48GB file 50.79GB

Qwen3-Coder-REAP-246B-A35B-MXFP4_MOE-GGUF

246B 8K ctx
FP4
246GB file 252.03GB

Qwen3-Coder-REAP-25B-A3B-MXFP4_MOE-GGUF

25B 8K ctx
FP4
25GB file 27.41GB

Qwen3-Next-80B-A3B-Instruct-MXFP4_MOE-GGUF

80B 8K ctx
FP4
80GB file 83.31GB

Qwen3-Next-80B-A3B-Thinking-MXFP4_MOE-GGUF

80B 8K ctx
FP4
80GB file 83.31GB

QwenLong-L1.5-30B-A3B-MXFP4_MOE-GGUF

30B 8K ctx
FP4
30GB file 32.49GB

Ring-flash-2.0-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

Ring-mini-2.0-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

Ring-mini-sparse-2.0-exp-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

rnj-1-instruct-GGUF

1B 8K ctx
Q3_M
0.44GB file 2.46GB
Q4_K_M
0.56GB file 2.58GB
Q4_NL
0.56GB file 2.58GB
Q4_XS
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

SERA-32B-GGUF

32B 8K ctx
Q3_M
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q4_NL
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_K_M
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

SERA-8B-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

SmallThinker-21B-A3B-Instruct-MXFP4_MOE-GGUF

21B 8K ctx
FP4
21GB file 23.34GB

SmallThinker-4B-A0.6B-Instruct-MXFP4_MOE-GGUF

4B 8K ctx
FP4
4GB file 6.07GB

Step-3.5-Flash-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

Tongyi-DeepResearch-30B-A3B-MXFP4_MOE-GGUF

30B 8K ctx
FP4
30GB file 32.49GB

Trinity-Mini-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB

Trinity-Nano-Preview-MXFP4_MOE-GGUF

Unknown 8K ctx
FP4
0GB file 2GB
N

Nodinner

1 models

gemma-2-2b-it-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB
N

Nodmix

3 models

Nodmix

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
FP16
6GB file 8.05GB

Nodmix-Coder-14B-Instruct-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB
FP16
28GB file 30.23GB

Nodmix-Q3

Unknown 8K ctx
BF16
0GB file 2GB
Q3_0
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_0
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_K_M
0GB file 2GB
Q8_0
0GB file 2GB
N

Noel Jacob

1 models

Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
N

Noidname

1 models

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
N

Noir Zangetsu

1 models

Qwen2.5-3B-Flutter

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB