All Supported Models

29681 AI models · 198875 quantization formats tracked

C

C0Ld Smi1E

1 models

resume-reader-best

Unknown 8K ctx
Q8_0
0GB file 2GB
C

C10 X

4 models

Nanbeige4-3B-Thinking-2511-Claude-4.5-Opus-High-Reasoning-Distill-heretic-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Nanbeige4-3B-Thinking-2511-Claude-4.5-Opus-High-Reasoning-Distill-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Nanbeige4-3B-Thinking-2511-Claude-4.5-Opus-High-Reasoning-Distill-V2-heretic-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Qwen3-4B-Thinking-2507-opus-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB
C

C3 D S

3 models

CARDS-Qwen3.5-27B-GGUF

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB
Q8_0
28.69GB file 31.13GB
BF16
54GB file 56.44GB

CARDS-Qwen3.5-4B-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

CARDS-Qwen3.5-9B-GGUF

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB
C

C3Ts

1 models

newmodelGGUF

Unknown 8K ctx
FP16
0GB file 2GB
C

C4Goul

1 models

XortronCriminalComputingConfig-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
C

C4Tdr0Ut

1 models

grok-oss

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
C

C516A

2 models

gemma-3-12b-it

12B 8K ctx
Q2_K
3.75GB file 5.95GB
Q3_K_M
5.25GB file 7.45GB
Q3_K_S
5.25GB file 7.45GB
Q4_K_M
6.75GB file 8.95GB
Q4_0
6.75GB file 8.95GB
Q5_K
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB

quantized-codegemma-7b-it

12B 8K ctx
Q2_K
3.75GB file 5.95GB
Q3_K_S
5.25GB file 7.45GB
Q3_K_M
5.25GB file 7.45GB
Q4_K
6.75GB file 8.95GB
Q4_0
6.75GB file 8.95GB
Q4_K_M
6.75GB file 8.95GB
Q5_K
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB
C

Caio Xapelaum

3 models

Llama-3.1-Storm-8B-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

Qwen2.5-Coder-1.5B-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

tiny_starcoder_py-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
C

Calandracas

1 models

gpt-oss-120b-Derestricted-GGUF

120B 8K ctx
Q4_K_M
67.5GB file 71.47GB
C

Calcuis

5 models

deepseek-r1

671B 8K ctx
Q2_0
209.69GB file 222.68GB
Q3_0
293.56GB file 306.55GB
Q4_1
377.44GB file 390.43GB
Q4_0
377.44GB file 390.43GB
Q5_1
461.31GB file 474.3GB
Q5_0
461.31GB file 474.3GB
Q6_0
545.19GB file 558.18GB
Q8_0
712.94GB file 725.93GB

olmo-gguf

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

openmath2

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_1
4.5GB file 6.63GB
Q4_0
4.5GB file 6.63GB
Q5_1
5.5GB file 7.63GB
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

phi3

Unknown 8K ctx
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB
Q5_1
0GB file 2GB
Q1_0
0GB file 2GB
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q5_0
0GB file 2GB

phi4

Unknown 8K ctx
Q2_0
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB
Q3_0
0GB file 2GB