All Supported Models

29681 AI models · 198875 quantization formats tracked

G

G T O M A83

1 models

Qwen2.5-Coder-1.5B-Instruct-GGUF

1.5B 8K ctx
Q4_K_M
0.84GB file 2.86GB
G

G T O83

1 models

modelos

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
G

G The Og

3 models

Qwen2.5-Coder-0.5B-IQ4_NL-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2.5-Coder-0.5B-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2.5-Coder-1.5B-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB
G

G W A N G J I K

1 models

Qwen2.5-1.5B-Instruct-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB
G

G023

4 models

Qwen3-1.77B-g023-GGUF

1.7B 8K ctx
Q8_0
1.81GB file 3.84GB
BF16
3.4GB file 5.43GB

qwen3-tiny-v1

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q3_K_M
0.74GB file 2.77GB
Q4_K_M
0.96GB file 2.99GB
Q6_K
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB

qwen3-tiny-v2

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q3_K_M
0.74GB file 2.77GB
Q4_K_M
0.96GB file 2.99GB
Q6_K
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB

qwen3-tiny-v2-finetuned

32B 8K ctx
Q8_0
34GB file 36.52GB
G

Gabriben

1 models

Qwen2.5-1.5B-Instruct-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB
G

Gabriel Sn

1 models

PartyUp-Qwen2.5-3B-v1

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
G

Gabrieliam

1 models

gpt-oss-20b-Derestricted-Q8_0-GGUF

20B 8K ctx
Q8_0
21.25GB file 23.58GB
G

Gabriellarson

44 models

AceReason-Nemotron-1.1-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_K_S
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_M
7GB file 9.11GB
Q1_S
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB

Devstral-Small-2507-GGUF

2507B 8K ctx
Q2_K
783.44GB file 826.51GB
Q2_K_S
783.44GB file 826.51GB
Q2_M
783.44GB file 826.51GB
Q2_S
783.44GB file 826.51GB
Q2_XS
783.44GB file 826.51GB
Q2_XXS
783.44GB file 826.51GB
Q3_K_L
1096.81GB file 1139.88GB
Q3_K_M
1096.81GB file 1139.88GB
Q3_K_S
1096.81GB file 1139.88GB
Q3_M
1096.81GB file 1139.88GB
Q3_S
1096.81GB file 1139.88GB
Q3_XS
1096.81GB file 1139.88GB
Q3_XXS
1096.81GB file 1139.88GB
Q4_0
1410.19GB file 1453.26GB
Q4_K_M
1410.19GB file 1453.26GB
Q4_K_S
1410.19GB file 1453.26GB
Q4_NL
1410.19GB file 1453.26GB
Q4_XS
1410.19GB file 1453.26GB
Q5_0
1723.56GB file 1766.63GB
Q5_K_M
1723.56GB file 1766.63GB
Q5_K_S
1723.56GB file 1766.63GB
Q6_K
2036.94GB file 2080.01GB
Q1_M
2507GB file 2550.07GB
Q1_S
2507GB file 2550.07GB
Q8_0
2663.69GB file 2706.76GB

ERNIE-4.5-21B-A3B-Thinking-GGUF

21B 8K ctx
Q2_K
6.56GB file 8.9GB
Q2_K_S
6.56GB file 8.9GB
Q2_M
6.56GB file 8.9GB
Q2_S
6.56GB file 8.9GB
Q2_XS
6.56GB file 8.9GB
Q2_XXS
6.56GB file 8.9GB
Q3_K_L
9.19GB file 11.53GB
Q3_K_M
9.19GB file 11.53GB
Q3_K_S
9.19GB file 11.53GB
Q3_M
9.19GB file 11.53GB
Q3_S
9.19GB file 11.53GB
Q3_XS
9.19GB file 11.53GB
Q3_XXS
9.19GB file 11.53GB
Q4_0
11.81GB file 14.15GB
Q4_K_M
11.81GB file 14.15GB
Q4_K_S
11.81GB file 14.15GB
Q4_NL
11.81GB file 14.15GB
Q4_XS
11.81GB file 14.15GB
Q5_0
14.44GB file 16.78GB
Q5_K_M
14.44GB file 16.78GB
Q5_K_S
14.44GB file 16.78GB
Q6_K
17.06GB file 19.4GB
Q8_0
22.31GB file 24.65GB

ERNIE-4.5-300B-A47B-PT-GGUF

300B 8K ctx
Q2_K
93.75GB file 100.67GB
Q3_K_M
131.25GB file 138.17GB
Q4_K_M
168.75GB file 175.67GB
Q5_K_M
206.25GB file 213.17GB
Q6_K
243.75GB file 250.67GB
Q8_0
318.75GB file 325.67GB

Foundation-Sec-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_S
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_S
2.5GB file 4.63GB
Q2_XS
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_S
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

gpt-oss-120b-GGUF

120B 8K ctx
Q4_0
67.5GB file 71.47GB
Q8_0
127.5GB file 131.47GB

gpt-oss-20b-GGUF

20B 8K ctx
Q4_0
11.25GB file 13.58GB
Q8_0
21.25GB file 23.58GB

GroveMoE-Inst-GGUF

Unknown 8K ctx
FP16
0GB file 2GB

Huihui-gpt-oss-20b-BF16-abliterated-GGUF

20B 8K ctx
Q4_K_M
11.25GB file 13.58GB
BF16
40GB file 42.33GB

ICONN-1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q2_K_S
0.31GB file 2.33GB
Q2_M
0.31GB file 2.33GB
Q2_S
0.31GB file 2.33GB
Q2_XS
0.31GB file 2.33GB
Q2_XXS
0.31GB file 2.33GB
Q3_K_L
0.44GB file 2.46GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_S
0.44GB file 2.46GB
Q3_M
0.44GB file 2.46GB
Q3_S
0.44GB file 2.46GB
Q3_XS
0.44GB file 2.46GB
Q3_XXS
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q4_XS
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q1_M
1GB file 3.02GB
Q1_S
1GB file 3.02GB
Q8_0
1.06GB file 3.08GB

Jan-nano-128k-GGUF

Unknown 8K ctx
Q1_M
0GB file 2GB
Q1_S
0GB file 2GB
Q2_K
0GB file 2GB
Q2_K_S
0GB file 2GB
Q2_M
0GB file 2GB
Q2_S
0GB file 2GB
Q2_XS
0GB file 2GB
Q2_XXS
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_M
0GB file 2GB
Q3_S
0GB file 2GB
Q3_XS
0GB file 2GB
Q3_XXS
0GB file 2GB
Q4_0
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_0
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

jupyter-agent-qwen3-4b-thinking-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q2_M
1.25GB file 3.32GB
Q2_S
1.25GB file 3.32GB
Q2_XXS
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q3_M
1.75GB file 3.82GB
Q3_S
1.75GB file 3.82GB
Q3_XXS
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_NL
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

LFM2-2.6B-GGUF

2.6B 8K ctx
Q2_K
0.81GB file 2.85GB
Q2_M
0.81GB file 2.85GB
Q2_S
0.81GB file 2.85GB
Q2_XXS
0.81GB file 2.85GB
Q3_K_L
1.14GB file 3.18GB
Q3_K_M
1.14GB file 3.18GB
Q3_K_S
1.14GB file 3.18GB
Q3_M
1.14GB file 3.18GB
Q3_S
1.14GB file 3.18GB
Q3_XXS
1.14GB file 3.18GB
Q4_0
1.46GB file 3.5GB
Q4_K_M
1.46GB file 3.5GB
Q4_K_S
1.46GB file 3.5GB
Q4_NL
1.46GB file 3.5GB
Q4_XS
1.46GB file 3.5GB
Q5_0
1.79GB file 3.83GB
Q5_K_M
1.79GB file 3.83GB
Q5_K_S
1.79GB file 3.83GB
Q6_K
2.11GB file 4.15GB
Q8_0
2.76GB file 4.8GB

LFM2-8B-A1B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_S
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_S
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
FP4
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB

Llama-3_3-Nemotron-Super-49B-v1_5-GGUF

49B 8K ctx
Q2_K
15.31GB file 18.11GB
Q2_K_S
15.31GB file 18.11GB
Q2_M
15.31GB file 18.11GB
Q2_S
15.31GB file 18.11GB
Q2_XS
15.31GB file 18.11GB
Q2_XXS
15.31GB file 18.11GB
Q3_K_L
21.44GB file 24.24GB
Q3_K_M
21.44GB file 24.24GB
Q3_K_S
21.44GB file 24.24GB
Q3_M
21.44GB file 24.24GB
Q3_S
21.44GB file 24.24GB
Q3_XS
21.44GB file 24.24GB
Q3_XXS
21.44GB file 24.24GB
Q4_0
27.56GB file 30.36GB
Q4_K_M
27.56GB file 30.36GB
Q4_K_S
27.56GB file 30.36GB
Q4_NL
27.56GB file 30.36GB
Q4_XS
27.56GB file 30.36GB
Q5_0
33.69GB file 36.49GB
Q5_K_M
33.69GB file 36.49GB
Q5_K_S
33.69GB file 36.49GB
Q6_K
39.81GB file 42.61GB
Q1_M
49GB file 51.8GB
Q1_S
49GB file 51.8GB
Q8_0
52.06GB file 54.86GB

Lucy-128k-GGUF

Unknown 8K ctx
Q1_M
0GB file 2GB
Q1_S
0GB file 2GB
Q2_K
0GB file 2GB
Q2_K_S
0GB file 2GB
Q2_M
0GB file 2GB
Q2_S
0GB file 2GB
Q2_XS
0GB file 2GB
Q2_XXS
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_M
0GB file 2GB
Q3_S
0GB file 2GB
Q3_XS
0GB file 2GB
Q3_XXS
0GB file 2GB
Q4_0
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_NL
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_0
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

Lucy-GGUF

Unknown 8K ctx
Q1_M
0GB file 2GB
Q1_S
0GB file 2GB
Q2_K
0GB file 2GB
Q2_K_S
0GB file 2GB
Q2_M
0GB file 2GB
Q2_S
0GB file 2GB
Q2_XS
0GB file 2GB
Q2_XXS
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_M
0GB file 2GB
Q3_S
0GB file 2GB
Q3_XS
0GB file 2GB
Q3_XXS
0GB file 2GB
Q4_0
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_NL
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_0
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

Magistral-Small-2507-GGUF

2507B 8K ctx
Q2_K
783.44GB file 826.51GB
Q2_K_S
783.44GB file 826.51GB
Q2_M
783.44GB file 826.51GB
Q2_S
783.44GB file 826.51GB
Q2_XS
783.44GB file 826.51GB
Q2_XXS
783.44GB file 826.51GB
Q3_K_L
1096.81GB file 1139.88GB
Q3_K_M
1096.81GB file 1139.88GB
Q3_K_S
1096.81GB file 1139.88GB
Q3_M
1096.81GB file 1139.88GB
Q3_S
1096.81GB file 1139.88GB
Q3_XS
1096.81GB file 1139.88GB
Q3_XXS
1096.81GB file 1139.88GB
Q4_0
1410.19GB file 1453.26GB
Q4_K_M
1410.19GB file 1453.26GB
Q4_K_S
1410.19GB file 1453.26GB
Q4_NL
1410.19GB file 1453.26GB
Q4_XS
1410.19GB file 1453.26GB
Q5_0
1723.56GB file 1766.63GB
Q5_K_M
1723.56GB file 1766.63GB
Q5_K_S
1723.56GB file 1766.63GB
Q6_K
2036.94GB file 2080.01GB
Q1_M
2507GB file 2550.07GB
Q1_S
2507GB file 2550.07GB
Q8_0
2663.69GB file 2706.76GB

NextCoder-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_L
6.13GB file 8.36GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q4_NL
7.88GB file 10.11GB
Q4_XS
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

NextCoder-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_K_S
10GB file 12.52GB
Q2_M
10GB file 12.52GB
Q2_S
10GB file 12.52GB
Q2_XS
10GB file 12.52GB
Q2_XXS
10GB file 12.52GB
Q3_K_L
14GB file 16.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_M
14GB file 16.52GB
Q3_S
14GB file 16.52GB
Q3_XS
14GB file 16.52GB
Q3_XXS
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_NL
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q1_M
32GB file 34.52GB
Q1_S
32GB file 34.52GB
Q8_0
34GB file 36.52GB

NextCoder-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_K_S
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_M
7GB file 9.11GB
Q1_S
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB

NFT-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_K_S
10GB file 12.52GB
Q2_M
10GB file 12.52GB
Q2_S
10GB file 12.52GB
Q2_XS
10GB file 12.52GB
Q2_XXS
10GB file 12.52GB
Q3_K_L
14GB file 16.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_M
14GB file 16.52GB
Q3_S
14GB file 16.52GB
Q3_XS
14GB file 16.52GB
Q3_XXS
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_NL
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q1_M
32GB file 34.52GB
Q1_S
32GB file 34.52GB
Q8_0
34GB file 36.52GB

NFT-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_K_S
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_M
7GB file 9.11GB
Q1_S
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB

NVIDIA-Nemotron-Nano-12B-v2-GGUF

12B 8K ctx
Q2_K
3.75GB file 5.95GB
Q2_K_S
3.75GB file 5.95GB
Q2_M
3.75GB file 5.95GB
Q2_S
3.75GB file 5.95GB
Q2_XS
3.75GB file 5.95GB
Q2_XXS
3.75GB file 5.95GB
Q3_K_L
5.25GB file 7.45GB
Q3_K_M
5.25GB file 7.45GB
Q3_K_S
5.25GB file 7.45GB
Q3_M
5.25GB file 7.45GB
Q3_S
5.25GB file 7.45GB
Q3_XS
5.25GB file 7.45GB
Q3_XXS
5.25GB file 7.45GB
Q4_0
6.75GB file 8.95GB
Q4_K_M
6.75GB file 8.95GB
Q4_K_S
6.75GB file 8.95GB
Q4_NL
6.75GB file 8.95GB
Q4_XS
6.75GB file 8.95GB
Q5_0
8.25GB file 10.45GB
Q5_K_M
8.25GB file 10.45GB
Q5_K_S
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

OpenBuddy-R1-0528-Distill-Qwen3-32B-Preview4-QAT-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_K_S
10GB file 12.52GB
Q2_M
10GB file 12.52GB
Q2_S
10GB file 12.52GB
Q2_XS
10GB file 12.52GB
Q2_XXS
10GB file 12.52GB
Q3_K_L
14GB file 16.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_M
14GB file 16.52GB
Q3_S
14GB file 16.52GB
Q3_XS
14GB file 16.52GB
Q3_XXS
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_NL
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q1_M
32GB file 34.52GB
Q1_S
32GB file 34.52GB
Q8_0
34GB file 36.52GB

OpenBuddy-R1-0528-Distill-Qwen3-32B-Preview6-QAT-200K-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_K_S
10GB file 12.52GB
Q2_M
10GB file 12.52GB
Q2_S
10GB file 12.52GB
Q2_XS
10GB file 12.52GB
Q2_XXS
10GB file 12.52GB
Q3_K_L
14GB file 16.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_M
14GB file 16.52GB
Q3_S
14GB file 16.52GB
Q3_XS
14GB file 16.52GB
Q3_XXS
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_NL
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q1_M
32GB file 34.52GB
Q1_S
32GB file 34.52GB
Q8_0
34GB file 36.52GB

OpenBuddy-R1-0528-Distill-Qwen3-32B-Preview7-QAT-200K-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_K_S
10GB file 12.52GB
Q2_M
10GB file 12.52GB
Q2_S
10GB file 12.52GB
Q2_XS
10GB file 12.52GB
Q2_XXS
10GB file 12.52GB
Q3_K_L
14GB file 16.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_M
14GB file 16.52GB
Q3_S
14GB file 16.52GB
Q3_XS
14GB file 16.52GB
Q3_XXS
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_NL
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

OpenCodeReasoning-Nemotron-1.1-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q2_K_S
4.38GB file 6.61GB
Q2_M
4.38GB file 6.61GB
Q2_S
4.38GB file 6.61GB
Q2_XS
4.38GB file 6.61GB
Q2_XXS
4.38GB file 6.61GB
Q3_K_L
6.13GB file 8.36GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q3_M
6.13GB file 8.36GB
Q3_S
6.13GB file 8.36GB
Q3_XS
6.13GB file 8.36GB
Q3_XXS
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q4_NL
7.88GB file 10.11GB
Q4_XS
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q1_M
14GB file 16.23GB
Q1_S
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB

OpenCodeReasoning-Nemotron-1.1-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_K_S
10GB file 12.52GB
Q2_M
10GB file 12.52GB
Q2_S
10GB file 12.52GB
Q2_XS
10GB file 12.52GB
Q2_XXS
10GB file 12.52GB
Q3_K_L
14GB file 16.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_M
14GB file 16.52GB
Q3_S
14GB file 16.52GB
Q3_XS
14GB file 16.52GB
Q3_XXS
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_NL
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q1_M
32GB file 34.52GB
Q1_S
32GB file 34.52GB
Q8_0
34GB file 36.52GB

OpenCodeReasoning-Nemotron-1.1-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_K_S
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_M
7GB file 9.11GB
Q1_S
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB

OpenReasoning-Nemotron-1.5B-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q2_K_S
0.47GB file 2.49GB
Q2_M
0.47GB file 2.49GB
Q2_S
0.47GB file 2.49GB
Q2_XS
0.47GB file 2.49GB
Q2_XXS
0.47GB file 2.49GB
Q3_K_L
0.66GB file 2.68GB
Q3_K_M
0.66GB file 2.68GB
Q3_K_S
0.66GB file 2.68GB
Q3_M
0.66GB file 2.68GB
Q3_S
0.66GB file 2.68GB
Q3_XS
0.66GB file 2.68GB
Q3_XXS
0.66GB file 2.68GB
Q4_0
0.84GB file 2.86GB
Q4_K_M
0.84GB file 2.86GB
Q4_K_S
0.84GB file 2.86GB
Q4_NL
0.84GB file 2.86GB
Q4_XS
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q5_K_M
1.03GB file 3.05GB
Q5_K_S
1.03GB file 3.05GB
Q6_K
1.22GB file 3.24GB
Q1_M
1.5GB file 3.52GB
Q1_S
1.5GB file 3.52GB
Q8_0
1.59GB file 3.61GB

OpenReasoning-Nemotron-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q2_K_S
4.38GB file 6.61GB
Q2_M
4.38GB file 6.61GB
Q2_S
4.38GB file 6.61GB
Q2_XS
4.38GB file 6.61GB
Q2_XXS
4.38GB file 6.61GB
Q3_K_L
6.13GB file 8.36GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q3_M
6.13GB file 8.36GB
Q3_S
6.13GB file 8.36GB
Q3_XS
6.13GB file 8.36GB
Q3_XXS
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q4_NL
7.88GB file 10.11GB
Q4_XS
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q1_M
14GB file 16.23GB
Q1_S
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB

OpenReasoning-Nemotron-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_K_S
10GB file 12.52GB
Q2_M
10GB file 12.52GB
Q2_S
10GB file 12.52GB
Q2_XS
10GB file 12.52GB
Q2_XXS
10GB file 12.52GB
Q3_K_L
14GB file 16.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_M
14GB file 16.52GB
Q3_S
14GB file 16.52GB
Q3_XS
14GB file 16.52GB
Q3_XXS
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_NL
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q1_M
32GB file 34.52GB
Q1_S
32GB file 34.52GB
Q8_0
34GB file 36.52GB

OpenReasoning-Nemotron-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_K_S
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_M
7GB file 9.11GB
Q1_S
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB

Phi-mini-MoE-instruct-GGUF

Unknown 8K ctx
Q1_M
0GB file 2GB
Q1_S
0GB file 2GB
Q2_K
0GB file 2GB
Q2_K_S
0GB file 2GB
Q2_M
0GB file 2GB
Q2_S
0GB file 2GB
Q2_XS
0GB file 2GB
Q2_XXS
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_M
0GB file 2GB
Q3_S
0GB file 2GB
Q3_XS
0GB file 2GB
Q3_XXS
0GB file 2GB
Q4_0
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_0
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

Qwen3-4B-Instruct-2507-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q2_K_S
1.25GB file 3.32GB
Q2_M
1.25GB file 3.32GB
Q2_S
1.25GB file 3.32GB
Q2_XS
1.25GB file 3.32GB
Q2_XXS
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q3_M
1.75GB file 3.82GB
Q3_S
1.75GB file 3.82GB
Q3_XS
1.75GB file 3.82GB
Q3_XXS
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_NL
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Qwen3-4B-Thinking-2507-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q2_K_S
1.25GB file 3.32GB
Q2_M
1.25GB file 3.32GB
Q2_S
1.25GB file 3.32GB
Q2_XS
1.25GB file 3.32GB
Q2_XXS
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q3_M
1.75GB file 3.82GB
Q3_S
1.75GB file 3.82GB
Q3_XS
1.75GB file 3.82GB
Q3_XXS
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_NL
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Seed-OSS-36B-Instruct-GGUF

36B 8K ctx
Q2_K
11.25GB file 13.84GB
Q2_K_S
11.25GB file 13.84GB
Q2_M
11.25GB file 13.84GB
Q2_S
11.25GB file 13.84GB
Q2_XS
11.25GB file 13.84GB
Q2_XXS
11.25GB file 13.84GB
Q3_K_L
15.75GB file 18.34GB
Q3_K_M
15.75GB file 18.34GB
Q3_K_S
15.75GB file 18.34GB
Q3_M
15.75GB file 18.34GB
Q3_S
15.75GB file 18.34GB
Q3_XS
15.75GB file 18.34GB
Q3_XXS
15.75GB file 18.34GB
Q4_0
20.25GB file 22.84GB
Q4_K_M
20.25GB file 22.84GB
Q4_K_S
20.25GB file 22.84GB
Q4_NL
20.25GB file 22.84GB
Q4_XS
20.25GB file 22.84GB
Q5_0
24.75GB file 27.34GB
Q5_K_M
24.75GB file 27.34GB
Q5_K_S
24.75GB file 27.34GB
Q6_K
29.25GB file 31.84GB
Q8_0
38.25GB file 40.84GB

SimpleChat-30BA3B-V2-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q3_K_L
13.13GB file 15.62GB
Q3_K_M
13.13GB file 15.62GB
Q3_K_S
13.13GB file 15.62GB
Q3_M
13.13GB file 15.62GB
Q3_S
13.13GB file 15.62GB
Q3_XS
13.13GB file 15.62GB
Q4_0
16.88GB file 19.37GB
Q4_K_M
16.88GB file 19.37GB
Q4_K_S
16.88GB file 19.37GB
Q4_NL
16.88GB file 19.37GB
Q4_XS
16.88GB file 19.37GB
Q5_0
20.63GB file 23.12GB
Q5_K_M
20.63GB file 23.12GB
Q5_K_S
20.63GB file 23.12GB
Q6_K
24.38GB file 26.87GB
Q8_0
31.88GB file 34.37GB

SimpleChat-4B-V1-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q2_K_S
1.25GB file 3.32GB
Q2_M
1.25GB file 3.32GB
Q2_S
1.25GB file 3.32GB
Q2_XS
1.25GB file 3.32GB
Q2_XXS
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q3_M
1.75GB file 3.82GB
Q3_S
1.75GB file 3.82GB
Q3_XS
1.75GB file 3.82GB
Q3_XXS
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_NL
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Skywork-SWE-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_K_S
10GB file 12.52GB
Q2_M
10GB file 12.52GB
Q2_S
10GB file 12.52GB
Q2_XS
10GB file 12.52GB
Q2_XXS
10GB file 12.52GB
Q3_K_L
14GB file 16.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_M
14GB file 16.52GB
Q3_S
14GB file 16.52GB
Q3_XS
14GB file 16.52GB
Q3_XXS
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q1_M
32GB file 34.52GB
Q1_S
32GB file 34.52GB
Q8_0
34GB file 36.52GB

SmallThinker-21BA3B-Instruct-GGUF

21B 8K ctx
Q2_K
6.56GB file 8.9GB
Q2_K_S
6.56GB file 8.9GB
Q3_K_L
9.19GB file 11.53GB
Q3_K_M
9.19GB file 11.53GB
Q3_K_S
9.19GB file 11.53GB
Q3_M
9.19GB file 11.53GB
Q3_S
9.19GB file 11.53GB
Q3_XS
9.19GB file 11.53GB
Q4_0
11.81GB file 14.15GB
Q4_K_M
11.81GB file 14.15GB
Q4_K_S
11.81GB file 14.15GB
Q4_XS
11.81GB file 14.15GB
Q5_0
14.44GB file 16.78GB
Q5_K_M
14.44GB file 16.78GB
Q5_K_S
14.44GB file 16.78GB
Q6_K
17.06GB file 19.4GB
Q8_0
22.31GB file 24.65GB

SmallThinker-4BA0.6B-Instruct-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q2_K_S
1.25GB file 3.32GB
Q2_M
1.25GB file 3.32GB
Q2_S
1.25GB file 3.32GB
Q2_XS
1.25GB file 3.32GB
Q2_XXS
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_XS
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

WEBGEN-4B-Preview-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q2_K_S
1.25GB file 3.32GB
Q2_M
1.25GB file 3.32GB
Q2_S
1.25GB file 3.32GB
Q2_XS
1.25GB file 3.32GB
Q2_XXS
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q3_M
1.75GB file 3.82GB
Q3_S
1.75GB file 3.82GB
Q3_XS
1.75GB file 3.82GB
Q3_XXS
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_NL
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
G

Gagagiga

1 models

Llama-3-Open-Ko-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB