All Supported Models

29681 AI models · 198875 quantization formats tracked

U

Uninformed

1 models

GLM-4.7-Architect-355B-A32B-GGUF

355B 8K ctx
Q2_K
110.94GB file 118.76GB
U

Universe T B D

1 models

astrollama.gguf

Unknown 8K ctx
FP16
0GB file 2GB
U

Unmodeled Tyler

1 models

atom-micro-1-lab

0.6B 8K ctx
BF16
1.2GB file 3.21GB
U

Unnicknameable

3 models

Llama-3.2-1B-Instruct-Q4_0-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB

Llama-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-3B-Q4_0-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
U

Unsloth

118 models

AceReason-Nemotron-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q2_K_L
4.38GB file 6.61GB
Q2_K_XL
4.38GB file 6.61GB
Q2_M
4.38GB file 6.61GB
Q2_XXS
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q3_K_XL
6.13GB file 8.36GB
Q3_XXS
6.13GB file 8.36GB
Q4_1
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q4_K_XL
7.88GB file 10.11GB
Q4_NL
7.88GB file 10.11GB
Q4_XS
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q5_K_XL
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q6_K_XL
11.38GB file 13.61GB
Q1_M
14GB file 16.23GB
Q1_S
14GB file 16.23GB
Q8_K_XL
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Apertus-70B-Instruct-2509-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q2_K_L
21.88GB file 25.03GB
Q2_K_XL
21.88GB file 25.03GB
Q2_M
21.88GB file 25.03GB
Q2_XXS
21.88GB file 25.03GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_K_XL
30.63GB file 33.78GB
Q3_XXS
30.63GB file 33.78GB
Q4_0
39.38GB file 42.53GB
Q4_1
39.38GB file 42.53GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q4_K_XL
39.38GB file 42.53GB
Q4_NL
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB
Q5_K_XL
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q6_K_XL
56.88GB file 60.03GB
Q1_M
70GB file 73.15GB
Q1_S
70GB file 73.15GB
Q8_0
74.38GB file 77.53GB
Q8_K_XL
74.38GB file 77.53GB
BF16
140GB file 143.15GB

Apertus-8B-Instruct-2509-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_L
2.5GB file 4.63GB
Q2_K_XL
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_XL
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_K_XL
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q5_K_XL
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q6_K_XL
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB
Q8_K_XL
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Apriel-1.5-15b-Thinker-GGUF

15B 8K ctx
Q2_K
4.69GB file 6.94GB
Q2_K_L
4.69GB file 6.94GB
Q2_K_XL
4.69GB file 6.94GB
Q2_M
4.69GB file 6.94GB
Q2_XXS
4.69GB file 6.94GB
Q3_K_M
6.56GB file 8.81GB
Q3_K_S
6.56GB file 8.81GB
Q3_K_XL
6.56GB file 8.81GB
Q3_XXS
6.56GB file 8.81GB
Q4_0
8.44GB file 10.69GB
Q4_1
8.44GB file 10.69GB
Q4_K_M
8.44GB file 10.69GB
Q4_K_S
8.44GB file 10.69GB
Q4_K_XL
8.44GB file 10.69GB
Q4_NL
8.44GB file 10.69GB
Q4_XS
8.44GB file 10.69GB
Q5_K_M
10.31GB file 12.56GB
Q5_K_S
10.31GB file 12.56GB
Q5_K_XL
10.31GB file 12.56GB
Q6_K
12.19GB file 14.44GB
Q6_K_XL
12.19GB file 14.44GB
Q1_M
15GB file 17.25GB
Q1_S
15GB file 17.25GB
Q8_0
15.94GB file 18.19GB
Q8_K_XL
15.94GB file 18.19GB
BF16
30GB file 32.25GB

c4ai-command-a-03-2025-GGUF

2025B 8K ctx
Q2_K
632.81GB file 667.99GB
Q2_K_L
632.81GB file 667.99GB
Q3_K_M
885.94GB file 921.12GB
Q4_K_M
1139.06GB file 1174.24GB
Q5_K_M
1392.19GB file 1427.37GB
Q6_K
1645.31GB file 1680.49GB
Q8_0
2151.56GB file 2186.74GB
BF16
4050GB file 4085.18GB

cogito-v2-preview-llama-405B-GGUF

405B 8K ctx
Q2_K
126.56GB file 135.2GB
Q2_K_L
126.56GB file 135.2GB
Q2_K_XL
126.56GB file 135.2GB
Q2_M
126.56GB file 135.2GB
Q2_XXS
126.56GB file 135.2GB
Q3_K_M
177.19GB file 185.83GB
Q3_K_S
177.19GB file 185.83GB
Q3_K_XL
177.19GB file 185.83GB
Q3_XXS
177.19GB file 185.83GB
Q4_0
227.81GB file 236.45GB
Q4_1
227.81GB file 236.45GB
Q4_K_M
227.81GB file 236.45GB
Q4_K_S
227.81GB file 236.45GB
Q4_K_XL
227.81GB file 236.45GB
Q4_NL
227.81GB file 236.45GB
Q4_XS
227.81GB file 236.45GB
Q5_K_M
278.44GB file 287.08GB
Q5_K_S
278.44GB file 287.08GB
Q5_K_XL
278.44GB file 287.08GB
Q6_K
329.06GB file 337.7GB
Q6_K_XL
329.06GB file 337.7GB
Q1_M
405GB file 413.64GB
Q1_S
405GB file 413.64GB
Q8_0
430.31GB file 438.95GB
Q8_K_XL
430.31GB file 438.95GB
BF16
810GB file 818.64GB

cogito-v2-preview-llama-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q2_K_L
21.88GB file 25.03GB
Q2_K_XL
21.88GB file 25.03GB
Q2_M
21.88GB file 25.03GB
Q2_XXS
21.88GB file 25.03GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_K_XL
30.63GB file 33.78GB
Q3_XXS
30.63GB file 33.78GB
Q4_0
39.38GB file 42.53GB
Q4_1
39.38GB file 42.53GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q4_K_XL
39.38GB file 42.53GB
Q4_NL
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB
Q5_K_XL
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q6_K_XL
56.88GB file 60.03GB
Q1_M
70GB file 73.15GB
Q1_S
70GB file 73.15GB
Q8_0
74.38GB file 77.53GB
Q8_K_XL
74.38GB file 77.53GB
BF16
140GB file 143.15GB

DeepSeek-Prover-V2-671B-GGUF

671B 8K ctx
Q2_K
209.69GB file 222.68GB
Q2_K_L
209.69GB file 222.68GB
Q2_K_XL
209.69GB file 222.68GB
Q2_M
209.69GB file 222.68GB
Q2_XXS
209.69GB file 222.68GB
Q3_K_M
293.56GB file 306.55GB
Q3_K_S
293.56GB file 306.55GB
Q3_K_XL
293.56GB file 306.55GB
Q3_XXS
293.56GB file 306.55GB
Q4_0
377.44GB file 390.43GB
Q4_1
377.44GB file 390.43GB
Q4_K_M
377.44GB file 390.43GB
Q4_K_S
377.44GB file 390.43GB
Q4_K_XL
377.44GB file 390.43GB
Q4_NL
377.44GB file 390.43GB
Q4_XS
377.44GB file 390.43GB
Q5_K_M
461.31GB file 474.3GB
Q5_K_S
461.31GB file 474.3GB
Q5_K_XL
461.31GB file 474.3GB
Q6_K
545.19GB file 558.18GB
Q6_K_XL
545.19GB file 558.18GB
Q1_M
671GB file 683.99GB
Q1_S
671GB file 683.99GB
Q8_0
712.94GB file 725.93GB
Q8_K_XL
712.94GB file 725.93GB
BF16
1342GB file 1354.99GB

DeepSeek-R1-0528-GGUF

0528B 8K ctx
Q2_K
165GB file 175.65GB
Q2_K_L
165GB file 175.65GB
Q2_K_XL
165GB file 175.65GB
Q2_M
165GB file 175.65GB
Q2_XXS
165GB file 175.65GB
Q3_K_M
231GB file 241.65GB
Q3_K_S
231GB file 241.65GB
Q3_K_XL
231GB file 241.65GB
Q3_XXS
231GB file 241.65GB
Q4_0
297GB file 307.65GB
Q4_1
297GB file 307.65GB
Q4_K_M
297GB file 307.65GB
Q4_K_S
297GB file 307.65GB
Q4_K_XL
297GB file 307.65GB
Q4_NL
297GB file 307.65GB
Q4_XS
297GB file 307.65GB
Q5_K_M
363GB file 373.65GB
Q5_K_S
363GB file 373.65GB
Q5_K_XL
363GB file 373.65GB
Q6_K
429GB file 439.65GB
Q6_K_XL
429GB file 439.65GB
Q1_0
528GB file 538.65GB
Q1_M
528GB file 538.65GB
Q1_S
528GB file 538.65GB
Q8_0
561GB file 571.65GB
Q8_K_XL
561GB file 571.65GB
BF16
1056GB file 1066.65GB

DeepSeek-R1-0528-Qwen3-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_L
2.5GB file 4.63GB
Q2_K_XL
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_XL
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_K_XL
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q5_K_XL
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q6_K_XL
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB
Q8_K_XL
8.5GB file 10.63GB
BF16
16GB file 18.13GB

DeepSeek-R1-Distill-Llama-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q2_K_L
21.88GB file 25.03GB
Q2_K_XL
21.88GB file 25.03GB
Q2_M
21.88GB file 25.03GB
Q2_XXS
21.88GB file 25.03GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_S
30.63GB file 33.78GB
Q3_K_XL
30.63GB file 33.78GB
Q3_XXS
30.63GB file 33.78GB
Q4_0
39.38GB file 42.53GB
Q4_1
39.38GB file 42.53GB
Q4_K_M
39.38GB file 42.53GB
Q4_K_S
39.38GB file 42.53GB
Q4_K_XL
39.38GB file 42.53GB
Q4_NL
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q5_K_S
48.13GB file 51.28GB
Q5_K_XL
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q6_K_XL
56.88GB file 60.03GB
Q1_M
70GB file 73.15GB
Q1_S
70GB file 73.15GB
Q8_0
74.38GB file 77.53GB
Q8_K_XL
74.38GB file 77.53GB
BF16
140GB file 143.15GB

DeepSeek-R1-Distill-Llama-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_L
2.5GB file 4.63GB
Q2_K_XL
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_XL
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_K_XL
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q5_K_XL
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q6_K_XL
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB
Q8_K_XL
8.5GB file 10.63GB
BF16
16GB file 18.13GB

DeepSeek-R1-Distill-Qwen-1.5B-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q2_K_L
0.47GB file 2.49GB
Q2_K_XL
0.47GB file 2.49GB
Q2_M
0.47GB file 2.49GB
Q2_XXS
0.47GB file 2.49GB
Q3_K_M
0.66GB file 2.68GB
Q3_K_XL
0.66GB file 2.68GB
Q3_XXS
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q4_K_XL
0.84GB file 2.86GB
Q4_XS
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q6_K
1.22GB file 3.24GB
Q1_M
1.5GB file 3.52GB
Q1_S
1.5GB file 3.52GB
Q8_0
1.59GB file 3.61GB
BF16
3GB file 5.02GB

DeepSeek-R1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q2_K_L
0.31GB file 2.33GB
Q2_K_XL
0.31GB file 2.33GB
Q2_K_XS
0.31GB file 2.33GB
Q2_XXS
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB
Q4_K_M
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q1_M
1GB file 3.02GB
Q1_S
1GB file 3.02GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

DeepSeek-R1-GGUF-UD

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q2_K_L
0.31GB file 2.33GB
Q2_K_XL
0.31GB file 2.33GB
Q2_M
0.31GB file 2.33GB
Q2_XXS
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_S
0.44GB file 2.46GB
Q3_K_XL
0.44GB file 2.46GB
Q3_XXS
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_XL
0.56GB file 2.58GB
Q4_NL
0.56GB file 2.58GB
Q4_XS
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q1_M
1GB file 3.02GB
Q1_S
1GB file 3.02GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

DeepSeek-TNG-R1T2-Chimera-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q1_0
0GB file 2GB
Q1_M
0GB file 2GB
Q1_S
0GB file 2GB
Q2_K
0GB file 2GB
Q2_K_L
0GB file 2GB
Q2_K_XL
0GB file 2GB
Q2_M
0GB file 2GB
Q2_XXS
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_K_XL
0GB file 2GB
Q3_XXS
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_K_XL
0GB file 2GB
Q4_NL
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q5_K_XL
0GB file 2GB
Q6_K
0GB file 2GB
Q6_K_XL
0GB file 2GB
Q8_0
0GB file 2GB
Q8_K_XL
0GB file 2GB

DeepSeek-V3-0324-GGUF

0324B 8K ctx
Q2_K
101.25GB file 108.56GB
Q2_K_XL
101.25GB file 108.56GB
Q2_XXS
101.25GB file 108.56GB
Q3_K_M
141.75GB file 149.06GB
Q3_K_XL
141.75GB file 149.06GB
Q4_K_M
182.25GB file 189.56GB
Q4_K_XL
182.25GB file 189.56GB
Q5_K_M
222.75GB file 230.06GB
Q6_K
263.25GB file 270.56GB
Q1_M
324GB file 331.31GB
Q1_S
324GB file 331.31GB
Q8_0
344.25GB file 351.56GB
BF16
648GB file 655.31GB

DeepSeek-V3-0324-GGUF-UD

0324B 8K ctx
Q2_K
101.25GB file 108.56GB
Q2_K_L
101.25GB file 108.56GB
Q2_K_XL
101.25GB file 108.56GB
Q2_M
101.25GB file 108.56GB
Q2_XXS
101.25GB file 108.56GB
Q3_K_M
141.75GB file 149.06GB
Q3_K_XL
141.75GB file 149.06GB
Q3_XXS
141.75GB file 149.06GB
Q4_K_M
182.25GB file 189.56GB
Q4_K_XL
182.25GB file 189.56GB
Q4_NL
182.25GB file 189.56GB
Q4_XS
182.25GB file 189.56GB
Q5_K_M
222.75GB file 230.06GB
Q6_K
263.25GB file 270.56GB
Q1_M
324GB file 331.31GB
Q1_S
324GB file 331.31GB
Q8_0
344.25GB file 351.56GB
BF16
648GB file 655.31GB

DictaLM-3.0-24B-Thinking-GGUF

24B 8K ctx
Q2_K
7.5GB file 9.89GB
Q2_K_L
7.5GB file 9.89GB
Q2_K_XL
7.5GB file 9.89GB
Q2_M
7.5GB file 9.89GB
Q2_XXS
7.5GB file 9.89GB
Q3_K_M
10.5GB file 12.89GB
Q3_K_S
10.5GB file 12.89GB
Q3_K_XL
10.5GB file 12.89GB
Q3_XXS
10.5GB file 12.89GB
Q4_0
13.5GB file 15.89GB
Q4_1
13.5GB file 15.89GB
Q4_K_M
13.5GB file 15.89GB
Q4_K_S
13.5GB file 15.89GB
Q4_K_XL
13.5GB file 15.89GB
Q4_NL
13.5GB file 15.89GB
Q4_XS
13.5GB file 15.89GB
Q5_K_M
16.5GB file 18.89GB
Q5_K_S
16.5GB file 18.89GB
Q5_K_XL
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB
Q6_K_XL
19.5GB file 21.89GB
Q1_M
24GB file 26.39GB
Q1_S
24GB file 26.39GB
Q8_0
25.5GB file 27.89GB
Q8_K_XL
25.5GB file 27.89GB
BF16
48GB file 50.39GB

dots.llm1.inst-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q1_0
0GB file 2GB
Q1_M
0GB file 2GB
Q1_S
0GB file 2GB
Q2_K
0GB file 2GB
Q2_K_L
0GB file 2GB
Q2_K_XL
0GB file 2GB
Q2_M
0GB file 2GB
Q2_XXS
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_K_XL
0GB file 2GB
Q3_XXS
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_K_XL
0GB file 2GB
Q4_NL
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q5_K_XL
0GB file 2GB
Q6_K
0GB file 2GB
Q6_K_XL
0GB file 2GB
Q8_0
0GB file 2GB
Q8_K_XL
0GB file 2GB

ERNIE-4.5-0.3B-PT-GGUF

0.3B 8K ctx
Q2_K
0.09GB file 2.09GB
Q2_K_L
0.09GB file 2.09GB
Q2_K_XL
0.09GB file 2.09GB
Q3_K_M
0.13GB file 2.13GB
Q3_K_S
0.13GB file 2.13GB
Q3_K_XL
0.13GB file 2.13GB
Q4_0
0.17GB file 2.17GB
Q4_1
0.17GB file 2.17GB
Q4_K_M
0.17GB file 2.17GB
Q4_K_S
0.17GB file 2.17GB
Q4_K_XL
0.17GB file 2.17GB
Q5_K_M
0.21GB file 2.21GB
Q5_K_S
0.21GB file 2.21GB
Q5_K_XL
0.21GB file 2.21GB
Q6_K
0.24GB file 2.24GB
Q6_K_XL
0.24GB file 2.24GB
Q8_0
0.32GB file 2.32GB
Q8_K_XL
0.32GB file 2.32GB

ERNIE-4.5-21B-A3B-PT-GGUF

21B 8K ctx
Q2_K
6.56GB file 8.9GB
Q2_K_L
6.56GB file 8.9GB
Q2_K_XL
6.56GB file 8.9GB
Q2_M
6.56GB file 8.9GB
Q2_XXS
6.56GB file 8.9GB
Q3_K_M
9.19GB file 11.53GB
Q3_K_S
9.19GB file 11.53GB
Q3_K_XL
9.19GB file 11.53GB
Q3_XXS
9.19GB file 11.53GB
Q4_0
11.81GB file 14.15GB
Q4_1
11.81GB file 14.15GB
Q4_K_M
11.81GB file 14.15GB
Q4_K_S
11.81GB file 14.15GB
Q4_K_XL
11.81GB file 14.15GB
Q4_NL
11.81GB file 14.15GB
Q4_XS
11.81GB file 14.15GB
Q5_K_M
14.44GB file 16.78GB
Q5_K_S
14.44GB file 16.78GB
Q5_K_XL
14.44GB file 16.78GB
Q6_K
17.06GB file 19.4GB
Q6_K_XL
17.06GB file 19.4GB
Q1_0
21GB file 23.34GB
Q1_M
21GB file 23.34GB
Q1_S
21GB file 23.34GB
Q8_0
22.31GB file 24.65GB
Q8_K_XL
22.31GB file 24.65GB
BF16
42GB file 44.34GB

ERNIE-4.5-21B-A3B-Thinking-GGUF

21B 8K ctx
Q2_K
6.56GB file 8.9GB
Q2_K_L
6.56GB file 8.9GB
Q2_K_XL
6.56GB file 8.9GB
Q2_M
6.56GB file 8.9GB
Q2_XXS
6.56GB file 8.9GB
Q3_K_M
9.19GB file 11.53GB
Q3_K_S
9.19GB file 11.53GB
Q3_K_XL
9.19GB file 11.53GB
Q3_XXS
9.19GB file 11.53GB
Q4_0
11.81GB file 14.15GB
Q4_1
11.81GB file 14.15GB
Q4_K_M
11.81GB file 14.15GB
Q4_K_S
11.81GB file 14.15GB
Q4_K_XL
11.81GB file 14.15GB
Q4_NL
11.81GB file 14.15GB
Q4_XS
11.81GB file 14.15GB
Q5_K_M
14.44GB file 16.78GB
Q5_K_S
14.44GB file 16.78GB
Q5_K_XL
14.44GB file 16.78GB
Q6_K
17.06GB file 19.4GB
Q6_K_XL
17.06GB file 19.4GB
Q1_0
21GB file 23.34GB
Q1_M
21GB file 23.34GB
Q1_S
21GB file 23.34GB
Q8_0
22.31GB file 24.65GB
Q8_K_XL
22.31GB file 24.65GB
BF16
42GB file 44.34GB

ERNIE-4.5-300B-A47B-PT-GGUF

300B 8K ctx
Q2_K
93.75GB file 100.67GB
Q2_K_L
93.75GB file 100.67GB
Q2_K_XL
93.75GB file 100.67GB
Q2_M
93.75GB file 100.67GB
Q2_XXS
93.75GB file 100.67GB
Q3_K_M
131.25GB file 138.17GB
Q3_K_S
131.25GB file 138.17GB
Q3_K_XL
131.25GB file 138.17GB
Q3_XXS
131.25GB file 138.17GB
Q4_0
168.75GB file 175.67GB
Q4_1
168.75GB file 175.67GB
Q4_K_M
168.75GB file 175.67GB
Q4_K_S
168.75GB file 175.67GB
Q4_K_XL
168.75GB file 175.67GB
Q4_NL
168.75GB file 175.67GB
Q4_XS
168.75GB file 175.67GB
Q5_K_M
206.25GB file 213.17GB
Q5_K_S
206.25GB file 213.17GB
Q5_K_XL
206.25GB file 213.17GB
Q6_K
243.75GB file 250.67GB
Q6_K_XL
243.75GB file 250.67GB
Q1_0
300GB file 306.92GB
Q1_M
300GB file 306.92GB
Q1_S
300GB file 306.92GB
Q8_0
318.75GB file 325.67GB
Q8_K_XL
318.75GB file 325.67GB
BF16
600GB file 606.92GB

functiongemma-270m-it-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q2_K_L
2.81GB file 4.96GB
Q2_K_XL
2.81GB file 4.96GB
Q2_M
2.81GB file 4.96GB
Q2_XXS
2.81GB file 4.96GB
Q3_K_M
3.94GB file 6.09GB
Q3_K_S
3.94GB file 6.09GB
Q3_K_XL
3.94GB file 6.09GB
Q3_XXS
3.94GB file 6.09GB
Q4_0
5.06GB file 7.21GB
Q4_1
5.06GB file 7.21GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q4_K_XL
5.06GB file 7.21GB
Q4_NL
5.06GB file 7.21GB
Q4_XS
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q5_K_XL
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q6_K_XL
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
Q8_K_XL
9.56GB file 11.71GB
BF16
18GB file 20.15GB

gemma-2-it-GGUF

2B 8K ctx
Q2_0
0.63GB file 2.66GB
Q3_0
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

gemma-3-1b-it-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q2_K_L
0.31GB file 2.33GB
Q2_K_XL
0.31GB file 2.33GB
Q2_M
0.31GB file 2.33GB
Q2_XXS
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_S
0.44GB file 2.46GB
Q3_K_XL
0.44GB file 2.46GB
Q3_XXS
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q4_K_XL
0.56GB file 2.58GB
Q4_NL
0.56GB file 2.58GB
Q4_XS
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q5_K_XL
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q6_K_XL
0.81GB file 2.83GB
Q1_M
1GB file 3.02GB
Q1_S
1GB file 3.02GB
Q8_0
1.06GB file 3.08GB
Q8_K_XL
1.06GB file 3.08GB
BF16
2GB file 4.02GB

gemma-3-270m-it-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q2_K_L
0.31GB file 2.33GB
Q2_K_XL
0.31GB file 2.33GB
Q2_M
0.31GB file 2.33GB
Q2_XXS
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_S
0.44GB file 2.46GB
Q3_K_XL
0.44GB file 2.46GB
Q3_XXS
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q4_K_XL
0.56GB file 2.58GB
Q4_NL
0.56GB file 2.58GB
Q4_XS
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q5_K_XL
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q6_K_XL
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
Q8_K_XL
1.06GB file 3.08GB

gemma-3-270m-it-qat-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q2_K_L
0.31GB file 2.33GB
Q2_K_XL
0.31GB file 2.33GB
Q2_M
0.31GB file 2.33GB
Q2_XXS
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_S
0.44GB file 2.46GB
Q3_K_XL
0.44GB file 2.46GB
Q3_XXS
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q4_K_XL
0.56GB file 2.58GB
Q4_NL
0.56GB file 2.58GB
Q4_XS
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q5_K_XL
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q6_K_XL
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
Q8_K_XL
1.06GB file 3.08GB

GLM-4-32B-0414-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_K_L
10GB file 12.52GB
Q2_K_XL
10GB file 12.52GB
Q2_M
10GB file 12.52GB
Q2_XXS
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_K_XL
14GB file 16.52GB
Q3_XXS
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_K_XL
18GB file 20.52GB
Q4_NL
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q5_K_XL
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q6_K_XL
26GB file 28.52GB
Q1_M
32GB file 34.52GB
Q1_S
32GB file 34.52GB
Q8_0
34GB file 36.52GB
Q8_K_XL
34GB file 36.52GB
BF16
64GB file 66.52GB

GLM-4-9B-0414-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q2_K_L
2.81GB file 4.96GB
Q2_K_XL
2.81GB file 4.96GB
Q2_M
2.81GB file 4.96GB
Q2_XXS
2.81GB file 4.96GB
Q3_K_M
3.94GB file 6.09GB
Q3_K_S
3.94GB file 6.09GB
Q3_K_XL
3.94GB file 6.09GB
Q3_XXS
3.94GB file 6.09GB
Q4_0
5.06GB file 7.21GB
Q4_1
5.06GB file 7.21GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q4_K_XL
5.06GB file 7.21GB
Q4_NL
5.06GB file 7.21GB
Q4_XS
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q5_K_XL
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q6_K_XL
7.31GB file 9.46GB
Q1_M
9GB file 11.15GB
Q1_S
9GB file 11.15GB
Q8_0
9.56GB file 11.71GB
Q8_K_XL
9.56GB file 11.71GB
BF16
18GB file 20.15GB

GLM-4.5-Air-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q1_0
0GB file 2GB
Q1_M
0GB file 2GB
Q1_S
0GB file 2GB
Q2_K
0GB file 2GB
Q2_K_L
0GB file 2GB
Q2_K_XL
0GB file 2GB
Q2_M
0GB file 2GB
Q2_XXS
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_K_XL
0GB file 2GB
Q3_XXS
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_K_XL
0GB file 2GB
Q4_NL
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q5_K_XL
0GB file 2GB
Q6_K
0GB file 2GB
Q6_K_XL
0GB file 2GB
Q8_0
0GB file 2GB
Q8_K_XL
0GB file 2GB

GLM-4.5-GGUF

4.5B 8K ctx
Q2_K
1.41GB file 3.48GB
Q2_K_L
1.41GB file 3.48GB
Q2_K_XL
1.41GB file 3.48GB
Q2_M
1.41GB file 3.48GB
Q2_XXS
1.41GB file 3.48GB
Q3_K_M
1.97GB file 4.04GB
Q3_K_S
1.97GB file 4.04GB
Q3_K_XL
1.97GB file 4.04GB
Q3_XXS
1.97GB file 4.04GB
Q4_0
2.53GB file 4.6GB
Q4_1
2.53GB file 4.6GB
Q4_K_M
2.53GB file 4.6GB
Q4_K_S
2.53GB file 4.6GB
Q4_K_XL
2.53GB file 4.6GB
Q4_NL
2.53GB file 4.6GB
Q4_XS
2.53GB file 4.6GB
Q5_K_M
3.09GB file 5.16GB
Q5_K_S
3.09GB file 5.16GB
Q5_K_XL
3.09GB file 5.16GB
Q6_K
3.66GB file 5.73GB
Q6_K_XL
3.66GB file 5.73GB
Q1_0
4.5GB file 6.57GB
Q1_M
4.5GB file 6.57GB
Q1_S
4.5GB file 6.57GB
Q8_0
4.78GB file 6.85GB
Q8_K_XL
4.78GB file 6.85GB
BF16
9GB file 11.07GB

GLM-4.6-GGUF

4.6B 8K ctx
Q2_K
1.44GB file 3.52GB
Q2_K_L
1.44GB file 3.52GB
Q2_K_XL
1.44GB file 3.52GB
Q2_M
1.44GB file 3.52GB
Q2_XXS
1.44GB file 3.52GB
Q3_K_M
2.01GB file 4.09GB
Q3_K_S
2.01GB file 4.09GB
Q3_K_XL
2.01GB file 4.09GB
Q3_XXS
2.01GB file 4.09GB
Q4_0
2.59GB file 4.67GB
Q4_1
2.59GB file 4.67GB
Q4_K_M
2.59GB file 4.67GB
Q4_K_S
2.59GB file 4.67GB
Q4_K_XL
2.59GB file 4.67GB
Q4_NL
2.59GB file 4.67GB
Q4_XS
2.59GB file 4.67GB
Q5_K_M
3.16GB file 5.24GB
Q5_K_S
3.16GB file 5.24GB
Q5_K_XL
3.16GB file 5.24GB
Q6_K
3.74GB file 5.82GB
Q6_K_XL
3.74GB file 5.82GB
Q1_0
4.6GB file 6.68GB
Q1_M
4.6GB file 6.68GB
Q1_S
4.6GB file 6.68GB
Q8_0
4.89GB file 6.97GB
Q8_K_XL
4.89GB file 6.97GB
BF16
9.2GB file 11.28GB

GLM-4.6-REAP-268B-A32B-GGUF

268B 8K ctx
Q2_K
83.75GB file 90.14GB
Q2_K_L
83.75GB file 90.14GB
Q2_K_XL
83.75GB file 90.14GB
Q2_M
83.75GB file 90.14GB
Q2_XXS
83.75GB file 90.14GB
Q3_K_M
117.25GB file 123.64GB
Q3_K_S
117.25GB file 123.64GB
Q3_K_XL
117.25GB file 123.64GB
Q3_XXS
117.25GB file 123.64GB
Q4_0
150.75GB file 157.14GB
Q4_1
150.75GB file 157.14GB
Q4_K_M
150.75GB file 157.14GB
Q4_K_S
150.75GB file 157.14GB
Q4_K_XL
150.75GB file 157.14GB
Q4_NL
150.75GB file 157.14GB
Q4_XS
150.75GB file 157.14GB
Q5_K_M
184.25GB file 190.64GB
Q5_K_S
184.25GB file 190.64GB
Q5_K_XL
184.25GB file 190.64GB
Q6_K
217.75GB file 224.14GB
Q6_K_XL
217.75GB file 224.14GB
Q1_0
268GB file 274.39GB
Q1_M
268GB file 274.39GB
Q1_S
268GB file 274.39GB
Q8_0
284.75GB file 291.14GB
Q8_K_XL
284.75GB file 291.14GB
BF16
536GB file 542.39GB

GLM-4.7-Flash-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
FP4
0GB file 2GB
Q1_0
0GB file 2GB
Q1_M
0GB file 2GB
Q1_S
0GB file 2GB
Q2_K
0GB file 2GB
Q2_K_L
0GB file 2GB
Q2_K_XL
0GB file 2GB
Q2_M
0GB file 2GB
Q2_XXS
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_K_XL
0GB file 2GB
Q3_XXS
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_K_XL
0GB file 2GB
Q4_NL
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q5_K_XL
0GB file 2GB
Q6_K
0GB file 2GB
Q6_K_XL
0GB file 2GB
Q8_0
0GB file 2GB
Q8_K_XL
0GB file 2GB

GLM-4.7-Flash-REAP-23B-A3B-GGUF

23B 8K ctx
Q2_K
7.19GB file 9.57GB
Q2_K_L
7.19GB file 9.57GB
Q2_K_XL
7.19GB file 9.57GB
Q2_M
7.19GB file 9.57GB
Q2_XXS
7.19GB file 9.57GB
Q3_K_M
10.06GB file 12.44GB
Q3_K_S
10.06GB file 12.44GB
Q3_K_XL
10.06GB file 12.44GB
Q3_XXS
10.06GB file 12.44GB
Q4_0
12.94GB file 15.32GB
Q4_1
12.94GB file 15.32GB
Q4_K_M
12.94GB file 15.32GB
Q4_K_S
12.94GB file 15.32GB
Q4_K_XL
12.94GB file 15.32GB
Q4_NL
12.94GB file 15.32GB
Q4_XS
12.94GB file 15.32GB
Q5_K_M
15.81GB file 18.19GB
Q5_K_S
15.81GB file 18.19GB
Q5_K_XL
15.81GB file 18.19GB
Q6_K
18.69GB file 21.07GB
Q6_K_XL
18.69GB file 21.07GB
Q1_0
23GB file 25.38GB
Q1_M
23GB file 25.38GB
Q1_S
23GB file 25.38GB
Q8_0
24.44GB file 26.82GB
Q8_K_XL
24.44GB file 26.82GB
BF16
46GB file 48.38GB

GLM-4.7-GGUF

4.7B 8K ctx
Q2_K
1.47GB file 3.55GB
Q2_K_L
1.47GB file 3.55GB
Q2_K_XL
1.47GB file 3.55GB
Q2_M
1.47GB file 3.55GB
Q2_XXS
1.47GB file 3.55GB
Q3_K_M
2.06GB file 4.14GB
Q3_K_S
2.06GB file 4.14GB
Q3_K_XL
2.06GB file 4.14GB
Q3_XXS
2.06GB file 4.14GB
Q4_0
2.64GB file 4.72GB
Q4_1
2.64GB file 4.72GB
Q4_K_M
2.64GB file 4.72GB
Q4_K_S
2.64GB file 4.72GB
Q4_K_XL
2.64GB file 4.72GB
Q4_NL
2.64GB file 4.72GB
Q4_XS
2.64GB file 4.72GB
Q5_K_M
3.23GB file 5.31GB
Q5_K_S
3.23GB file 5.31GB
Q5_K_XL
3.23GB file 5.31GB
Q6_K
3.82GB file 5.9GB
Q6_K_XL
3.82GB file 5.9GB
Q1_0
4.7GB file 6.78GB
Q1_M
4.7GB file 6.78GB
Q1_S
4.7GB file 6.78GB
Q8_0
4.99GB file 7.07GB
Q8_K_XL
4.99GB file 7.07GB
BF16
9.4GB file 11.48GB

GLM-4.7-REAP-218B-A32B-GGUF

218B 8K ctx
Q2_K
68.13GB file 73.7GB
Q2_K_L
68.13GB file 73.7GB
Q2_K_XL
68.13GB file 73.7GB
Q2_M
68.13GB file 73.7GB
Q2_XXS
68.13GB file 73.7GB
Q3_K_M
95.38GB file 100.95GB
Q3_K_S
95.38GB file 100.95GB
Q3_K_XL
95.38GB file 100.95GB
Q3_XXS
95.38GB file 100.95GB
Q4_0
122.63GB file 128.2GB
Q4_1
122.63GB file 128.2GB
Q4_K_M
122.63GB file 128.2GB
Q4_K_S
122.63GB file 128.2GB
Q4_K_XL
122.63GB file 128.2GB
Q4_NL
122.63GB file 128.2GB
Q4_XS
122.63GB file 128.2GB
Q5_K_M
149.88GB file 155.45GB
Q5_K_S
149.88GB file 155.45GB
Q5_K_XL
149.88GB file 155.45GB
Q6_K
177.13GB file 182.7GB
Q6_K_XL
177.13GB file 182.7GB
Q1_0
218GB file 223.57GB
Q1_M
218GB file 223.57GB
Q1_S
218GB file 223.57GB
Q8_0
231.63GB file 237.2GB
Q8_K_XL
231.63GB file 237.2GB
BF16
436GB file 441.57GB

GLM-5-GGUF

5B 8K ctx
Q2_K
1.56GB file 3.64GB
Q2_K_L
1.56GB file 3.64GB
Q2_K_XL
1.56GB file 3.64GB
Q2_M
1.56GB file 3.64GB
Q2_XXS
1.56GB file 3.64GB
Q3_K_M
2.19GB file 4.27GB
Q3_K_S
2.19GB file 4.27GB
Q3_K_XL
2.19GB file 4.27GB
Q3_XXS
2.19GB file 4.27GB
Q4_0
2.81GB file 4.89GB
Q4_1
2.81GB file 4.89GB
Q4_K_M
2.81GB file 4.89GB
Q4_K_S
2.81GB file 4.89GB
Q4_K_XL
2.81GB file 4.89GB
Q4_NL
2.81GB file 4.89GB
Q4_XS
2.81GB file 4.89GB
Q5_K_M
3.44GB file 5.52GB
Q5_K_S
3.44GB file 5.52GB
Q5_K_XL
3.44GB file 5.52GB
Q6_K
4.06GB file 6.14GB
Q6_K_XL
4.06GB file 6.14GB
FP4
5GB file 7.08GB
Q1_0
5GB file 7.08GB
Q1_M
5GB file 7.08GB
Q1_S
5GB file 7.08GB
Q8_0
5.31GB file 7.39GB
Q8_K_XL
5.31GB file 7.39GB
BF16
10GB file 12.08GB

GLM-5.1-GGUF

5.1B 8K ctx
Q2_K_XL
1.59GB file 3.67GB
Q2_M
1.59GB file 3.67GB
Q2_XXS
1.59GB file 3.67GB
Q3_K_M
2.23GB file 4.31GB
Q3_K_S
2.23GB file 4.31GB
Q3_K_XL
2.23GB file 4.31GB
Q3_S
2.23GB file 4.31GB
Q3_XXS
2.23GB file 4.31GB
Q4_K_M
2.87GB file 4.95GB
Q4_K_S
2.87GB file 4.95GB
Q4_K_XL
2.87GB file 4.95GB
Q4_NL
2.87GB file 4.95GB
Q4_XS
2.87GB file 4.95GB
Q5_K_M
3.51GB file 5.59GB
Q5_K_S
3.51GB file 5.59GB
Q5_K_XL
3.51GB file 5.59GB
Q6_K
4.14GB file 6.22GB
Q6_K_XL
4.14GB file 6.22GB
FP4
5.1GB file 7.18GB
Q1_M
5.1GB file 7.18GB
Q8_0
5.42GB file 7.5GB
Q8_K_XL
5.42GB file 7.5GB
BF16
10.2GB file 12.28GB

GLM-Z1-32B-0414-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_K_L
10GB file 12.52GB
Q2_K_XL
10GB file 12.52GB
Q2_M
10GB file 12.52GB
Q2_XXS
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_K_XL
14GB file 16.52GB
Q3_XXS
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_K_XL
18GB file 20.52GB
Q4_NL
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q5_K_XL
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q6_K_XL
26GB file 28.52GB
Q1_M
32GB file 34.52GB
Q1_S
32GB file 34.52GB
Q8_0
34GB file 36.52GB
Q8_K_XL
34GB file 36.52GB
BF16
64GB file 66.52GB

GLM-Z1-9B-0414-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q2_K_L
2.81GB file 4.96GB
Q2_K_XL
2.81GB file 4.96GB
Q2_M
2.81GB file 4.96GB
Q2_XXS
2.81GB file 4.96GB
Q3_K_M
3.94GB file 6.09GB
Q3_K_S
3.94GB file 6.09GB
Q3_K_XL
3.94GB file 6.09GB
Q3_XXS
3.94GB file 6.09GB
Q4_0
5.06GB file 7.21GB
Q4_1
5.06GB file 7.21GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q4_K_XL
5.06GB file 7.21GB
Q4_NL
5.06GB file 7.21GB
Q4_XS
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q5_K_XL
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q6_K_XL
7.31GB file 9.46GB
Q1_M
9GB file 11.15GB
Q1_S
9GB file 11.15GB
Q8_0
9.56GB file 11.71GB
Q8_K_XL
9.56GB file 11.71GB
BF16
18GB file 20.15GB

gpt-oss-120b-GGUF

120B 8K ctx
Q2_K
37.5GB file 41.47GB
Q2_K_L
37.5GB file 41.47GB
Q3_K_M
52.5GB file 56.47GB
Q3_K_S
52.5GB file 56.47GB
Q4_0
67.5GB file 71.47GB
Q4_1
67.5GB file 71.47GB
Q4_K_M
67.5GB file 71.47GB
Q4_K_S
67.5GB file 71.47GB
Q4_K_XL
67.5GB file 71.47GB
Q5_K_M
82.5GB file 86.47GB
Q5_K_S
82.5GB file 86.47GB
Q6_K
97.5GB file 101.47GB
Q6_K_XL
97.5GB file 101.47GB
Q8_0
127.5GB file 131.47GB
Q8_K_XL
127.5GB file 131.47GB

gpt-oss-20b-GGUF

20B 8K ctx
Q2_K
6.25GB file 8.58GB
Q2_K_L
6.25GB file 8.58GB
Q3_K_M
8.75GB file 11.08GB
Q3_K_S
8.75GB file 11.08GB
Q4_0
11.25GB file 13.58GB
Q4_1
11.25GB file 13.58GB
Q4_K_M
11.25GB file 13.58GB
Q4_K_S
11.25GB file 13.58GB
Q4_K_XL
11.25GB file 13.58GB
Q5_K_M
13.75GB file 16.08GB
Q5_K_S
13.75GB file 16.08GB
Q6_K
16.25GB file 18.58GB
Q6_K_XL
16.25GB file 18.58GB
Q8_0
21.25GB file 23.58GB
Q8_K_XL
21.25GB file 23.58GB

gpt-oss-safeguard-120b-GGUF

120B 8K ctx
Q2_K
37.5GB file 41.47GB
Q2_K_L
37.5GB file 41.47GB
Q3_K_M
52.5GB file 56.47GB
Q3_K_S
52.5GB file 56.47GB
Q4_0
67.5GB file 71.47GB
Q4_1
67.5GB file 71.47GB
Q4_K_M
67.5GB file 71.47GB
Q4_K_S
67.5GB file 71.47GB
Q4_K_XL
67.5GB file 71.47GB
Q5_K_M
82.5GB file 86.47GB
Q5_K_S
82.5GB file 86.47GB
Q6_K
97.5GB file 101.47GB
Q6_K_XL
97.5GB file 101.47GB
Q8_0
127.5GB file 131.47GB
Q8_K_XL
127.5GB file 131.47GB

gpt-oss-safeguard-20b-GGUF

20B 8K ctx
Q2_K
6.25GB file 8.58GB
Q2_K_L
6.25GB file 8.58GB
Q3_K_M
8.75GB file 11.08GB
Q3_K_S
8.75GB file 11.08GB
Q4_0
11.25GB file 13.58GB
Q4_1
11.25GB file 13.58GB
Q4_K_M
11.25GB file 13.58GB
Q4_K_S
11.25GB file 13.58GB
Q4_K_XL
11.25GB file 13.58GB
Q5_K_M
13.75GB file 16.08GB
Q5_K_S
13.75GB file 16.08GB
Q6_K
16.25GB file 18.58GB
Q6_K_XL
16.25GB file 18.58GB
Q8_0
21.25GB file 23.58GB
Q8_K_XL
21.25GB file 23.58GB

granite-3.3-8b-instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_L
2.5GB file 4.63GB
Q2_K_XL
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_XL
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_K_XL
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q5_K_XL
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q6_K_XL
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_K_XL
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Hermes-4-405B-GGUF

405B 8K ctx
Q2_K_XL
126.56GB file 135.2GB
Q3_K_XL
177.19GB file 185.83GB
Q4_K_M
227.81GB file 236.45GB
Q4_K_XL
227.81GB file 236.45GB
Q5_K_XL
278.44GB file 287.08GB
Q1_M
405GB file 413.64GB
Q1_S
405GB file 413.64GB
Q8_0
430.31GB file 438.95GB
BF16
810GB file 818.64GB

Jan-nano-128k-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q1_M
0GB file 2GB
Q1_S
0GB file 2GB
Q2_K
0GB file 2GB
Q2_K_L
0GB file 2GB
Q2_K_XL
0GB file 2GB
Q2_M
0GB file 2GB
Q2_XXS
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_K_XL
0GB file 2GB
Q3_XXS
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_K_XL
0GB file 2GB
Q4_NL
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q5_K_XL
0GB file 2GB
Q6_K
0GB file 2GB
Q6_K_XL
0GB file 2GB
Q8_0
0GB file 2GB
Q8_K_XL
0GB file 2GB

Jan-nano-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q1_M
0GB file 2GB
Q1_S
0GB file 2GB
Q2_K
0GB file 2GB
Q2_K_L
0GB file 2GB
Q2_K_XL
0GB file 2GB
Q2_M
0GB file 2GB
Q2_XXS
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_K_XL
0GB file 2GB
Q3_XXS
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_K_XL
0GB file 2GB
Q4_NL
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q5_K_XL
0GB file 2GB
Q6_K
0GB file 2GB
Q6_K_XL
0GB file 2GB
Q8_0
0GB file 2GB
Q8_K_XL
0GB file 2GB

KernelLLM-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q1_M
0GB file 2GB
Q1_S
0GB file 2GB
Q2_K
0GB file 2GB
Q2_K_L
0GB file 2GB
Q2_K_XL
0GB file 2GB
Q2_M
0GB file 2GB
Q2_XXS
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_K_XL
0GB file 2GB
Q3_XXS
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_K_XL
0GB file 2GB
Q4_NL
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q5_K_XL
0GB file 2GB
Q6_K
0GB file 2GB
Q6_K_XL
0GB file 2GB
Q8_0
0GB file 2GB
Q8_K_XL
0GB file 2GB

LFM2-1.2B-GGUF

1.2B 8K ctx
Q2_K
0.38GB file 2.4GB
Q2_K_L
0.38GB file 2.4GB
Q2_K_XL
0.38GB file 2.4GB
Q3_K_M
0.53GB file 2.55GB
Q3_K_S
0.53GB file 2.55GB
Q3_K_XL
0.53GB file 2.55GB
Q4_0
0.67GB file 2.69GB
Q4_1
0.67GB file 2.69GB
Q4_K_M
0.67GB file 2.69GB
Q4_K_S
0.67GB file 2.69GB
Q4_K_XL
0.67GB file 2.69GB
Q5_K_M
0.83GB file 2.85GB
Q5_K_S
0.83GB file 2.85GB
Q5_K_XL
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB
Q6_K_XL
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB
Q8_K_XL
1.28GB file 3.3GB

LFM2-2.6B-Exp-GGUF

2.6B 8K ctx
Q2_K
0.81GB file 2.85GB
Q2_K_L
0.81GB file 2.85GB
Q2_K_XL
0.81GB file 2.85GB
Q3_K_M
1.14GB file 3.18GB
Q3_K_S
1.14GB file 3.18GB
Q3_K_XL
1.14GB file 3.18GB
Q4_0
1.46GB file 3.5GB
Q4_1
1.46GB file 3.5GB
Q4_K_M
1.46GB file 3.5GB
Q4_K_S
1.46GB file 3.5GB
Q4_K_XL
1.46GB file 3.5GB
Q5_K_M
1.79GB file 3.83GB
Q5_K_S
1.79GB file 3.83GB
Q5_K_XL
1.79GB file 3.83GB
Q6_K
2.11GB file 4.15GB
Q6_K_XL
2.11GB file 4.15GB
Q8_0
2.76GB file 4.8GB
Q8_K_XL
2.76GB file 4.8GB
BF16
5.2GB file 7.24GB

LFM2-350M-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q2_K_L
0GB file 2GB
Q2_K_XL
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_K_XL
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_K_XL
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q5_K_XL
0GB file 2GB
Q6_K
0GB file 2GB
Q6_K_XL
0GB file 2GB
Q8_0
0GB file 2GB
Q8_K_XL
0GB file 2GB

LFM2-700M-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q2_K_L
0GB file 2GB
Q2_K_XL
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_K_XL
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_K_XL
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q5_K_XL
0GB file 2GB
Q6_K
0GB file 2GB
Q6_K_XL
0GB file 2GB
Q8_0
0GB file 2GB
Q8_K_XL
0GB file 2GB

LFM2-8B-A1B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_L
2.5GB file 4.63GB
Q2_K_XL
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_XL
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_K_XL
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q5_K_XL
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q6_K_XL
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
Q8_K_XL
8.5GB file 10.63GB
BF16
16GB file 18.13GB

LFM2.5-1.2B-Instruct-GGUF

1.2B 8K ctx
Q2_K
0.38GB file 2.4GB
Q2_K_L
0.38GB file 2.4GB
Q2_K_XL
0.38GB file 2.4GB
Q3_K_M
0.53GB file 2.55GB
Q3_K_S
0.53GB file 2.55GB
Q3_K_XL
0.53GB file 2.55GB
Q4_0
0.67GB file 2.69GB
Q4_1
0.67GB file 2.69GB
Q4_K_M
0.67GB file 2.69GB
Q4_K_S
0.67GB file 2.69GB
Q4_K_XL
0.67GB file 2.69GB
Q5_K_M
0.83GB file 2.85GB
Q5_K_S
0.83GB file 2.85GB
Q5_K_XL
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB
Q6_K_XL
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB
Q8_K_XL
1.28GB file 3.3GB
BF16
2.4GB file 4.42GB

LFM2.5-1.2B-Thinking-GGUF

1.2B 8K ctx
Q2_K
0.38GB file 2.4GB
Q2_K_L
0.38GB file 2.4GB
Q2_K_XL
0.38GB file 2.4GB
Q3_K_M
0.53GB file 2.55GB
Q3_K_S
0.53GB file 2.55GB
Q3_K_XL
0.53GB file 2.55GB
Q4_0
0.67GB file 2.69GB
Q4_1
0.67GB file 2.69GB
Q4_K_M
0.67GB file 2.69GB
Q4_K_S
0.67GB file 2.69GB
Q4_K_XL
0.67GB file 2.69GB
Q5_K_M
0.83GB file 2.85GB
Q5_K_S
0.83GB file 2.85GB
Q5_K_XL
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB
Q6_K_XL
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB
Q8_K_XL
1.28GB file 3.3GB
BF16
2.4GB file 4.42GB

Ling-1T-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q2_K
0GB file 2GB
Q2_K_L
0GB file 2GB
Q2_K_XL
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_K_XL
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_K_XL
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q5_K_XL
0GB file 2GB
Q6_K
0GB file 2GB
Q6_K_XL
0GB file 2GB
Q8_0
0GB file 2GB
Q8_K_XL
0GB file 2GB

Llama-3_1-Nemotron-Ultra-253B-v1-GGUF

253B 8K ctx
Q2_K
79.06GB file 85.21GB
Q2_K_L
79.06GB file 85.21GB
Q2_K_XL
79.06GB file 85.21GB
Q2_M
79.06GB file 85.21GB
Q2_XXS
79.06GB file 85.21GB
Q3_K_M
110.69GB file 116.84GB
Q3_K_S
110.69GB file 116.84GB
Q3_K_XL
110.69GB file 116.84GB
Q3_XXS
110.69GB file 116.84GB
Q4_1
142.31GB file 148.46GB
Q4_K_M
142.31GB file 148.46GB
Q4_K_S
142.31GB file 148.46GB
Q4_K_XL
142.31GB file 148.46GB
Q4_NL
142.31GB file 148.46GB
Q4_XS
142.31GB file 148.46GB
Q5_K_M
173.94GB file 180.09GB
Q5_K_S
173.94GB file 180.09GB
Q5_K_XL
173.94GB file 180.09GB
Q6_K
205.56GB file 211.71GB
Q6_K_XL
205.56GB file 211.71GB
Q1_M
253GB file 259.15GB
Q1_S
253GB file 259.15GB
Q8_0
268.81GB file 274.96GB
Q8_K_XL
268.81GB file 274.96GB
BF16
506GB file 512.15GB

Llama-3_3-Nemotron-Super-49B-v1_5-GGUF

49B 8K ctx
Q2_K
15.31GB file 18.11GB
Q2_K_L
15.31GB file 18.11GB
Q2_K_XL
15.31GB file 18.11GB
Q2_M
15.31GB file 18.11GB
Q2_XXS
15.31GB file 18.11GB
Q3_K_M
21.44GB file 24.24GB
Q3_K_S
21.44GB file 24.24GB
Q3_K_XL
21.44GB file 24.24GB
Q3_XXS
21.44GB file 24.24GB
Q4_0
27.56GB file 30.36GB
Q4_1
27.56GB file 30.36GB
Q4_K_M
27.56GB file 30.36GB
Q4_K_S
27.56GB file 30.36GB
Q4_K_XL
27.56GB file 30.36GB
Q4_NL
27.56GB file 30.36GB
Q4_XS
27.56GB file 30.36GB
Q5_K_M
33.69GB file 36.49GB
Q5_K_S
33.69GB file 36.49GB
Q5_K_XL
33.69GB file 36.49GB
Q6_K
39.81GB file 42.61GB
Q6_K_XL
39.81GB file 42.61GB
Q1_M
49GB file 51.8GB
Q1_S
49GB file 51.8GB
Q8_0
52.06GB file 54.86GB
Q8_K_XL
52.06GB file 54.86GB
BF16
98GB file 100.8GB

Llama-3_3-Nemotron-Super-49B-v1-GGUF

49B 8K ctx
Q2_K
15.31GB file 18.11GB
Q2_K_L
15.31GB file 18.11GB
Q2_K_XL
15.31GB file 18.11GB
Q2_M
15.31GB file 18.11GB
Q2_XXS
15.31GB file 18.11GB
Q3_K_M
21.44GB file 24.24GB
Q3_K_S
21.44GB file 24.24GB
Q3_K_XL
21.44GB file 24.24GB
Q3_XXS
21.44GB file 24.24GB
Q4_1
27.56GB file 30.36GB
Q4_K_M
27.56GB file 30.36GB
Q4_K_S
27.56GB file 30.36GB
Q4_K_XL
27.56GB file 30.36GB
Q4_NL
27.56GB file 30.36GB
Q4_XS
27.56GB file 30.36GB
Q5_K_M
33.69GB file 36.49GB
Q5_K_S
33.69GB file 36.49GB
Q5_K_XL
33.69GB file 36.49GB
Q6_K
39.81GB file 42.61GB
Q6_K_XL
39.81GB file 42.61GB
Q1_M
49GB file 51.8GB
Q1_S
49GB file 51.8GB
Q8_K_XL
52.06GB file 54.86GB
BF16
98GB file 100.8GB

Llama-3.1-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_L
2.5GB file 4.63GB
Q2_K_XL
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_XL
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_K_XL
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q5_K_XL
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q6_K_XL
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_K_XL
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Llama-3.1-Nemotron-Nano-8B-v1-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_L
2.5GB file 4.63GB
Q2_K_XL
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_XL
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_K_XL
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q5_K_XL
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q6_K_XL
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_K_XL
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Llama-3.2-1B-Instruct-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q2_K_L
0.31GB file 2.33GB
Q2_K_XL
0.31GB file 2.33GB
Q2_M
0.31GB file 2.33GB
Q2_XXS
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_S
0.44GB file 2.46GB
Q3_K_XL
0.44GB file 2.46GB
Q3_XXS
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q4_K_XL
0.56GB file 2.58GB
Q4_NL
0.56GB file 2.58GB
Q4_XS
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q5_K_XL
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q6_K_XL
0.81GB file 2.83GB
Q1_M
1GB file 3.02GB
Q1_S
1GB file 3.02GB
Q8_0
1.06GB file 3.08GB
Q8_K_XL
1.06GB file 3.08GB
BF16
2GB file 4.02GB

Llama-3.2-3B-Instruct-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q2_K_L
0.94GB file 2.99GB
Q2_K_XL
0.94GB file 2.99GB
Q2_M
0.94GB file 2.99GB
Q2_XXS
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q3_K_XL
1.31GB file 3.36GB
Q3_XXS
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q4_K_XL
1.69GB file 3.74GB
Q4_NL
1.69GB file 3.74GB
Q4_XS
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q5_K_XL
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q6_K_XL
2.44GB file 4.49GB
Q1_M
3GB file 5.05GB
Q1_S
3GB file 5.05GB
Q8_0
3.19GB file 5.24GB
Q8_K_XL
3.19GB file 5.24GB
BF16
6GB file 8.05GB

MAI-DS-R1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q2_K_L
0.31GB file 2.33GB
Q2_K_XL
0.31GB file 2.33GB
Q2_M
0.31GB file 2.33GB
Q2_XXS
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_XL
0.44GB file 2.46GB
Q3_XXS
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_XL
0.56GB file 2.58GB
Q4_NL
0.56GB file 2.58GB
Q4_XS
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q1_M
1GB file 3.02GB
Q1_S
1GB file 3.02GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

MiMo-V2.5-Pro-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
FP4
0GB file 2GB
Q1_M
0GB file 2GB
Q2_K_XL
0GB file 2GB
Q2_M
0GB file 2GB
Q2_XXS
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_XL
0GB file 2GB
Q3_S
0GB file 2GB
Q3_XXS
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_K_XL
0GB file 2GB
Q4_NL
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q5_K_XL
0GB file 2GB
Q6_K
0GB file 2GB
Q6_K_XL
0GB file 2GB
Q8_0
0GB file 2GB
Q8_K_XL
0GB file 2GB

MiniMax-M2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q2_K_L
0.63GB file 2.66GB
Q2_K_XL
0.63GB file 2.66GB
Q2_M
0.63GB file 2.66GB
Q2_XXS
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q3_K_XL
0.88GB file 2.91GB
Q3_XXS
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q4_K_XL
1.13GB file 3.16GB
Q4_NL
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q5_K_XL
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q6_K_XL
1.63GB file 3.66GB
Q1_0
2GB file 4.03GB
Q1_M
2GB file 4.03GB
Q1_S
2GB file 4.03GB
Q8_0
2.13GB file 4.16GB
Q8_K_XL
2.13GB file 4.16GB
BF16
4GB file 6.03GB

MiniMax-M2.1-GGUF

2.1B 8K ctx
Q2_K
0.66GB file 2.69GB
Q2_K_L
0.66GB file 2.69GB
Q2_K_XL
0.66GB file 2.69GB
Q2_M
0.66GB file 2.69GB
Q2_XXS
0.66GB file 2.69GB
Q3_K_M
0.92GB file 2.95GB
Q3_K_S
0.92GB file 2.95GB
Q3_K_XL
0.92GB file 2.95GB
Q3_XXS
0.92GB file 2.95GB
Q4_0
1.18GB file 3.21GB
Q4_1
1.18GB file 3.21GB
Q4_K_M
1.18GB file 3.21GB
Q4_K_S
1.18GB file 3.21GB
Q4_K_XL
1.18GB file 3.21GB
Q4_NL
1.18GB file 3.21GB
Q4_XS
1.18GB file 3.21GB
Q5_K_M
1.44GB file 3.47GB
Q5_K_S
1.44GB file 3.47GB
Q5_K_XL
1.44GB file 3.47GB
Q6_K
1.71GB file 3.74GB
Q6_K_XL
1.71GB file 3.74GB
Q1_0
2.1GB file 4.13GB
Q1_M
2.1GB file 4.13GB
Q1_S
2.1GB file 4.13GB
Q8_0
2.23GB file 4.26GB
Q8_K_XL
2.23GB file 4.26GB
BF16
4.2GB file 6.23GB

MiniMax-M2.5-GGUF

2.5B 8K ctx
Q2_K
0.78GB file 2.82GB
Q2_K_L
0.78GB file 2.82GB
Q2_K_XL
0.78GB file 2.82GB
Q2_M
0.78GB file 2.82GB
Q2_XXS
0.78GB file 2.82GB
Q3_K_M
1.09GB file 3.13GB
Q3_K_S
1.09GB file 3.13GB
Q3_K_XL
1.09GB file 3.13GB
Q3_XXS
1.09GB file 3.13GB
Q4_0
1.41GB file 3.45GB
Q4_1
1.41GB file 3.45GB
Q4_K_M
1.41GB file 3.45GB
Q4_K_S
1.41GB file 3.45GB
Q4_K_XL
1.41GB file 3.45GB
Q4_NL
1.41GB file 3.45GB
Q4_XS
1.41GB file 3.45GB
Q5_K_M
1.72GB file 3.76GB
Q5_K_S
1.72GB file 3.76GB
Q5_K_XL
1.72GB file 3.76GB
Q6_K
2.03GB file 4.07GB
Q6_K_XL
2.03GB file 4.07GB
FP4
2.5GB file 4.54GB
Q1_0
2.5GB file 4.54GB
Q1_M
2.5GB file 4.54GB
Q1_S
2.5GB file 4.54GB
Q8_0
2.66GB file 4.7GB
Q8_K_XL
2.66GB file 4.7GB
BF16
5GB file 7.04GB

MiniMax-M2.7-GGUF

2.7B 8K ctx
Q2_K_XL
0.84GB file 2.88GB
Q2_M
0.84GB file 2.88GB
Q2_XXS
0.84GB file 2.88GB
Q3_K_M
1.18GB file 3.22GB
Q3_K_S
1.18GB file 3.22GB
Q3_K_XL
1.18GB file 3.22GB
Q3_S
1.18GB file 3.22GB
Q3_XXS
1.18GB file 3.22GB
Q4_K_M
1.52GB file 3.56GB
Q4_K_S
1.52GB file 3.56GB
Q4_K_XL
1.52GB file 3.56GB
Q4_NL
1.52GB file 3.56GB
Q4_XS
1.52GB file 3.56GB
Q5_K_M
1.86GB file 3.9GB
Q5_K_S
1.86GB file 3.9GB
Q5_K_XL
1.86GB file 3.9GB
Q6_K
2.19GB file 4.23GB
Q6_K_XL
2.19GB file 4.23GB
FP4
2.7GB file 4.74GB
Q1_M
2.7GB file 4.74GB
Q8_0
2.87GB file 4.91GB
Q8_K_XL
2.87GB file 4.91GB
BF16
5.4GB file 7.44GB

Mistral-Nemo-Instruct-2407-GGUF

2407B 8K ctx
Q2_K
752.19GB file 793.63GB
Q3_K_M
1053.06GB file 1094.5GB
Q4_K_M
1353.94GB file 1395.38GB
Q5_K_M
1654.81GB file 1696.25GB
Q6_K
1955.69GB file 1997.13GB
Q8_0
2557.44GB file 2598.88GB

Mistral-Small-24B-Instruct-2501-GGUF

24B 8K ctx
Q2_K
7.5GB file 9.89GB
Q2_K_L
7.5GB file 9.89GB
Q3_K_M
10.5GB file 12.89GB
Q4_K_M
13.5GB file 15.89GB
Q5_K
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB
BF16
48GB file 50.39GB

Nemotron-3-Nano-30B-A3B-GGUF

30B 8K ctx
Q2_K_L
9.38GB file 11.87GB
Q2_K_XL
9.38GB file 11.87GB
Q2_M
9.38GB file 11.87GB
Q2_XXS
9.38GB file 11.87GB
Q3_K_M
13.13GB file 15.62GB
Q3_K_S
13.13GB file 15.62GB
Q3_K_XL
13.13GB file 15.62GB
Q3_XXS
13.13GB file 15.62GB
Q4_0
16.88GB file 19.37GB
Q4_1
16.88GB file 19.37GB
Q4_K_M
16.88GB file 19.37GB
Q4_K_S
16.88GB file 19.37GB
Q4_K_XL
16.88GB file 19.37GB
Q4_NL
16.88GB file 19.37GB
Q4_XS
16.88GB file 19.37GB
Q5_K_M
20.63GB file 23.12GB
Q5_K_S
20.63GB file 23.12GB
Q5_K_XL
20.63GB file 23.12GB
Q6_K
24.38GB file 26.87GB
Q6_K_XL
24.38GB file 26.87GB
Q8_0
31.88GB file 34.37GB
Q8_K_XL
31.88GB file 34.37GB
BF16
60GB file 62.49GB

NVIDIA-Nemotron-3-Nano-4B-GGUF

4B 8K ctx
Q2_K_XL
1.25GB file 3.32GB
Q2_M
1.25GB file 3.32GB
Q2_XXS
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q3_K_XL
1.75GB file 3.82GB
Q3_XXS
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_K_XL
2.25GB file 4.32GB
Q4_NL
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q5_K_XL
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q6_K_XL
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
Q8_K_XL
4.25GB file 6.32GB
BF16
8GB file 10.07GB

NVIDIA-Nemotron-3-Nano-Omni-30B-A3B-Reasoning-GGUF

30B 8K ctx
Q2_K_XL
9.38GB file 11.87GB
Q2_M
9.38GB file 11.87GB
Q2_XXS
9.38GB file 11.87GB
Q3_K_M
13.13GB file 15.62GB
Q3_K_XL
13.13GB file 15.62GB
Q3_S
13.13GB file 15.62GB
Q3_XXS
13.13GB file 15.62GB
Q4_K_M
16.88GB file 19.37GB
Q4_K_S
16.88GB file 19.37GB
Q4_K_XL
16.88GB file 19.37GB
Q4_NL
16.88GB file 19.37GB
Q4_XS
16.88GB file 19.37GB
Q5_K_M
20.63GB file 23.12GB
Q5_K_S
20.63GB file 23.12GB
Q5_K_XL
20.63GB file 23.12GB
Q6_K
24.38GB file 26.87GB
Q6_K_XL
24.38GB file 26.87GB
FP4
30GB file 32.49GB
Q8_0
31.88GB file 34.37GB
Q8_K_XL
31.88GB file 34.37GB
BF16
60GB file 62.49GB

NVIDIA-Nemotron-3-Super-120B-A12B-GGUF

120B 8K ctx
Q2_K_XL
37.5GB file 41.47GB
Q2_M
37.5GB file 41.47GB
Q2_XXS
37.5GB file 41.47GB
Q3_K_M
52.5GB file 56.47GB
Q3_K_S
52.5GB file 56.47GB
Q3_K_XL
52.5GB file 56.47GB
Q3_S
52.5GB file 56.47GB
Q3_XXS
52.5GB file 56.47GB
Q4_K_M
67.5GB file 71.47GB
Q4_K_S
67.5GB file 71.47GB
Q4_K_XL
67.5GB file 71.47GB
Q4_NL
67.5GB file 71.47GB
Q4_XS
67.5GB file 71.47GB
Q5_K_M
82.5GB file 86.47GB
Q5_K_S
82.5GB file 86.47GB
Q5_K_XL
82.5GB file 86.47GB
Q6_K
97.5GB file 101.47GB
Q6_K_XL
97.5GB file 101.47GB
FP4
120GB file 123.97GB
Q1_M
120GB file 123.97GB
Q8_0
127.5GB file 131.47GB
Q8_K_XL
127.5GB file 131.47GB
BF16
240GB file 243.97GB

OLMo-2-0325-32B-Instruct-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_K_L
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q5_K_M
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB
BF16
64GB file 66.52GB

OLMo-2-0425-1B-Instruct-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q2_K_L
0.31GB file 2.33GB
Q2_K_XL
0.31GB file 2.33GB
Q2_M
0.31GB file 2.33GB
Q2_XXS
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_S
0.44GB file 2.46GB
Q3_K_XL
0.44GB file 2.46GB
Q3_XXS
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_XL
0.56GB file 2.58GB
Q4_NL
0.56GB file 2.58GB
Q4_XS
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_XL
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q6_K_XL
0.81GB file 2.83GB
Q1_M
1GB file 3.02GB
Q1_S
1GB file 3.02GB
Q8_0
1.06GB file 3.08GB
Q8_K_XL
1.06GB file 3.08GB
BF16
2GB file 4.02GB

OpenReasoning-Nemotron-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_K_L
10GB file 12.52GB
Q2_K_XL
10GB file 12.52GB
Q2_M
10GB file 12.52GB
Q2_XXS
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_K_XL
14GB file 16.52GB
Q3_XXS
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_K_XL
18GB file 20.52GB
Q4_NL
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q5_K_XL
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q6_K_XL
26GB file 28.52GB
Q1_M
32GB file 34.52GB
Q1_S
32GB file 34.52GB
Q8_0
34GB file 36.52GB
Q8_K_XL
34GB file 36.52GB
BF16
64GB file 66.52GB

phi-4-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q2_K_L
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Phi-4-mini-instruct-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q2_K_L
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Phi-4-mini-reasoning-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q2_K_L
4.38GB file 6.61GB
Q2_K_XL
4.38GB file 6.61GB
Q2_M
4.38GB file 6.61GB
Q2_XXS
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q3_K_XL
6.13GB file 8.36GB
Q3_XXS
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_XL
7.88GB file 10.11GB
Q4_NL
7.88GB file 10.11GB
Q4_XS
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_XL
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q6_K_XL
11.38GB file 13.61GB
Q1_M
14GB file 16.23GB
Q1_S
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB
Q8_K_XL
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Phi-4-reasoning-GGUF

14B 8K ctx
Q2_M
4.38GB file 6.61GB
Q2_XXS
4.38GB file 6.61GB
Q2_K
4.38GB file 6.61GB
Q2_K_L
4.38GB file 6.61GB
Q2_K_XL
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q3_K_XL
6.13GB file 8.36GB
Q3_XXS
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_XL
7.88GB file 10.11GB
Q4_NL
7.88GB file 10.11GB
Q4_XS
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_XL
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q6_K_XL
11.38GB file 13.61GB
Q1_M
14GB file 16.23GB
Q1_S
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB
Q8_K_XL
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Phi-4-reasoning-plus-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q2_K_L
4.38GB file 6.61GB
Q2_K_XL
4.38GB file 6.61GB
Q2_M
4.38GB file 6.61GB
Q2_XXS
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q3_K_XL
6.13GB file 8.36GB
Q3_XXS
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_XL
7.88GB file 10.11GB
Q4_NL
7.88GB file 10.11GB
Q4_XS
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_XL
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q6_K_XL
11.38GB file 13.61GB
Q1_M
14GB file 16.23GB
Q1_S
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB
Q8_K_XL
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Qwen3-0.6B-GGUF

0.6B 8K ctx
Q2_K
0.19GB file 2.2GB
Q2_K_L
0.19GB file 2.2GB
Q2_K_XL
0.19GB file 2.2GB
Q2_M
0.19GB file 2.2GB
Q2_XXS
0.19GB file 2.2GB
Q3_K_M
0.26GB file 2.27GB
Q3_K_S
0.26GB file 2.27GB
Q3_K_XL
0.26GB file 2.27GB
Q3_XXS
0.26GB file 2.27GB
Q4_0
0.34GB file 2.35GB
Q4_1
0.34GB file 2.35GB
Q4_K_M
0.34GB file 2.35GB
Q4_K_S
0.34GB file 2.35GB
Q4_K_XL
0.34GB file 2.35GB
Q4_NL
0.34GB file 2.35GB
Q4_XS
0.34GB file 2.35GB
Q5_K_M
0.41GB file 2.42GB
Q5_K_S
0.41GB file 2.42GB
Q5_K_XL
0.41GB file 2.42GB
Q6_K
0.49GB file 2.5GB
Q6_K_XL
0.49GB file 2.5GB
Q1_M
0.6GB file 2.61GB
Q1_S
0.6GB file 2.61GB
Q8_0
0.64GB file 2.65GB
Q8_K_XL
0.64GB file 2.65GB
BF16
1.2GB file 3.21GB

Qwen3-1.7B-GGUF

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q2_K_L
0.53GB file 2.56GB
Q2_K_XL
0.53GB file 2.56GB
Q2_M
0.53GB file 2.56GB
Q2_XXS
0.53GB file 2.56GB
Q3_K_M
0.74GB file 2.77GB
Q3_K_S
0.74GB file 2.77GB
Q3_K_XL
0.74GB file 2.77GB
Q3_XXS
0.74GB file 2.77GB
Q4_0
0.96GB file 2.99GB
Q4_1
0.96GB file 2.99GB
Q4_K_M
0.96GB file 2.99GB
Q4_K_S
0.96GB file 2.99GB
Q4_K_XL
0.96GB file 2.99GB
Q4_NL
0.96GB file 2.99GB
Q4_XS
0.96GB file 2.99GB
Q5_K_M
1.17GB file 3.2GB
Q5_K_S
1.17GB file 3.2GB
Q5_K_XL
1.17GB file 3.2GB
Q6_K
1.38GB file 3.41GB
Q6_K_XL
1.38GB file 3.41GB
Q1_M
1.7GB file 3.73GB
Q1_S
1.7GB file 3.73GB
Q8_0
1.81GB file 3.84GB
Q8_K_XL
1.81GB file 3.84GB
BF16
3.4GB file 5.43GB

Qwen3-14B-128K-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q2_K_L
4.38GB file 6.61GB
Q2_K_XL
4.38GB file 6.61GB
Q2_M
4.38GB file 6.61GB
Q2_XXS
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q3_K_XL
6.13GB file 8.36GB
Q3_XXS
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q4_K_XL
7.88GB file 10.11GB
Q4_NL
7.88GB file 10.11GB
Q4_XS
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q5_K_XL
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q6_K_XL
11.38GB file 13.61GB
Q1_M
14GB file 16.23GB
Q1_S
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB
Q8_K_XL
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Qwen3-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q2_K_L
4.38GB file 6.61GB
Q2_K_XL
4.38GB file 6.61GB
Q2_M
4.38GB file 6.61GB
Q2_XXS
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q3_K_XL
6.13GB file 8.36GB
Q3_XXS
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q4_K_XL
7.88GB file 10.11GB
Q4_NL
7.88GB file 10.11GB
Q4_XS
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q5_K_XL
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q6_K_XL
11.38GB file 13.61GB
Q1_M
14GB file 16.23GB
Q1_S
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB
Q8_K_XL
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Qwen3-235B-A22B-128K-GGUF

235B 8K ctx
Q2_K
73.44GB file 79.29GB
Q2_K_L
73.44GB file 79.29GB
Q2_K_XL
73.44GB file 79.29GB
Q3_K_M
102.81GB file 108.66GB
Q3_K_S
102.81GB file 108.66GB
Q3_K_XL
102.81GB file 108.66GB
Q4_1
132.19GB file 138.04GB
Q4_K_M
132.19GB file 138.04GB
Q4_K_S
132.19GB file 138.04GB
Q4_K_XL
132.19GB file 138.04GB
Q4_XS
132.19GB file 138.04GB
Q5_K_M
161.56GB file 167.41GB
Q5_K_S
161.56GB file 167.41GB
Q5_K_XL
161.56GB file 167.41GB
Q6_K
190.94GB file 196.79GB
Q6_K_XL
190.94GB file 196.79GB
Q8_0
249.69GB file 255.54GB
Q8_K_XL
249.69GB file 255.54GB
BF16
470GB file 475.85GB

Qwen3-235B-A22B-GGUF

235B 8K ctx
Q2_K
73.44GB file 79.29GB
Q2_K_L
73.44GB file 79.29GB
Q2_K_XL
73.44GB file 79.29GB
Q3_K_M
102.81GB file 108.66GB
Q3_K_S
102.81GB file 108.66GB
Q3_K_XL
102.81GB file 108.66GB
Q4_1
132.19GB file 138.04GB
Q4_K_M
132.19GB file 138.04GB
Q4_K_S
132.19GB file 138.04GB
Q4_K_XL
132.19GB file 138.04GB
Q4_XS
132.19GB file 138.04GB
Q5_K_M
161.56GB file 167.41GB
Q5_K_S
161.56GB file 167.41GB
Q5_K_XL
161.56GB file 167.41GB
Q6_K
190.94GB file 196.79GB
Q6_K_XL
190.94GB file 196.79GB
Q8_0
249.69GB file 255.54GB
Q8_K_XL
249.69GB file 255.54GB
BF16
470GB file 475.85GB

Qwen3-235B-A22B-Instruct-2507-GGUF

235B 8K ctx
Q2_K
73.44GB file 79.29GB
Q2_K_L
73.44GB file 79.29GB
Q2_K_XL
73.44GB file 79.29GB
Q3_K_M
102.81GB file 108.66GB
Q3_K_S
102.81GB file 108.66GB
Q3_K_XL
102.81GB file 108.66GB
Q4_0
132.19GB file 138.04GB
Q4_1
132.19GB file 138.04GB
Q4_K_M
132.19GB file 138.04GB
Q4_K_S
132.19GB file 138.04GB
Q4_K_XL
132.19GB file 138.04GB
Q4_XS
132.19GB file 138.04GB
Q5_K_M
161.56GB file 167.41GB
Q5_K_S
161.56GB file 167.41GB
Q5_K_XL
161.56GB file 167.41GB
Q6_K
190.94GB file 196.79GB
Q6_K_XL
190.94GB file 196.79GB
Q8_0
249.69GB file 255.54GB
Q8_K_XL
249.69GB file 255.54GB
BF16
470GB file 475.85GB

Qwen3-30B-A3B-128K-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q2_K_L
9.38GB file 11.87GB
Q2_K_XL
9.38GB file 11.87GB
Q2_M
9.38GB file 11.87GB
Q2_XXS
9.38GB file 11.87GB
Q3_K_M
13.13GB file 15.62GB
Q3_K_S
13.13GB file 15.62GB
Q3_K_XL
13.13GB file 15.62GB
Q3_XXS
13.13GB file 15.62GB
Q4_0
16.88GB file 19.37GB
Q4_1
16.88GB file 19.37GB
Q4_K_M
16.88GB file 19.37GB
Q4_K_S
16.88GB file 19.37GB
Q4_K_XL
16.88GB file 19.37GB
Q4_NL
16.88GB file 19.37GB
Q4_XS
16.88GB file 19.37GB
Q5_K_M
20.63GB file 23.12GB
Q5_K_S
20.63GB file 23.12GB
Q5_K_XL
20.63GB file 23.12GB
Q6_K
24.38GB file 26.87GB
Q6_K_XL
24.38GB file 26.87GB
Q1_M
30GB file 32.49GB
Q1_S
30GB file 32.49GB
Q8_0
31.88GB file 34.37GB
Q8_K_XL
31.88GB file 34.37GB
BF16
60GB file 62.49GB

Qwen3-30B-A3B-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q2_K_L
9.38GB file 11.87GB
Q2_K_XL
9.38GB file 11.87GB
Q2_M
9.38GB file 11.87GB
Q2_XXS
9.38GB file 11.87GB
Q3_K_M
13.13GB file 15.62GB
Q3_K_S
13.13GB file 15.62GB
Q3_K_XL
13.13GB file 15.62GB
Q3_XXS
13.13GB file 15.62GB
Q4_0
16.88GB file 19.37GB
Q4_1
16.88GB file 19.37GB
Q4_K_M
16.88GB file 19.37GB
Q4_K_S
16.88GB file 19.37GB
Q4_K_XL
16.88GB file 19.37GB
Q4_NL
16.88GB file 19.37GB
Q4_XS
16.88GB file 19.37GB
Q5_K_M
20.63GB file 23.12GB
Q5_K_S
20.63GB file 23.12GB
Q5_K_XL
20.63GB file 23.12GB
Q6_K
24.38GB file 26.87GB
Q6_K_XL
24.38GB file 26.87GB
Q1_M
30GB file 32.49GB
Q1_S
30GB file 32.49GB
Q8_0
31.88GB file 34.37GB
Q8_K_XL
31.88GB file 34.37GB
BF16
60GB file 62.49GB

Qwen3-32B-128K-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_K_L
10GB file 12.52GB
Q2_K_XL
10GB file 12.52GB
Q2_M
10GB file 12.52GB
Q2_XXS
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_K_XL
14GB file 16.52GB
Q3_XXS
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_K_XL
18GB file 20.52GB
Q4_NL
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q5_K_XL
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q6_K_XL
26GB file 28.52GB
Q1_M
32GB file 34.52GB
Q1_S
32GB file 34.52GB
Q8_0
34GB file 36.52GB
Q8_K_XL
34GB file 36.52GB
BF16
64GB file 66.52GB

Qwen3-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_K_L
10GB file 12.52GB
Q2_K_XL
10GB file 12.52GB
Q2_M
10GB file 12.52GB
Q2_XXS
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_K_XL
14GB file 16.52GB
Q3_XXS
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_K_XL
18GB file 20.52GB
Q4_NL
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q5_K_XL
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q6_K_XL
26GB file 28.52GB
Q1_M
32GB file 34.52GB
Q1_S
32GB file 34.52GB
Q8_0
34GB file 36.52GB
Q8_K_XL
34GB file 36.52GB
BF16
64GB file 66.52GB

Qwen3-4B-128K-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q2_K_L
1.25GB file 3.32GB
Q2_K_XL
1.25GB file 3.32GB
Q2_M
1.25GB file 3.32GB
Q2_XXS
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q3_K_XL
1.75GB file 3.82GB
Q3_XXS
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_K_XL
2.25GB file 4.32GB
Q4_NL
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q5_K_XL
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q6_K_XL
3.25GB file 5.32GB
Q1_M
4GB file 6.07GB
Q1_S
4GB file 6.07GB
Q8_0
4.25GB file 6.32GB
Q8_K_XL
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Qwen3-4B-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q2_K_L
1.25GB file 3.32GB
Q2_K_XL
1.25GB file 3.32GB
Q2_M
1.25GB file 3.32GB
Q2_XXS
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q3_K_XL
1.75GB file 3.82GB
Q3_XXS
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_K_XL
2.25GB file 4.32GB
Q4_NL
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q5_K_XL
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q6_K_XL
3.25GB file 5.32GB
Q1_M
4GB file 6.07GB
Q1_S
4GB file 6.07GB
Q8_0
4.25GB file 6.32GB
Q8_K_XL
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Qwen3-8B-128K-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_L
2.5GB file 4.63GB
Q2_K_XL
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_XL
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_K_XL
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q5_K_XL
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q6_K_XL
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB
Q8_K_XL
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Qwen3-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_L
2.5GB file 4.63GB
Q2_K_XL
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_XL
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_K_XL
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q5_K_XL
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q6_K_XL
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB
Q8_K_XL
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Qwen3-Coder-30B-A3B-Instruct-1M-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q2_K_L
9.38GB file 11.87GB
Q2_K_XL
9.38GB file 11.87GB
Q2_M
9.38GB file 11.87GB
Q2_XXS
9.38GB file 11.87GB
Q3_K_M
13.13GB file 15.62GB
Q3_K_S
13.13GB file 15.62GB
Q3_K_XL
13.13GB file 15.62GB
Q3_XXS
13.13GB file 15.62GB
Q4_0
16.88GB file 19.37GB
Q4_1
16.88GB file 19.37GB
Q4_K_M
16.88GB file 19.37GB
Q4_K_S
16.88GB file 19.37GB
Q4_K_XL
16.88GB file 19.37GB
Q4_NL
16.88GB file 19.37GB
Q4_XS
16.88GB file 19.37GB
Q5_K_M
20.63GB file 23.12GB
Q5_K_S
20.63GB file 23.12GB
Q5_K_XL
20.63GB file 23.12GB
Q6_K
24.38GB file 26.87GB
Q6_K_XL
24.38GB file 26.87GB
Q1_0
30GB file 32.49GB
Q1_M
30GB file 32.49GB
Q1_S
30GB file 32.49GB
Q8_0
31.88GB file 34.37GB
Q8_K_XL
31.88GB file 34.37GB
BF16
60GB file 62.49GB

Qwen3-Coder-30B-A3B-Instruct-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q2_K_L
9.38GB file 11.87GB
Q2_K_XL
9.38GB file 11.87GB
Q2_M
9.38GB file 11.87GB
Q2_XXS
9.38GB file 11.87GB
Q3_K_M
13.13GB file 15.62GB
Q3_K_S
13.13GB file 15.62GB
Q3_K_XL
13.13GB file 15.62GB
Q3_XXS
13.13GB file 15.62GB
Q4_0
16.88GB file 19.37GB
Q4_1
16.88GB file 19.37GB
Q4_K_M
16.88GB file 19.37GB
Q4_K_S
16.88GB file 19.37GB
Q4_K_XL
16.88GB file 19.37GB
Q4_NL
16.88GB file 19.37GB
Q4_XS
16.88GB file 19.37GB
Q5_K_M
20.63GB file 23.12GB
Q5_K_S
20.63GB file 23.12GB
Q5_K_XL
20.63GB file 23.12GB
Q6_K
24.38GB file 26.87GB
Q6_K_XL
24.38GB file 26.87GB
Q1_0
30GB file 32.49GB
Q1_M
30GB file 32.49GB
Q1_S
30GB file 32.49GB
Q8_0
31.88GB file 34.37GB
Q8_K_XL
31.88GB file 34.37GB
BF16
60GB file 62.49GB

Qwen3-Coder-480B-A35B-Instruct-1M-GGUF

480B 8K ctx
Q2_K
150GB file 159.86GB
Q2_K_L
150GB file 159.86GB
Q2_K_XL
150GB file 159.86GB
Q3_K_M
210GB file 219.86GB
Q3_K_S
210GB file 219.86GB
Q3_K_XL
210GB file 219.86GB
Q3_XXS
210GB file 219.86GB
Q4_0
270GB file 279.86GB
Q4_1
270GB file 279.86GB
Q4_K_M
270GB file 279.86GB
Q4_K_S
270GB file 279.86GB
Q4_K_XL
270GB file 279.86GB
Q4_NL
270GB file 279.86GB
Q4_XS
270GB file 279.86GB
Q5_K_M
330GB file 339.86GB
Q5_K_S
330GB file 339.86GB
Q5_K_XL
330GB file 339.86GB
Q6_K
390GB file 399.86GB
Q6_K_XL
390GB file 399.86GB
Q1_M
480GB file 489.86GB
Q8_0
510GB file 519.86GB
Q8_K_XL
510GB file 519.86GB
BF16
960GB file 969.86GB

Qwen3-Coder-480B-A35B-Instruct-GGUF

480B 8K ctx
Q2_K
150GB file 159.86GB
Q2_K_L
150GB file 159.86GB
Q2_K_XL
150GB file 159.86GB
Q3_K_M
210GB file 219.86GB
Q3_K_S
210GB file 219.86GB
Q3_K_XL
210GB file 219.86GB
Q3_XXS
210GB file 219.86GB
Q4_0
270GB file 279.86GB
Q4_1
270GB file 279.86GB
Q4_K_M
270GB file 279.86GB
Q4_K_S
270GB file 279.86GB
Q4_K_XL
270GB file 279.86GB
Q4_NL
270GB file 279.86GB
Q4_XS
270GB file 279.86GB
Q5_K_M
330GB file 339.86GB
Q5_K_S
330GB file 339.86GB
Q5_K_XL
330GB file 339.86GB
Q6_K
390GB file 399.86GB
Q6_K_XL
390GB file 399.86GB
Q1_M
480GB file 489.86GB
Q8_0
510GB file 519.86GB
Q8_K_XL
510GB file 519.86GB
BF16
960GB file 969.86GB

Qwen3-Coder-Next-GGUF

57B 8K ctx
Q2_K
17.81GB file 20.74GB
Q2_K_L
17.81GB file 20.74GB
Q2_K_XL
17.81GB file 20.74GB
Q2_M
17.81GB file 20.74GB
Q2_XXS
17.81GB file 20.74GB
Q3_K_M
24.94GB file 27.87GB
Q3_K_S
24.94GB file 27.87GB
Q3_K_XL
24.94GB file 27.87GB
Q3_S
24.94GB file 27.87GB
Q3_XXS
24.94GB file 27.87GB
Q4_0
32.06GB file 34.99GB
Q4_1
32.06GB file 34.99GB
Q4_K_M
32.06GB file 34.99GB
Q4_K_S
32.06GB file 34.99GB
Q4_K_XL
32.06GB file 34.99GB
Q4_NL
32.06GB file 34.99GB
Q4_XS
32.06GB file 34.99GB
Q5_K_M
39.19GB file 42.12GB
Q5_K_S
39.19GB file 42.12GB
Q5_K_XL
39.19GB file 42.12GB
Q6_K
46.31GB file 49.24GB
Q6_K_XL
46.31GB file 49.24GB
FP4
57GB file 59.93GB
Q1_0
57GB file 59.93GB
Q1_M
57GB file 59.93GB
Q1_S
57GB file 59.93GB
Q8_0
60.56GB file 63.49GB
Q8_K_XL
60.56GB file 63.49GB
BF16
114GB file 116.93GB

Qwen3-Coder-REAP-363B-A35B-GGUF

363B 8K ctx
Q2_K
113.44GB file 121.39GB
Q2_K_L
113.44GB file 121.39GB
Q2_K_XL
113.44GB file 121.39GB
Q3_K_M
158.81GB file 166.76GB
Q3_K_S
158.81GB file 166.76GB
Q3_K_XL
158.81GB file 166.76GB
Q3_XXS
158.81GB file 166.76GB
Q4_0
204.19GB file 212.14GB
Q4_1
204.19GB file 212.14GB
Q4_K_M
204.19GB file 212.14GB
Q4_K_S
204.19GB file 212.14GB
Q4_K_XL
204.19GB file 212.14GB
Q4_NL
204.19GB file 212.14GB
Q4_XS
204.19GB file 212.14GB
Q5_K_M
249.56GB file 257.51GB
Q5_K_S
249.56GB file 257.51GB
Q5_K_XL
249.56GB file 257.51GB
Q6_K
294.94GB file 302.89GB
Q6_K_XL
294.94GB file 302.89GB
Q1_0
363GB file 370.95GB
Q1_M
363GB file 370.95GB
Q1_S
363GB file 370.95GB
Q8_0
385.69GB file 393.64GB
Q8_K_XL
385.69GB file 393.64GB
BF16
726GB file 733.95GB

Qwen3-Next-80B-A3B-Instruct-GGUF

80B 8K ctx
Q2_K
25GB file 28.31GB
Q2_K_L
25GB file 28.31GB
Q2_K_XL
25GB file 28.31GB
Q2_XXS
25GB file 28.31GB
Q3_K_M
35GB file 38.31GB
Q3_K_S
35GB file 38.31GB
Q3_K_XL
35GB file 38.31GB
Q3_XXS
35GB file 38.31GB
Q4_0
45GB file 48.31GB
Q4_1
45GB file 48.31GB
Q4_K_M
45GB file 48.31GB
Q4_K_S
45GB file 48.31GB
Q4_K_XL
45GB file 48.31GB
Q4_NL
45GB file 48.31GB
Q4_XS
45GB file 48.31GB
Q5_K_M
55GB file 58.31GB
Q5_K_S
55GB file 58.31GB
Q5_K_XL
55GB file 58.31GB
Q6_K
65GB file 68.31GB
Q6_K_XL
65GB file 68.31GB
Q1_0
80GB file 83.31GB
Q1_M
80GB file 83.31GB
Q1_S
80GB file 83.31GB
Q8_0
85GB file 88.31GB
Q8_K_XL
85GB file 88.31GB
BF16
160GB file 163.31GB

Qwen3-Next-80B-A3B-Thinking-GGUF

80B 8K ctx
Q2_K
25GB file 28.31GB
Q2_K_L
25GB file 28.31GB
Q2_K_XL
25GB file 28.31GB
Q2_XXS
25GB file 28.31GB
Q3_K_M
35GB file 38.31GB
Q3_K_S
35GB file 38.31GB
Q3_K_XL
35GB file 38.31GB
Q3_XXS
35GB file 38.31GB
Q4_0
45GB file 48.31GB
Q4_1
45GB file 48.31GB
Q4_K_M
45GB file 48.31GB
Q4_K_S
45GB file 48.31GB
Q4_K_XL
45GB file 48.31GB
Q4_NL
45GB file 48.31GB
Q4_XS
45GB file 48.31GB
Q5_K_M
55GB file 58.31GB
Q5_K_S
55GB file 58.31GB
Q5_K_XL
55GB file 58.31GB
Q6_K
65GB file 68.31GB
Q6_K_XL
65GB file 68.31GB
Q1_0
80GB file 83.31GB
Q1_M
80GB file 83.31GB
Q1_S
80GB file 83.31GB
Q8_0
85GB file 88.31GB
Q8_K_XL
85GB file 88.31GB
BF16
160GB file 163.31GB

QwQ-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_K_L
10GB file 12.52GB
Q2_K_XL
10GB file 12.52GB
Q2_M
10GB file 12.52GB
Q2_XXS
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_K_XL
14GB file 16.52GB
Q3_XXS
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_XL
18GB file 20.52GB
Q4_NL
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_XL
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q6_K_XL
26GB file 28.52GB
Q1_M
32GB file 34.52GB
Q1_S
32GB file 34.52GB
Q8_0
34GB file 36.52GB
Q8_K_XL
34GB file 36.52GB
BF16
64GB file 66.52GB

QwQ-32B-Preview-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q5_K_M
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

r1-1776-distill-llama-70b-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q2_K_L
21.88GB file 25.03GB
Q3_K_M
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB
BF16
140GB file 143.15GB

r1-1776-GGUF

1776B 8K ctx
Q2_K
555GB file 586.1GB
Q2_K_L
555GB file 586.1GB
Q2_K_XL
555GB file 586.1GB
Q2_K_XS
555GB file 586.1GB
Q3_K_M
777GB file 808.1GB
Q3_K_XL
777GB file 808.1GB
Q4_K_M
999GB file 1030.1GB
Q4_K_XL
999GB file 1030.1GB
Q5_K_M
1221GB file 1252.1GB
Q6_K
1443GB file 1474.1GB
Q8_0
1887GB file 1918.1GB
BF16
3552GB file 3583.1GB

Reflection-Llama-3.1-70B-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_L
30.63GB file 33.78GB
Q4_K_M
39.38GB file 42.53GB
Q5_K_M
48.13GB file 51.28GB

Seed-Coder-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_L
2.5GB file 4.63GB
Q2_K_XL
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_XL
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_K_XL
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q5_K_XL
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q6_K_XL
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB
Q8_K_XL
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Seed-Coder-8B-Reasoning-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_L
2.5GB file 4.63GB
Q2_K_XL
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_XL
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_K_XL
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q5_K_XL
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q6_K_XL
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB
Q8_K_XL
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Seed-OSS-36B-Instruct-GGUF

36B 8K ctx
Q2_K
11.25GB file 13.84GB
Q2_K_L
11.25GB file 13.84GB
Q2_K_XL
11.25GB file 13.84GB
Q2_M
11.25GB file 13.84GB
Q2_XXS
11.25GB file 13.84GB
Q3_K_M
15.75GB file 18.34GB
Q3_K_S
15.75GB file 18.34GB
Q3_K_XL
15.75GB file 18.34GB
Q3_XXS
15.75GB file 18.34GB
Q4_0
20.25GB file 22.84GB
Q4_1
20.25GB file 22.84GB
Q4_K_M
20.25GB file 22.84GB
Q4_K_S
20.25GB file 22.84GB
Q4_K_XL
20.25GB file 22.84GB
Q4_NL
20.25GB file 22.84GB
Q4_XS
20.25GB file 22.84GB
Q5_K_M
24.75GB file 27.34GB
Q5_K_S
24.75GB file 27.34GB
Q5_K_XL
24.75GB file 27.34GB
Q6_K
29.25GB file 31.84GB
Q6_K_XL
29.25GB file 31.84GB
Q1_M
36GB file 38.59GB
Q1_S
36GB file 38.59GB
Q8_0
38.25GB file 40.84GB
Q8_K_XL
38.25GB file 40.84GB
BF16
72GB file 74.59GB
U

Untitled Minister

2 models

phi-4-abliterated-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

phi-4-abliterated-Q5_K_M-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB
U

Uonlp

1 models

Vistral-7B-Chat-gguf

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB
U

Uonyeka

1 models

llama-3.2.Instruct_q4_k_m

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
U

Upendrab

2 models

granite-8b-code-instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

llama-3-sqlcoder-8b-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
U

Uproai

1 models

ros-7b-v1-gguf

7B 8K ctx
FP16
14GB file 16.11GB