All Supported Models

29681 AI models · 198875 quantization formats tracked

B

Brianpu

3 models

Qwen1.5-0.5B-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2-0.5B-Instruct-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2.5-0.5B-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB
B

Brianpuz

11 models

DeepSeek-R1-DRAFT-Qwen2.5-0.5B-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

gemma-3-1b-it-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Mistral-Small-3.1-DRAFT-0.5B-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2-0.5B-Instruct-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2-0.5B-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2.5-0.5B-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2.5-0.5B-Instruct-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2.5-0.5B-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2.5-0.5B-Q8_0-GGUF

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB

Qwen2.5-1.5B-Q6_K-GGUF

1.5B 8K ctx
Q6_0
1.22GB file 3.24GB
FP16
3GB file 5.02GB

QwQ-32B-Q2_K-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
FP16
64GB file 66.52GB
B

Brianpuze

4 models

Qwen2-0.5B-Instruct-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2-0.5B-Q4_K_M-Q4_0-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB

Qwen2.5-0.5B-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2.5-0.5B-Q4_K_M-Q3_K_M-GGUF-TEST

0.5B 8K ctx
Q3_0
0.22GB file 2.23GB
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB
B

Bricksandbotltd

1 models

buildsnpper-chatbot-Q4_K_M

Unknown 8K ctx
Q4_K_M
0GB file 2GB
B

Briko

1 models

Granite-3.1-3B-A800m-Instruct-APEX

3B 8K ctx
FP16
6GB file 8.05GB
B

Brinq A I

2 models

functiongemma-270m-physical-ai

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB

smartpanel-functiongemma-270m

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB
B

Brisa Admin

1 models

mistral-7b-instruct-private-full

7B 8K ctx
FP16
14GB file 16.11GB
B

Brittlewis12

42 models

aanaphi2-v0.1-GGUF

0.1B 8K ctx
Q2_K
0.03GB file 2.03GB
Q3_K_L
0.04GB file 2.04GB
Q3_K_M
0.04GB file 2.04GB
Q3_K_S
0.04GB file 2.04GB
Q4_K_M
0.06GB file 2.06GB
Q4_K_S
0.06GB file 2.06GB
Q5_K_M
0.07GB file 2.07GB
Q5_K_S
0.07GB file 2.07GB
Q6_K
0.08GB file 2.08GB
Q8_0
0.11GB file 2.11GB
FP16
0.2GB file 2.2GB

Arcee-Maestro-7B-Preview-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_K_S
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_M
7GB file 9.11GB
Q1_S
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB

Beagle14-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB

DeepHermes-3-Llama-3-8B-Preview-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_S
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_S
2.5GB file 4.63GB
Q2_XS
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_S
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB

DeepSeek-R1-0528-Qwen3-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_S
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_S
2.5GB file 4.63GB
Q2_XS
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_S
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB

Devstral-Small-2507-GGUF

2507B 8K ctx
Q2_K
783.44GB file 826.51GB
Q2_K_S
783.44GB file 826.51GB
Q2_M
783.44GB file 826.51GB
Q2_S
783.44GB file 826.51GB
Q2_XS
783.44GB file 826.51GB
Q2_XXS
783.44GB file 826.51GB
Q3_K_L
1096.81GB file 1139.88GB
Q3_K_M
1096.81GB file 1139.88GB
Q3_K_S
1096.81GB file 1139.88GB
Q3_M
1096.81GB file 1139.88GB
Q3_S
1096.81GB file 1139.88GB
Q3_XS
1096.81GB file 1139.88GB
Q3_XXS
1096.81GB file 1139.88GB
Q4_0
1410.19GB file 1453.26GB
Q4_1
1410.19GB file 1453.26GB
Q4_K_M
1410.19GB file 1453.26GB
Q4_K_S
1410.19GB file 1453.26GB
Q4_NL
1410.19GB file 1453.26GB
Q4_XS
1410.19GB file 1453.26GB
Q5_0
1723.56GB file 1766.63GB
Q5_1
1723.56GB file 1766.63GB
Q5_K_M
1723.56GB file 1766.63GB
Q5_K_S
1723.56GB file 1766.63GB
Q6_K
2036.94GB file 2080.01GB
Q1_M
2507GB file 2550.07GB
Q1_S
2507GB file 2550.07GB
Q8_0
2663.69GB file 2706.76GB

distilabeled-Marcoro14-7B-slerp-full-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB

gemma-2b-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

gemma-2b-it-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
FP16
4GB file 6.03GB

gemma-3-1b-it-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q2_K_S
0.31GB file 2.33GB
Q2_M
0.31GB file 2.33GB
Q2_S
0.31GB file 2.33GB
Q2_XS
0.31GB file 2.33GB
Q2_XXS
0.31GB file 2.33GB
Q3_K_L
0.44GB file 2.46GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_S
0.44GB file 2.46GB
Q3_M
0.44GB file 2.46GB
Q3_S
0.44GB file 2.46GB
Q3_XS
0.44GB file 2.46GB
Q3_XXS
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q4_NL
0.56GB file 2.58GB
Q4_XS
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q5_1
0.69GB file 2.71GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q1_M
1GB file 3.02GB
Q1_S
1GB file 3.02GB
Q8_0
1.06GB file 3.08GB

gemma-3-27b-it-GGUF

27B 8K ctx
Q2_K
8.44GB file 10.88GB
Q2_K_S
8.44GB file 10.88GB
Q2_M
8.44GB file 10.88GB
Q2_S
8.44GB file 10.88GB
Q2_XS
8.44GB file 10.88GB
Q2_XXS
8.44GB file 10.88GB
Q3_K_L
11.81GB file 14.25GB
Q3_K_M
11.81GB file 14.25GB
Q3_K_S
11.81GB file 14.25GB
Q3_M
11.81GB file 14.25GB
Q3_S
11.81GB file 14.25GB
Q3_XS
11.81GB file 14.25GB
Q3_XXS
11.81GB file 14.25GB
Q4_0
15.19GB file 17.63GB
Q4_1
15.19GB file 17.63GB
Q4_K_M
15.19GB file 17.63GB
Q4_K_S
15.19GB file 17.63GB
Q4_NL
15.19GB file 17.63GB
Q4_XS
15.19GB file 17.63GB
Q5_0
18.56GB file 21GB
Q5_1
18.56GB file 21GB
Q5_K_M
18.56GB file 21GB
Q5_K_S
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q1_M
27GB file 29.44GB
Q1_S
27GB file 29.44GB
Q8_0
28.69GB file 31.13GB

gemma-3-4b-it-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q2_K_S
1.25GB file 3.32GB
Q2_M
1.25GB file 3.32GB
Q2_S
1.25GB file 3.32GB
Q2_XS
1.25GB file 3.32GB
Q2_XXS
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q3_M
1.75GB file 3.82GB
Q3_S
1.75GB file 3.82GB
Q3_XS
1.75GB file 3.82GB
Q3_XXS
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_NL
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q1_M
4GB file 6.07GB
Q1_S
4GB file 6.07GB
Q8_0
4.25GB file 6.32GB

gemma-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

gemma-7b-it-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB

h2o-danube-1.8b-chat-GGUF

1.8B 8K ctx
Q2_K
0.56GB file 2.59GB
Q3_K_L
0.79GB file 2.82GB
Q3_K_M
0.79GB file 2.82GB
Q3_K_S
0.79GB file 2.82GB
Q4_K_M
1.01GB file 3.04GB
Q4_K_S
1.01GB file 3.04GB
Q5_K_M
1.24GB file 3.27GB
Q5_K_S
1.24GB file 3.27GB
Q6_K
1.46GB file 3.49GB
Q8_0
1.91GB file 3.94GB
FP16
3.6GB file 5.63GB

Kunoichi-DPO-v2-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_K_S
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_M
7GB file 9.11GB
Q1_S
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB

Llama-3.1-Tulu-3.1-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_S
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_S
2.5GB file 4.63GB
Q2_XS
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_S
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB

Memphis-CoT-3B-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
FP16
6GB file 8.05GB

Meta-Llama-3-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_S
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_S
2.5GB file 4.63GB
Q2_XS
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_S
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_S
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_S
2.5GB file 4.63GB
Q2_XS
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_S
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB

Mistral-Small-24B-Instruct-2501-reasoning-GGUF

24B 8K ctx
Q2_K
7.5GB file 9.89GB
Q2_K_S
7.5GB file 9.89GB
Q2_M
7.5GB file 9.89GB
Q2_S
7.5GB file 9.89GB
Q2_XS
7.5GB file 9.89GB
Q2_XXS
7.5GB file 9.89GB
Q3_K_L
10.5GB file 12.89GB
Q3_K_M
10.5GB file 12.89GB
Q3_K_S
10.5GB file 12.89GB
Q3_M
10.5GB file 12.89GB
Q3_S
10.5GB file 12.89GB
Q3_XS
10.5GB file 12.89GB
Q3_XXS
10.5GB file 12.89GB
Q4_0
13.5GB file 15.89GB
Q4_1
13.5GB file 15.89GB
Q4_K_M
13.5GB file 15.89GB
Q4_K_S
13.5GB file 15.89GB
Q4_NL
13.5GB file 15.89GB
Q4_XS
13.5GB file 15.89GB
Q5_0
16.5GB file 18.89GB
Q5_1
16.5GB file 18.89GB
Q5_K_M
16.5GB file 18.89GB
Q5_K_S
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB
Q1_M
24GB file 26.39GB
Q1_S
24GB file 26.39GB
Q8_0
25.5GB file 27.89GB

NeuralDaredevil-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB

Open-Reasoner-Zero-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_K_S
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_M
7GB file 9.11GB
Q1_S
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB

openchat-3.5-0106-11b-GGUF

11B 8K ctx
Q2_K
3.44GB file 5.62GB
Q3_K_L
4.81GB file 6.99GB
Q3_K_S
4.81GB file 6.99GB
Q4_K_M
6.19GB file 8.37GB
Q4_K_S
6.19GB file 8.37GB
Q5_K_M
7.56GB file 9.74GB
Q5_K_S
7.56GB file 9.74GB
Q6_K
8.94GB file 11.12GB
Q8_0
11.69GB file 13.87GB
FP16
22GB file 24.18GB

OpenCodeInterpreter-DS-1.3B-GGUF

1.3B 8K ctx
Q2_K
0.41GB file 2.43GB
Q3_K_L
0.57GB file 2.59GB
Q3_K_M
0.57GB file 2.59GB
Q3_K_S
0.57GB file 2.59GB
Q4_K_M
0.73GB file 2.75GB
Q4_K_S
0.73GB file 2.75GB
Q5_K_M
0.89GB file 2.91GB
Q5_K_S
0.89GB file 2.91GB
Q6_K
1.06GB file 3.08GB
Q8_0
1.38GB file 3.4GB
FP16
2.6GB file 4.62GB

OpenCodeInterpreter-DS-6.7B-GGUF

6.7B 8K ctx
Q2_K
2.09GB file 4.2GB
Q3_K_L
2.93GB file 5.04GB
Q3_K_M
2.93GB file 5.04GB
Q3_K_S
2.93GB file 5.04GB
Q4_K_M
3.77GB file 5.88GB
Q4_K_S
3.77GB file 5.88GB
Q5_K_M
4.61GB file 6.72GB
Q5_K_S
4.61GB file 6.72GB
Q6_K
5.44GB file 7.55GB
Q8_0
7.12GB file 9.23GB
FP16
13.4GB file 15.51GB

phi-2-orange-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB
Q6_K
0GB file 2GB

Phi-3-mini-4k-instruct-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB
Q2_K_S
1.19GB file 3.25GB
Q2_M
1.19GB file 3.25GB
Q2_S
1.19GB file 3.25GB
Q2_XS
1.19GB file 3.25GB
Q2_XXS
1.19GB file 3.25GB
Q3_K_L
1.66GB file 3.72GB
Q3_K_M
1.66GB file 3.72GB
Q3_K_S
1.66GB file 3.72GB
Q3_M
1.66GB file 3.72GB
Q3_S
1.66GB file 3.72GB
Q3_XS
1.66GB file 3.72GB
Q3_XXS
1.66GB file 3.72GB
Q4_K_M
2.14GB file 4.2GB
Q4_K_S
2.14GB file 4.2GB
Q4_NL
2.14GB file 4.2GB
Q4_XS
2.14GB file 4.2GB
Q5_K_M
2.61GB file 4.67GB
Q5_K_S
2.61GB file 4.67GB
Q6_K
3.09GB file 5.15GB
Q1_M
3.8GB file 5.86GB
Q1_S
3.8GB file 5.86GB
Q8_0
4.04GB file 6.1GB
FP16
7.6GB file 9.66GB

Qwen1.5-0.5B-OpenHermes-2.5-GGUF

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB
Q3_K_L
0.22GB file 2.23GB
Q3_K_M
0.22GB file 2.23GB
Q3_K_S
0.22GB file 2.23GB
Q4_K_M
0.28GB file 2.29GB
Q4_K_S
0.28GB file 2.29GB
Q5_K_M
0.34GB file 2.35GB
Q5_K_S
0.34GB file 2.35GB
Q6_K
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB
FP16
1GB file 3.01GB

Qwen1.5-1.8B-OpenHermes-2.5-GGUF

1.8B 8K ctx
Q2_K
0.56GB file 2.59GB
Q3_K_L
0.79GB file 2.82GB
Q3_K_M
0.79GB file 2.82GB
Q3_K_S
0.79GB file 2.82GB
Q4_K_M
1.01GB file 3.04GB
Q4_K_S
1.01GB file 3.04GB
Q5_K_M
1.24GB file 3.27GB
Q5_K_S
1.24GB file 3.27GB
Q6_K
1.46GB file 3.49GB
Q8_0
1.91GB file 3.94GB
FP16
3.6GB file 5.63GB

QwQ-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_K_S
10GB file 12.52GB
Q2_M
10GB file 12.52GB
Q2_S
10GB file 12.52GB
Q2_XS
10GB file 12.52GB
Q2_XXS
10GB file 12.52GB
Q3_K_L
14GB file 16.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_M
14GB file 16.52GB
Q3_S
14GB file 16.52GB
Q3_XS
14GB file 16.52GB
Q3_XXS
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_NL
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_1
22GB file 24.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q1_M
32GB file 34.52GB
Q1_S
32GB file 34.52GB
Q8_0
34GB file 36.52GB

reka-flash-3-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q2_K_S
0.94GB file 2.99GB
Q2_M
0.94GB file 2.99GB
Q2_S
0.94GB file 2.99GB
Q2_XS
0.94GB file 2.99GB
Q2_XXS
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q3_M
1.31GB file 3.36GB
Q3_S
1.31GB file 3.36GB
Q3_XS
1.31GB file 3.36GB
Q3_XXS
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q4_NL
1.69GB file 3.74GB
Q4_XS
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_1
2.06GB file 4.11GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q1_M
3GB file 5.05GB
Q1_S
3GB file 5.05GB
Q8_0
3.19GB file 5.24GB

s1-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_K_S
10GB file 12.52GB
Q2_M
10GB file 12.52GB
Q2_S
10GB file 12.52GB
Q2_XS
10GB file 12.52GB
Q2_XXS
10GB file 12.52GB
Q3_K_L
14GB file 16.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_M
14GB file 16.52GB
Q3_S
14GB file 16.52GB
Q3_XS
14GB file 16.52GB
Q3_XXS
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_NL
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_1
22GB file 24.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q1_M
32GB file 34.52GB
Q1_S
32GB file 34.52GB
Q8_0
34GB file 36.52GB

s1.1-32B-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q2_K_S
10GB file 12.52GB
Q2_M
10GB file 12.52GB
Q2_S
10GB file 12.52GB
Q2_XS
10GB file 12.52GB
Q2_XXS
10GB file 12.52GB
Q3_K_L
14GB file 16.52GB
Q3_K_M
14GB file 16.52GB
Q3_K_S
14GB file 16.52GB
Q3_M
14GB file 16.52GB
Q3_S
14GB file 16.52GB
Q3_XS
14GB file 16.52GB
Q3_XXS
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q4_K_S
18GB file 20.52GB
Q4_NL
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_1
22GB file 24.52GB
Q5_K_M
22GB file 24.52GB
Q5_K_S
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q1_M
32GB file 34.52GB
Q1_S
32GB file 34.52GB
Q8_0
34GB file 36.52GB

Snorkel-Mistral-PairRM-DPO-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q2_K
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

stable-code-3b-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
FP16
6GB file 8.05GB

stablelm-2-zephyr-1_6b-GGUF

6B 8K ctx
Q2_K
1.88GB file 3.98GB
Q3_K_L
2.63GB file 4.73GB
Q3_K_M
2.63GB file 4.73GB
Q3_K_S
2.63GB file 4.73GB
Q4_K_M
3.38GB file 5.48GB
Q4_K_S
3.38GB file 5.48GB
Q5_K_M
4.13GB file 6.23GB
Q5_K_S
4.13GB file 6.23GB
Q6_K
4.88GB file 6.98GB
Q8_0
6.38GB file 8.48GB
FP16
12GB file 14.1GB

stablelm-zephyr-3b-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
FP16
6GB file 8.05GB

Starlette-1-3B-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q2_K_S
0.94GB file 2.99GB
Q2_M
0.94GB file 2.99GB
Q2_S
0.94GB file 2.99GB
Q2_XS
0.94GB file 2.99GB
Q2_XXS
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q3_M
1.31GB file 3.36GB
Q3_S
1.31GB file 3.36GB
Q3_XS
1.31GB file 3.36GB
Q3_XXS
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q4_NL
1.69GB file 3.74GB
Q4_XS
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_1
2.06GB file 4.11GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q1_M
3GB file 5.05GB
Q1_S
3GB file 5.05GB
Q8_0
3.19GB file 5.24GB

TinyOpenHermes-1.1B-4k-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB
Q3_K_L
0.48GB file 2.5GB
Q3_K_M
0.48GB file 2.5GB
Q3_K_S
0.48GB file 2.5GB
Q4_K_M
0.62GB file 2.64GB
Q4_K_S
0.62GB file 2.64GB
Q5_K_M
0.76GB file 2.78GB
Q5_K_S
0.76GB file 2.78GB
Q6_K
0.89GB file 2.91GB
Q8_0
1.17GB file 3.19GB
FP16
2.2GB file 4.22GB

TopicNeuralHermes-2.5-Mistral-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB

zeta-GGUF

Unknown 8K ctx
Q1_M
0GB file 2GB
Q1_S
0GB file 2GB
Q2_K
0GB file 2GB
Q2_K_S
0GB file 2GB
Q2_M
0GB file 2GB
Q2_S
0GB file 2GB
Q2_XS
0GB file 2GB
Q2_XXS
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_M
0GB file 2GB
Q3_S
0GB file 2GB
Q3_XS
0GB file 2GB
Q3_XXS
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_NL
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB
B

Brocchirodrigo

1 models

anotaai-ajuda-qwen3_5_Q4

0.8B 8K ctx
Q4_0
0.45GB file 2.46GB
FP16
1.6GB file 3.61GB
B

Brokilone

1 models

Qwen3-4B-Thinking-2507-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB