All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Alamios

9 models

ALIA-40b-instruct-2512-Q4_K_M-GGUF

40B 8K ctx
Q4_0
22.5GB file 25.16GB
FP16
80GB file 82.66GB

ALIA-40b-instruct-2601-Q4_K_M-GGUF

40B 8K ctx
Q4_0
22.5GB file 25.16GB
FP16
80GB file 82.66GB

DeepSeek-R1-DRAFT-Qwen2.5-0.5B-GGUF

0.5B 8K ctx
Q4_K_M
0.28GB file 2.29GB
Q8_0
0.53GB file 2.54GB

DeepSeek-R1-DRAFT-Qwen2.5-Coder-0.5B-GGUF

0.5B 8K ctx
Q4_K_M
0.28GB file 2.29GB
Q8_0
0.53GB file 2.54GB

gemma-2-9b-it-GGUF-f16

9B 8K ctx
FP16
18GB file 20.15GB

Meta-Llama-3.1-8B-Instruct-GGUF-f16

8B 8K ctx
FP16
16GB file 18.13GB

Mistral-Small-3.1-DRAFT-0.5B-GGUF

0.5B 8K ctx
Q4_K_M
0.28GB file 2.29GB
Q5_K_M
0.34GB file 2.35GB
Q6_K
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB

QwQ-32B-DRAFT-0.5B-GGUF

0.5B 8K ctx
Q4_K_M
0.28GB file 2.29GB

salamandra-7b-instruct-GGUF-f16

7B 8K ctx
FP16
14GB file 16.11GB
A

Alan Strife

1 models

Phi-3-mini-4k-instruct-gguf

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB
A

Alan1113

1 models

Qwen3-4B-Instruct-2507-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB
A

Alan314159

1 models

Llama-3.2-1B-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB
A

Alaninfant

1 models

OrpoLlama-2-7B

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
A

Alanrios2001

2 models

Meta-Llama-3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Phi-3-mini-4k-instruct-Q5_K_M-GGUF

3.8B 8K ctx
Q5_0
2.61GB file 4.67GB
FP16
7.6GB file 9.66GB
A

Albertodelazzari

1 models

Mistral-7B-Instruct-v0.2-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
A

Albertosg112

1 models

Jarvis_Prime_S3_1000_Turbo-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB
A

Albinab

1 models

Qwen-0.5B-Coder-El-Terminalo

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB
FP16
1GB file 3.01GB
A

Alcoft

43 models

Chocolatine-2-14B-Instruct-v2.0b3-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_L
6.13GB file 8.36GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

DeepSeek-R1-Distill-Qwen-1.5B-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_L
0.66GB file 2.68GB
Q3_K_M
0.66GB file 2.68GB
Q3_K_S
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q4_K_S
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q5_K_S
1.03GB file 3.05GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB
BF16
3GB file 5.02GB

dnotitia_Smoothie-Qwen3-0.6B-GGUF

0.6B 8K ctx
Q2_K
0.19GB file 2.2GB
Q2_K_L
0.19GB file 2.2GB
Q2_K_XL
0.19GB file 2.2GB
Q2_K_XS
0.19GB file 2.2GB
Q2_K_XXS
0.19GB file 2.2GB
Q3_K_L
0.26GB file 2.27GB
Q3_K_M
0.26GB file 2.27GB
Q3_K_S
0.26GB file 2.27GB
Q3_K_XL
0.26GB file 2.27GB
Q3_K_XS
0.26GB file 2.27GB
Q3_K_XXL
0.26GB file 2.27GB
Q3_K_XXS
0.26GB file 2.27GB
Q4_K_L
0.34GB file 2.35GB
Q4_K_M
0.34GB file 2.35GB
Q4_K_S
0.34GB file 2.35GB
Q4_K_XL
0.34GB file 2.35GB
Q4_K_XS
0.34GB file 2.35GB
Q5_K_L
0.41GB file 2.42GB
Q5_K_M
0.41GB file 2.42GB
Q5_K_S
0.41GB file 2.42GB
Q5_K_XL
0.41GB file 2.42GB
Q5_K_XS
0.41GB file 2.42GB
Q5_K_XXS
0.41GB file 2.42GB
Q6_K
0.49GB file 2.5GB
Q6_K_L
0.49GB file 2.5GB
Q6_K_S
0.49GB file 2.5GB
Q6_K_XL
0.49GB file 2.5GB
Q8_0
0.64GB file 2.65GB
Q8_K_S
0.64GB file 2.65GB
Q8_K_XL
0.64GB file 2.65GB
Q8_K_XS
0.64GB file 2.65GB

dnotitia_Smoothie-Qwen3-1.7B-GGUF

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q2_K_L
0.53GB file 2.56GB
Q2_K_XL
0.53GB file 2.56GB
Q2_K_XS
0.53GB file 2.56GB
Q2_K_XXS
0.53GB file 2.56GB
Q3_K_L
0.74GB file 2.77GB
Q3_K_M
0.74GB file 2.77GB
Q3_K_S
0.74GB file 2.77GB
Q3_K_XL
0.74GB file 2.77GB
Q3_K_XS
0.74GB file 2.77GB
Q3_K_XXL
0.74GB file 2.77GB
Q3_K_XXS
0.74GB file 2.77GB
Q4_K_L
0.96GB file 2.99GB
Q4_K_M
0.96GB file 2.99GB
Q4_K_S
0.96GB file 2.99GB
Q4_K_XL
0.96GB file 2.99GB
Q4_K_XS
0.96GB file 2.99GB
Q5_K_L
1.17GB file 3.2GB
Q5_K_M
1.17GB file 3.2GB
Q5_K_S
1.17GB file 3.2GB
Q5_K_XL
1.17GB file 3.2GB
Q5_K_XS
1.17GB file 3.2GB
Q5_K_XXS
1.17GB file 3.2GB
Q6_K
1.38GB file 3.41GB
Q6_K_L
1.38GB file 3.41GB
Q6_K_S
1.38GB file 3.41GB
Q6_K_XL
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB
Q8_K_S
1.81GB file 3.84GB
Q8_K_XL
1.81GB file 3.84GB
Q8_K_XS
1.81GB file 3.84GB

dnotitia_Smoothie-Qwen3-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q2_K_L
4.38GB file 6.61GB
Q2_K_XL
4.38GB file 6.61GB
Q2_K_XS
4.38GB file 6.61GB
Q2_K_XXS
4.38GB file 6.61GB
Q3_K_L
6.13GB file 8.36GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q3_K_XL
6.13GB file 8.36GB
Q3_K_XS
6.13GB file 8.36GB
Q3_K_XXL
6.13GB file 8.36GB
Q3_K_XXS
6.13GB file 8.36GB
Q4_K_L
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q4_K_XL
7.88GB file 10.11GB
Q4_K_XS
7.88GB file 10.11GB
Q5_K_L
9.63GB file 11.86GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q5_K_XL
9.63GB file 11.86GB
Q5_K_XS
9.63GB file 11.86GB
Q5_K_XXS
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q6_K_L
11.38GB file 13.61GB
Q6_K_S
11.38GB file 13.61GB
Q6_K_XL
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB
Q8_K_S
14.88GB file 17.11GB
Q8_K_XL
14.88GB file 17.11GB
Q8_K_XS
14.88GB file 17.11GB

dnotitia_Smoothie-Qwen3-4B-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q2_K_L
1.25GB file 3.32GB
Q2_K_XL
1.25GB file 3.32GB
Q2_K_XS
1.25GB file 3.32GB
Q2_K_XXS
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q3_K_XL
1.75GB file 3.82GB
Q3_K_XS
1.75GB file 3.82GB
Q3_K_XXL
1.75GB file 3.82GB
Q3_K_XXS
1.75GB file 3.82GB
Q4_K_L
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_K_XL
2.25GB file 4.32GB
Q4_K_XS
2.25GB file 4.32GB
Q5_K_L
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q5_K_XL
2.75GB file 4.82GB
Q5_K_XS
2.75GB file 4.82GB
Q5_K_XXS
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q6_K_L
3.25GB file 5.32GB
Q6_K_S
3.25GB file 5.32GB
Q6_K_XL
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
Q8_K_S
4.25GB file 6.32GB
Q8_K_XL
4.25GB file 6.32GB
Q8_K_XS
4.25GB file 6.32GB

gpt2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

gpt2-large-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q2_K
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

gpt2-medium-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q2_K
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

gpt2-xl-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q2_K
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

granite-3.1-1b-a400m-instruct-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_L
0.44GB file 2.46GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_S
0.44GB file 2.46GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

granite-3.1-2b-instruct-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
BF16
4GB file 6.03GB

granite-3.1-3b-a800m-instruct-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

granite-3.1-8b-instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Homer-v1.0-Qwen2.5-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

HuggingFaceTB_SmolLM3-3B-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q2_K_L
0.94GB file 2.99GB
Q2_K_XL
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q3_K_XL
1.31GB file 3.36GB
Q3_K_XXL
1.31GB file 3.36GB
Q4_K_L
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q4_K_XL
1.69GB file 3.74GB
Q5_K_L
2.06GB file 4.11GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q5_K_XL
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q6_K_L
2.44GB file 4.49GB
Q6_K_XL
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Marco-o1-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_L
0.44GB file 2.46GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_S
0.44GB file 2.46GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

Phi-3.5-mini-instruct-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB
Q3_K_L
1.66GB file 3.72GB
Q3_K_M
1.66GB file 3.72GB
Q3_K_S
1.66GB file 3.72GB
Q4_K_M
2.14GB file 4.2GB
Q4_K_S
2.14GB file 4.2GB
Q5_K_M
2.61GB file 4.67GB
Q5_K_S
2.61GB file 4.67GB
Q6_K
3.09GB file 5.15GB
Q8_0
4.04GB file 6.1GB
BF16
7.6GB file 9.66GB

Qwen_Qwen3-0.6B-GGUF

0.6B 8K ctx
Q2_K
0.19GB file 2.2GB
Q2_K_L
0.19GB file 2.2GB
Q2_K_XL
0.19GB file 2.2GB
Q3_K_L
0.26GB file 2.27GB
Q3_K_M
0.26GB file 2.27GB
Q3_K_S
0.26GB file 2.27GB
Q3_K_XL
0.26GB file 2.27GB
Q3_K_XXL
0.26GB file 2.27GB
Q4_K_L
0.34GB file 2.35GB
Q4_K_M
0.34GB file 2.35GB
Q4_K_S
0.34GB file 2.35GB
Q4_K_XL
0.34GB file 2.35GB
Q5_K_L
0.41GB file 2.42GB
Q5_K_M
0.41GB file 2.42GB
Q5_K_S
0.41GB file 2.42GB
Q5_K_XL
0.41GB file 2.42GB
Q6_K
0.49GB file 2.5GB
Q6_K_L
0.49GB file 2.5GB
Q6_K_XL
0.49GB file 2.5GB
Q8_0
0.64GB file 2.65GB
Q8_K_XL
0.64GB file 2.65GB

Qwen_Qwen3-1.7B-GGUF

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q2_K_L
0.53GB file 2.56GB
Q2_K_XL
0.53GB file 2.56GB
Q3_K_L
0.74GB file 2.77GB
Q3_K_M
0.74GB file 2.77GB
Q3_K_S
0.74GB file 2.77GB
Q3_K_XL
0.74GB file 2.77GB
Q3_K_XXL
0.74GB file 2.77GB
Q4_K_L
0.96GB file 2.99GB
Q4_K_M
0.96GB file 2.99GB
Q4_K_S
0.96GB file 2.99GB
Q4_K_XL
0.96GB file 2.99GB
Q5_K_L
1.17GB file 3.2GB
Q5_K_M
1.17GB file 3.2GB
Q5_K_S
1.17GB file 3.2GB
Q5_K_XL
1.17GB file 3.2GB
Q6_K
1.38GB file 3.41GB
Q6_K_L
1.38GB file 3.41GB
Q6_K_XL
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB
Q8_K_XL
1.81GB file 3.84GB

Qwen_Qwen3-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q2_K_L
4.38GB file 6.61GB
Q2_K_XL
4.38GB file 6.61GB
Q3_K_L
6.13GB file 8.36GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q3_K_XL
6.13GB file 8.36GB
Q3_K_XXL
6.13GB file 8.36GB
Q4_K_L
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q4_K_XL
7.88GB file 10.11GB
Q5_K_L
9.63GB file 11.86GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q5_K_XL
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q6_K_L
11.38GB file 13.61GB
Q6_K_XL
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB
Q8_K_XL
14.88GB file 17.11GB

Qwen_Qwen3-4B-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q2_K_L
1.25GB file 3.32GB
Q2_K_XL
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q3_K_XL
1.75GB file 3.82GB
Q3_K_XXL
1.75GB file 3.82GB
Q4_K_L
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_K_XL
2.25GB file 4.32GB
Q5_K_L
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q5_K_XL
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q6_K_L
3.25GB file 5.32GB
Q6_K_XL
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
Q8_K_XL
4.25GB file 6.32GB

Qwen_Qwen3-4B-Instruct-2507-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q2_K_L
1.25GB file 3.32GB
Q2_K_XL
1.25GB file 3.32GB
Q2_K_XS
1.25GB file 3.32GB
Q2_K_XXS
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q3_K_XL
1.75GB file 3.82GB
Q3_K_XS
1.75GB file 3.82GB
Q3_K_XXL
1.75GB file 3.82GB
Q3_K_XXS
1.75GB file 3.82GB
Q4_K_L
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_K_XL
2.25GB file 4.32GB
Q4_K_XS
2.25GB file 4.32GB
Q5_K_L
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q5_K_XL
2.75GB file 4.82GB
Q5_K_XS
2.75GB file 4.82GB
Q5_K_XXS
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q6_K_L
3.25GB file 5.32GB
Q6_K_S
3.25GB file 5.32GB
Q6_K_XL
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
Q8_K_S
4.25GB file 6.32GB
Q8_K_XL
4.25GB file 6.32GB
Q8_K_XS
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Qwen_Qwen3-4B-Thinking-2507-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q2_K_L
1.25GB file 3.32GB
Q2_K_XL
1.25GB file 3.32GB
Q2_K_XS
1.25GB file 3.32GB
Q2_K_XXS
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q3_K_XL
1.75GB file 3.82GB
Q3_K_XS
1.75GB file 3.82GB
Q3_K_XXL
1.75GB file 3.82GB
Q3_K_XXS
1.75GB file 3.82GB
Q4_K_L
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_K_XL
2.25GB file 4.32GB
Q4_K_XS
2.25GB file 4.32GB
Q5_K_L
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q5_K_XL
2.75GB file 4.82GB
Q5_K_XS
2.75GB file 4.82GB
Q5_K_XXS
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q6_K_L
3.25GB file 5.32GB
Q6_K_S
3.25GB file 5.32GB
Q6_K_XL
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
Q8_K_S
4.25GB file 6.32GB
Q8_K_XL
4.25GB file 6.32GB
Q8_K_XS
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Qwen2.5-0.5B-Instruct-GGUF

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB
Q3_K_L
0.22GB file 2.23GB
Q3_K_M
0.22GB file 2.23GB
Q3_K_S
0.22GB file 2.23GB
Q4_K_M
0.28GB file 2.29GB
Q4_K_S
0.28GB file 2.29GB
Q5_K_M
0.34GB file 2.35GB
Q5_K_S
0.34GB file 2.35GB
Q6_K
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB

Qwen2.5-0.5B-Open-R1-Distill-GGUF

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB
Q3_K_L
0.22GB file 2.23GB
Q3_K_M
0.22GB file 2.23GB
Q3_K_S
0.22GB file 2.23GB
Q4_K_M
0.28GB file 2.29GB
Q4_K_S
0.28GB file 2.29GB
Q5_K_M
0.34GB file 2.35GB
Q5_K_S
0.34GB file 2.35GB
Q6_K
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB
BF16
1GB file 3.01GB

Qwen2.5-1.5B-Instruct-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_L
0.66GB file 2.68GB
Q3_K_M
0.66GB file 2.68GB
Q3_K_S
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q4_K_S
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q5_K_S
1.03GB file 3.05GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

Qwen2.5-14B-Instruct-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_L
6.13GB file 8.36GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Qwen2.5-7B-Instruct-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Qwen2.5-Coder-0.5B-Instruct-GGUF

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB
Q3_K_L
0.22GB file 2.23GB
Q3_K_M
0.22GB file 2.23GB
Q3_K_S
0.22GB file 2.23GB
Q4_K_M
0.28GB file 2.29GB
Q4_K_S
0.28GB file 2.29GB
Q5_K_M
0.34GB file 2.35GB
Q5_K_S
0.34GB file 2.35GB
Q6_K
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB

Qwen2.5-Coder-1.5B-Instruct-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_L
0.66GB file 2.68GB
Q3_K_M
0.66GB file 2.68GB
Q3_K_S
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q4_K_S
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q5_K_S
1.03GB file 3.05GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

Qwen2.5-Coder-14B-Instruct-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_L
6.13GB file 8.36GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q4_K_S
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Qwen2.5-Coder-7B-Instruct-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

Qwen3-0.6B-GGUF

0.6B 8K ctx
Q2_K
0.19GB file 2.2GB
Q3_K_L
0.26GB file 2.27GB
Q3_K_M
0.26GB file 2.27GB
Q3_K_S
0.26GB file 2.27GB
Q4_K_M
0.34GB file 2.35GB
Q4_K_S
0.34GB file 2.35GB
Q5_K_M
0.41GB file 2.42GB
Q5_K_S
0.41GB file 2.42GB
Q6_K
0.49GB file 2.5GB
Q8_0
0.64GB file 2.65GB
BF16
1.2GB file 3.21GB

Qwen3-1.7B-GGUF

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q3_K_L
0.74GB file 2.77GB
Q3_K_M
0.74GB file 2.77GB
Q3_K_S
0.74GB file 2.77GB
Q4_K_M
0.96GB file 2.99GB
Q4_K_S
0.96GB file 2.99GB
Q5_K_M
1.17GB file 3.2GB
Q5_K_S
1.17GB file 3.2GB
Q6_K
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB
BF16
3.4GB file 5.43GB

Qwen3-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_L
6.13GB file 8.36GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Qwen3-4B-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Qwen3-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

SauerkrautLM-v2-14b-DPO-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_L
6.13GB file 8.36GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

SmolLM2-1.7B-Instruct-GGUF

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q3_K_L
0.74GB file 2.77GB
Q3_K_M
0.74GB file 2.77GB
Q3_K_S
0.74GB file 2.77GB
Q4_K_M
0.96GB file 2.99GB
Q4_K_S
0.96GB file 2.99GB
Q5_K_M
1.17GB file 3.2GB
Q5_K_S
1.17GB file 3.2GB
Q6_K
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB
BF16
3.4GB file 5.43GB

SmolLM2-135M-Instruct-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q2_K
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

SmolLM2-360M-Instruct-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q2_K
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

soob3123_amoral-qwen3-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q2_K_L
4.38GB file 6.61GB
Q2_K_XL
4.38GB file 6.61GB
Q3_K_L
6.13GB file 8.36GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q3_K_XL
6.13GB file 8.36GB
Q3_K_XXL
6.13GB file 8.36GB
Q4_K_L
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q4_K_XL
7.88GB file 10.11GB
Q5_K_L
9.63GB file 11.86GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q5_K_XL
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q6_K_L
11.38GB file 13.61GB
Q6_K_XL
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB
Q8_K_XL
14.88GB file 17.11GB