All Supported Models

29681 AI models · 198875 quantization formats tracked

W

Worstplayer

2 models

gemma-3-27b-it-heretic-v2-GGUF

27B 8K ctx
Q3_M
11.81GB file 14.25GB
Q3_XS
11.81GB file 14.25GB
Q4_XS
15.19GB file 17.63GB

Qwen3-14B-sk-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q2_K
4.38GB file 6.61GB
Q2_M
4.38GB file 6.61GB
Q2_S
4.38GB file 6.61GB
Q2_XS
4.38GB file 6.61GB
Q2_XXS
4.38GB file 6.61GB
Q3_K_L
6.13GB file 8.36GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q3_M
6.13GB file 8.36GB
Q3_S
6.13GB file 8.36GB
Q3_XS
6.13GB file 8.36GB
Q3_XXS
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q4_NL
7.88GB file 10.11GB
Q4_XS
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q5_1
9.63GB file 11.86GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q1_0
14GB file 16.23GB
Q1_M
14GB file 16.23GB
Q1_S
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB
W

Worthdoing

13 models

DeepSeek-R1-Distill-Qwen-7B-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Mistral-7B-Instruct-v0.3-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Mixtral-8x7B-Instruct-v0.1-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB

Phi-3.5-mini-instruct-GGUF

3.8B 8K ctx
Q3_K_M
1.66GB file 3.72GB
Q4_K_M
2.14GB file 4.2GB
Q4_K_S
2.14GB file 4.2GB
Q5_K_M
2.61GB file 4.67GB
Q5_K_S
2.61GB file 4.67GB
Q8_0
4.04GB file 6.1GB

Phi-4-mini-GGUF

14B 8K ctx
Q3_K_M
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Qwen2.5-14B-Instruct-GGUF

14B 8K ctx
Q3_K_M
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q8_0
14.88GB file 17.11GB

Qwen2.5-3B-Instruct-GGUF

3B 8K ctx
Q3_K_M
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Qwen2.5-7B-Instruct-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Qwen2.5-Coder-7B-Instruct-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Qwen3.6-35B-A3B-GGUF

35B 8K ctx
Q3_K_M
15.31GB file 17.88GB
Q4_K_M
19.69GB file 22.26GB
Q4_K_S
19.69GB file 22.26GB
Q5_K_M
24.06GB file 26.63GB
Q5_K_S
24.06GB file 26.63GB
Q8_0
37.19GB file 39.76GB

SmolLM2-1.7B-Instruct-GGUF

1.7B 8K ctx
Q3_K_M
0.74GB file 2.77GB
Q4_K_M
0.96GB file 2.99GB
Q4_K_S
0.96GB file 2.99GB
Q5_K_M
1.17GB file 3.2GB
Q5_K_S
1.17GB file 3.2GB
Q6_K
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB

Stablelm-2-Zephyr-1.6B-GGUF

6B 8K ctx
Q3_K_M
2.63GB file 4.73GB
Q4_K_M
3.38GB file 5.48GB
Q4_K_S
3.38GB file 5.48GB
Q5_K_M
4.13GB file 6.23GB
Q5_K_S
4.13GB file 6.23GB
Q8_0
6.38GB file 8.48GB

TinyLlama-1.1B-Chat-v1.0-GGUF

1.1B 8K ctx
Q4_K_M
0.62GB file 2.64GB
Q5_K_M
0.76GB file 2.78GB
Q8_0
1.17GB file 3.19GB
W

Wowbager

1 models

granite-cermat-cz-7b

7B 8K ctx
FP16
14GB file 16.11GB
W

Woziii

1 models

llama-3-8b-chat-me

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
W

Wp Airik

3 models

gemma-3-1b-it-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

gemma-3-270m-it-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

gemma-3-270m-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
W

Wqerrewetw

5 models

DistilQwen2.5-7B-Instruct-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

ERNIE-4.5-0.3B-PT-GGUF

0.3B 8K ctx
FP16
0.6GB file 2.6GB

gemma-3-4b-novision-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

txgemma-9b-chat-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

txgemma-9b-predict-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB
W

Wsxiaoys

1 models

starcoderbase-1b-Q2_K-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
FP16
2GB file 4.02GB
W

Wuav

1 models

Jinx-gpt-oss-20b-Q4_K_M-GGUF

20B 8K ctx
Q4_0
11.25GB file 13.58GB
FP16
40GB file 42.33GB
W

Wuminxuan

1 models

Qwen2.5-7B-Instruct-Finance

7B 8K ctx
Q8_0
7.44GB file 9.55GB
W

Wushuxingji

1 models

Qwen2.5-14B-Instruct-1M-abliterated-Q6_K-GGUF

14B 8K ctx
Q6_0
11.38GB file 13.61GB
FP16
28GB file 30.23GB