All Supported Models

29681 AI models · 198875 quantization formats tracked

E

E N O S Y S

3 models

GigaChat3.1-10B-A1.8B-750-v1-GGUF

10B 8K ctx
FP16
20GB file 22.16GB

GLM-4.7-Flash-Uncensored-750-v1-GGUF

1B 8K ctx
FP16
2GB file 4.02GB

Kimi-Linear-48B-A3B-Instruct-abliterated-1000-v1-GGUF

48B 8K ctx
FP16
96GB file 98.79GB
E

E Palmisano

1 models

llama-3-sqlcoder-8b-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
E

E R E N121232

2 models

FINSTROM-AI-V1.5

Unknown 8K ctx
FP16
0GB file 2GB

MAJESTIC-FIN-R1-gguf

2.6B 8K ctx
Q8_0
2.76GB file 4.8GB
E

E Valente

1 models

Llama-2-7B-Chat-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
E

E Z P K

2 models

Claire-Mistral-7B-0.1-Q4_K_M-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

guillaumetell-7b-Q4_K_M-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
E

E2Jhiubyiiyvw

6 models

gemma-2-9b-it-Q5_K_M-GGUF

9B 8K ctx
Q5_0
6.19GB file 8.34GB
FP16
18GB file 20.15GB

Meta-Llama-3-8B-Instruct-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

Mistral-7B-Instruct-v0.2-Q5_K_M-GGUF

7B 8K ctx
Q5_K_M
4.81GB file 6.92GB

Phi-3-medium-128k-instruct-Q5_K_M-GGUF

3.8B 8K ctx
Q5_K_M
2.61GB file 4.67GB

Qwen2-7B-Instruct-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB
E

Eaddario

28 models

DeepSeek-R1-Distill-Llama-8B-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_S
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

DeepSeek-R1-Distill-Qwen-7B-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Devstral-Small-2505-GGUF

2505B 8K ctx
Q3_K_L
1095.94GB file 1138.98GB
Q3_K_M
1095.94GB file 1138.98GB
Q3_K_S
1095.94GB file 1138.98GB
Q3_M
1095.94GB file 1138.98GB
Q3_S
1095.94GB file 1138.98GB
Q4_K_M
1409.06GB file 1452.1GB
Q4_K_S
1409.06GB file 1452.1GB
Q4_NL
1409.06GB file 1452.1GB
Q5_K_M
1722.19GB file 1765.23GB
Q5_K_S
1722.19GB file 1765.23GB
Q6_K
2035.31GB file 2078.35GB
Q8_0
2661.56GB file 2704.6GB

Devstral-Small-2505-pruned-GGUF

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_M
0GB file 2GB
Q3_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_NL
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

Dolphin-Mistral-24B-Venice-Edition-GGUF

24B 8K ctx
Q3_K_L
10.5GB file 12.89GB
Q3_K_M
10.5GB file 12.89GB
Q3_K_S
10.5GB file 12.89GB
Q3_M
10.5GB file 12.89GB
Q3_S
10.5GB file 12.89GB
Q4_K_M
13.5GB file 15.89GB
Q4_K_S
13.5GB file 15.89GB
Q4_NL
13.5GB file 15.89GB
Q5_K_M
16.5GB file 18.89GB
Q5_K_S
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB

Dolphin-Mistral-24B-Venice-Edition-pruned-GGUF

24B 8K ctx
Q3_K_L
10.5GB file 12.89GB
Q3_K_M
10.5GB file 12.89GB
Q3_K_S
10.5GB file 12.89GB
Q3_M
10.5GB file 12.89GB
Q3_S
10.5GB file 12.89GB
Q4_K_M
13.5GB file 15.89GB
Q4_K_S
13.5GB file 15.89GB
Q4_NL
13.5GB file 15.89GB
Q5_K_M
16.5GB file 18.89GB
Q5_K_S
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB

Dolphin3.0-Mistral-24B-GGUF

24B 8K ctx
Q3_K_L
10.5GB file 12.89GB
Q3_K_M
10.5GB file 12.89GB
Q3_K_S
10.5GB file 12.89GB
Q3_M
10.5GB file 12.89GB
Q3_S
10.5GB file 12.89GB
Q4_K_M
13.5GB file 15.89GB
Q4_K_S
13.5GB file 15.89GB
Q4_NL
13.5GB file 15.89GB
Q5_K_M
16.5GB file 18.89GB
Q5_K_S
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB

Dolphin3.0-R1-Mistral-24B-GGUF

24B 8K ctx
Q3_K_L
10.5GB file 12.89GB
Q3_K_M
10.5GB file 12.89GB
Q3_K_S
10.5GB file 12.89GB
Q3_M
10.5GB file 12.89GB
Q3_S
10.5GB file 12.89GB
Q4_K_M
13.5GB file 15.89GB
Q4_K_S
13.5GB file 15.89GB
Q4_NL
13.5GB file 15.89GB
Q5_K_M
16.5GB file 18.89GB
Q5_K_S
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB

gemma-3-12b-it-GGUF

12B 8K ctx
Q3_K_L
5.25GB file 7.45GB
Q3_K_M
5.25GB file 7.45GB
Q3_K_S
5.25GB file 7.45GB
Q3_M
5.25GB file 7.45GB
Q3_S
5.25GB file 7.45GB
Q4_K_M
6.75GB file 8.95GB
Q4_K_S
6.75GB file 8.95GB
Q4_NL
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q5_K_S
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

gemma-3-12b-it-pruned-GGUF

12B 8K ctx
Q3_K_L
5.25GB file 7.45GB
Q3_K_M
5.25GB file 7.45GB
Q3_K_S
5.25GB file 7.45GB
Q3_M
5.25GB file 7.45GB
Q3_S
5.25GB file 7.45GB
Q4_K_M
6.75GB file 8.95GB
Q4_K_S
6.75GB file 8.95GB
Q4_NL
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q5_K_S
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

granite-4.1-30b-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q3_K
13.13GB file 15.62GB
Q4_K
16.88GB file 19.37GB
Q5_K
20.63GB file 23.12GB
Q6_K
24.38GB file 26.87GB
Q1_L
30GB file 32.49GB
Q7_K
30GB file 32.49GB
Q8_0
31.88GB file 34.37GB

granite-4.1-8b-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K
3.5GB file 5.63GB
Q4_K
4.5GB file 6.63GB
Q5_K
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q1_L
8GB file 10.13GB
Q7_K
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB

Hammer2.1-7b-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Llama-Guard-3-8B-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_S
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-xLAM-2-8b-fc-r-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_S
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Ministral-3-14B-Instruct-2512-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q2_S
4.38GB file 6.61GB
Q2_XS
4.38GB file 6.61GB
Q2_XXS
4.38GB file 6.61GB
Q3_K
6.13GB file 8.36GB
Q3_K_L
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q3_XXS
6.13GB file 8.36GB
Q4_K
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q5_K
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q1_L
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB

Ministral-3-14B-Reasoning-2512-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q2_S
4.38GB file 6.61GB
Q2_XS
4.38GB file 6.61GB
Q2_XXS
4.38GB file 6.61GB
Q3_K
6.13GB file 8.36GB
Q3_K_L
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q3_XXS
6.13GB file 8.36GB
Q4_K
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q5_K
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q1_L
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB

Mistral-Small-3.2-24B-Instruct-2506-GGUF

24B 8K ctx
Q3_K_L
10.5GB file 12.89GB
Q3_K_M
10.5GB file 12.89GB
Q3_K_S
10.5GB file 12.89GB
Q3_M
10.5GB file 12.89GB
Q3_S
10.5GB file 12.89GB
Q4_K_M
13.5GB file 15.89GB
Q4_K_S
13.5GB file 15.89GB
Q4_NL
13.5GB file 15.89GB
Q5_K_M
16.5GB file 18.89GB
Q5_K_S
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB

Mistral-Small-3.2-24B-Instruct-2506-pruned-GGUF

24B 8K ctx
Q3_K_L
10.5GB file 12.89GB
Q3_K_M
10.5GB file 12.89GB
Q3_K_S
10.5GB file 12.89GB
Q3_M
10.5GB file 12.89GB
Q3_S
10.5GB file 12.89GB
Q4_K_M
13.5GB file 15.89GB
Q4_K_S
13.5GB file 15.89GB
Q4_NL
13.5GB file 15.89GB
Q5_K_M
16.5GB file 18.89GB
Q5_K_S
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB

OLMo-2-1124-7B-Instruct-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Olmo-3-7B-Instruct-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_L
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB

Olmo-3-7B-Think-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_S
2.19GB file 4.3GB
Q2_XS
2.19GB file 4.3GB
Q2_XXS
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_L
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB

Qwen3-30B-A3B-GGUF

30B 8K ctx
Q3_K_L
13.13GB file 15.62GB
Q3_K_M
13.13GB file 15.62GB
Q3_K_S
13.13GB file 15.62GB
Q3_M
13.13GB file 15.62GB
Q3_S
13.13GB file 15.62GB
Q4_K_M
16.88GB file 19.37GB
Q4_K_S
16.88GB file 19.37GB
Q4_NL
16.88GB file 19.37GB
Q5_K_M
20.63GB file 23.12GB
Q5_K_S
20.63GB file 23.12GB
Q6_K
24.38GB file 26.87GB
Q8_0
31.88GB file 34.37GB

Qwen3-30B-A3B-pruned-GGUF

30B 8K ctx
Q3_K_L
13.13GB file 15.62GB
Q3_K_M
13.13GB file 15.62GB
Q3_K_S
13.13GB file 15.62GB
Q3_M
13.13GB file 15.62GB
Q3_S
13.13GB file 15.62GB
Q4_K_M
16.88GB file 19.37GB
Q4_K_S
16.88GB file 19.37GB
Q4_NL
16.88GB file 19.37GB
Q5_K_M
20.63GB file 23.12GB
Q5_K_S
20.63GB file 23.12GB
Q6_K
24.38GB file 26.87GB
Q8_0
31.88GB file 34.37GB

Qwen3-8B-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_S
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Qwen3.5-4B-GGUF

4B 8K ctx
Q2_M
1.25GB file 3.32GB
Q3_K
1.75GB file 3.82GB
Q4_K
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q5_K
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q1_M
4GB file 6.07GB
Q8_0
4.25GB file 6.32GB

Qwen3.5-9B-GGUF

9B 8K ctx
Q2_M
2.81GB file 4.96GB
Q3_K
3.94GB file 6.09GB
Q4_K
5.06GB file 7.21GB
Q4_K_M
5.06GB file 7.21GB
Q5_K
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q1_M
9GB file 11.15GB
Q8_0
9.56GB file 11.71GB

Watt-Tool-8B-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_S
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
E

Eadx

1 models

gemma-4-E4B-it-OBLITERATED

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q8_0
4.25GB file 6.32GB
E

Eagalon

1 models

Qwen2.5-14B-Instruct-1M-Q5_K_M-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB
E

Eamiller34

1 models

Qwen2.5-Coder-7B-Swift-Lm

7B 8K ctx
FP16
14GB file 16.11GB