All Supported Models

29681 AI models · 198875 quantization formats tracked

B

Basedcatx

1 models

Qwen2.5-14B-Instruct-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB
B

Basictrain

1 models

Llama-3.2-8X3B-MOE-Dark-Champion-Instruct-uncensored-abliterated-18.4B-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_XS
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
B

Basiphobe

1 models

sci-assistant

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
FP16
14GB file 16.11GB
B

Batiai

19 models

DeepSeek-V4-Flash-GGUF

284B 8K ctx
Q3_K_M
124.25GB file 130.9GB
Q4_K_M
159.75GB file 166.4GB
Q5_K_M
195.25GB file 201.9GB
Q6_K
230.75GB file 237.4GB
Q8_0
301.75GB file 308.4GB

DeepSeek-V4-Pro-GGUF

Unknown 8K ctx
Q3_K_M
0GB file 2GB
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB
Q8_0
0GB file 2GB

Gemma-4-26B-A4B-it-GGUF

26B 8K ctx
Q3_K_M
11.38GB file 13.81GB
Q3_M
11.38GB file 13.81GB
Q4_K_M
14.63GB file 17.06GB
Q4_XS
14.63GB file 17.06GB
Q6_K
21.13GB file 23.56GB
BF16
52GB file 54.43GB

gemma-4-31B-it-GGUF

31B 8K ctx
Q3_M
13.56GB file 16.07GB
Q4_K_M
17.44GB file 19.95GB
Q4_XS
17.44GB file 19.95GB
Q6_K
25.19GB file 27.7GB
BF16
62GB file 64.51GB

gemma-4-E2B-it-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
Q6_K
1.63GB file 3.66GB
BF16
4GB file 6.03GB

gemma-4-E4B-it-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q6_K
3.25GB file 5.32GB
BF16
8GB file 10.07GB

GLM-5.1-GGUF

744B 8K ctx
Q3_XXS
325.5GB file 339.69GB
Q4_XS
418.5GB file 432.69GB

Granite-4.1-8B-GGUF

8B 8K ctx
Q3_K_M
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB

Kimi-K2.6-GGUF

2.6B 8K ctx
Q3_XXS
1.14GB file 3.18GB
Q4_XS
1.46GB file 3.5GB
Q5_K_M
1.79GB file 3.83GB

MiniMax-M2.7-GGUF

229B 8K ctx
Q3_XXS
100.19GB file 105.94GB
Q4_XS
128.81GB file 134.56GB

Mistral-Medium-3.5-128B-GGUF

128B 8K ctx
Q3_XXS
56GB file 60.1GB
Q4_XS
72GB file 76.1GB
Q5_K_M
88GB file 92.1GB

Nemotron-3-Nano-30B-A3B-GGUF

30B 8K ctx
Q3_XXS
13.13GB file 15.62GB
Q4_XS
16.88GB file 19.37GB
Q5_K_M
20.63GB file 23.12GB

Nemotron-3-Nano-Omni-30B-Text-Only-GGUF

30B 8K ctx
Q3_XXS
13.13GB file 15.62GB
Q4_XS
16.88GB file 19.37GB
Q5_K_M
20.63GB file 23.12GB

Nemotron-3-Super-120B-A12B-GGUF

120B 8K ctx
Q3_XXS
52.5GB file 56.47GB
Q4_XS
67.5GB file 71.47GB

Qwen3.5-27B-GGUF

27B 8K ctx
Q4_XS
15.19GB file 17.63GB

Qwen3.5-35B-A3B-GGUF

35B 8K ctx
Q4_XS
19.69GB file 22.26GB

Qwen3.5-9B-GGUF

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
Q6_K
7.31GB file 9.46GB

Qwen3.6-27B-GGUF

27B 8K ctx
Q3_K_M
11.81GB file 14.25GB
Q3_XXS
11.81GB file 14.25GB
Q4_K_M
15.19GB file 17.63GB
Q4_XS
15.19GB file 17.63GB
Q6_K
21.94GB file 24.38GB
BF16
54GB file 56.44GB

Qwen3.6-35B-A3B-GGUF

35B 8K ctx
Q3_XXS
15.31GB file 17.88GB
Q4_K_M
19.69GB file 22.26GB
Q4_XS
19.69GB file 22.26GB
Q5_K_M
24.06GB file 26.63GB
Q6_K
28.44GB file 31.01GB
Q8_0
37.19GB file 39.76GB
BF16
70GB file 72.57GB
B

Bayanatawneh

1 models

sqlcoder-7b-2-copy

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB
B

Bazsalanszky

1 models

Mistral-7b-0.1-alpaca-hun-gemini

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
B

Bbennett17

1 models

Llama-3.1-8B-Instruct-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB
B

Bchen Snp

4 models

granite-3.2-8b-instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Phi-4-mini-instruct-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

phi-4-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen2.5-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
B

Bcse

3 models

Athena-120b-GGUF

120B 8K ctx
Q2_K
37.5GB file 41.47GB
Q3_K_XS
52.5GB file 56.47GB

BigLiz-120b-GGUF

120B 8K ctx
Q2_K
37.5GB file 41.47GB
Q3_K_XS
52.5GB file 56.47GB

Xwinter-120b-GGUF

120B 8K ctx
Q2_K
37.5GB file 41.47GB
Q3_K_XS
52.5GB file 56.47GB
B

Bdesnos

1 models

Qwen3-14B-Q6_K-GGUF

14B 8K ctx
Q6_0
11.38GB file 13.61GB
FP16
28GB file 30.23GB