All Supported Models

29681 AI models · 198875 quantization formats tracked

B

Bob Hugg

1 models

Qwen3-Coder-30B-A3B-Instruct-AWQ-Q4_K_M-GGUF

30B 8K ctx
Q4_0
16.88GB file 19.37GB
FP16
60GB file 62.49GB
B

Bobbaravi

1 models

autotrain-m8r4e-yg4om-F16-GGUF

16B 8K ctx
FP16
32GB file 34.26GB
B

Bobchenyx

9 models

DeepSeek-R1-0528-MLA-GGUF

671B 8K ctx
Q2_K
209.69GB file 222.68GB
Q4_K_M
377.44GB file 390.43GB

DeepSeek-V3-0324-508B-A32B-MLA-GGUF

508B 8K ctx
Q1_S
508GB file 518.32GB

DeepSeek-V3-0324-MLA-GGUF

236B 8K ctx
Q2_K
73.75GB file 79.62GB
Q4_K_M
132.75GB file 138.62GB
Q1_S
236GB file 241.87GB
Q1_M
236GB file 241.87GB

DeepSeek-V3-0324-MoE-Pruner-E192-GGUF

192B 8K ctx
Q2_XXS
60GB file 65.15GB
Q1_S
192GB file 197.15GB
Q1_M
192GB file 197.15GB

gpt-oss-120b-GGUF

120B 8K ctx
FP4
120GB file 123.97GB

gpt-oss-20b-GGUF

20B 8K ctx
FP4
20GB file 22.33GB

Qwen3-235B-A22B-GGUF

235B 8K ctx
Q2_K
73.44GB file 79.29GB
Q4_K_M
132.19GB file 138.04GB

Qwen3-235B-A22B-Instruct-2507-GGUF

235B 8K ctx
Q2_K
73.44GB file 79.29GB
Q4_K_M
132.19GB file 138.04GB

Qwen3-235B-A22B-Thinking-2507-GGUF

235B 8K ctx
Q2_K
73.44GB file 79.29GB
Q4_K_M
132.19GB file 138.04GB
B

Bobleer

2 models

autotrain-6lxuh-noau7-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

autotrain-lcsbp-cl4gy-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
B

Bocalan

1 models

Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
B

Bochen2079

4 models

AORTA-7B-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

katherine-k0-qwen3.5-9b

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB

katherine-k8-qwen3.5-9b

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB

tars-qwen3.5-9b

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
B

Bolonini D

1 models

internlm2-20b-gguf

20B 8K ctx
Q3_K_S
8.75GB file 11.08GB
Q3_K_M
8.75GB file 11.08GB
Q4_K_S
11.25GB file 13.58GB
Q4_K_M
11.25GB file 13.58GB
Q5_K_S
13.75GB file 16.08GB
Q5_K_M
13.75GB file 16.08GB
Q6_K
16.25GB file 18.58GB
B

Bolt Monkey

1 models

boltmonkey_shortreasoning-8b-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB
B

Boltuzamaki

1 models

TinyLlama-1.1B-Chat-v1.0.Q4_k

1.1B 8K ctx
Q4_0
0.62GB file 2.64GB
FP16
2.2GB file 4.22GB
B

Bombman

1 models

Gemma-4-E2B-NoAudio-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
Q8_0
2.13GB file 4.16GB