All Supported Models

29681 AI models · 198875 quantization formats tracked

B

Benevolence Messiah

34 models

DeepCoder-1.5B-Preview-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

DeepCoder-14B-Preview-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB

DeepSeekR1-QwQ-SkyT1-32B-Fusion-811-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB

gemma-2-9b-it-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

internlm2_5-7b-chat-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Llama-3-Instruct-8B-SPPO-Iter3-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3-Instruct-8B-SPPO-Iter3-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

OlympicCoder-32B-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB

OlympicCoder-7B-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Phi-3-mini-128k-instruct-GGUF

3.8B 8K ctx
Q2_0
1.19GB file 3.25GB
Q3_0
1.66GB file 3.72GB
Q4_0
2.14GB file 4.2GB
Q5_0
2.61GB file 4.67GB
Q6_0
3.09GB file 5.15GB
Q8_0
4.04GB file 6.1GB

Qwen2.5-14B-Instruct-1M-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB

Qwen2.5-14B-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB

Qwen2.5-7B-Instruct-1M-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Qwen2.5-Coder-32B-Instruct-abliterated-Q3_K_L-GGUF

32B 8K ctx
Q3_0
14GB file 16.52GB
FP16
64GB file 66.52GB

Qwen2.5-Coder-32B-Instruct-abliterated-Q4_0-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB

Qwen2.5-Coder-32B-Instruct-abliterated-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

Qwen2.5-Coder-32B-Instruct-abliterated-Q4_K_S-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

Qwen2.5-Coder-32B-Instruct-abliterated-Q5_0-GGUF

32B 8K ctx
Q5_0
22GB file 24.52GB

Qwen2.5-Coder-32B-Instruct-abliterated-Q5_K_M-GGUF

32B 8K ctx
Q5_0
22GB file 24.52GB
FP16
64GB file 66.52GB

Qwen2.5-Coder-32B-Instruct-abliterated-Q5_K_S-GGUF

32B 8K ctx
Q5_0
22GB file 24.52GB
FP16
64GB file 66.52GB

Qwen2.5-Coder-32B-Instruct-abliterated-Q6_K-GGUF

32B 8K ctx
Q6_0
26GB file 28.52GB
FP16
64GB file 66.52GB

Qwen2.5-Coder-32B-Instruct-abliterated-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB

Qwen2.5-Coder-32B-Instruct-Q6_K-GGUF

32B 8K ctx
Q6_0
26GB file 28.52GB
FP16
64GB file 66.52GB

Qwen2.5-Coder-32B-Instruct-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB

Qwen2.5-Coder-7B-Instruct-abliterated-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Qwen3-0.6B-abliterated-Q8_0-GGUF

0.6B 8K ctx
Q8_0
0.64GB file 2.65GB

Qwen3-14B-abliterated-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB

Qwen3-30B-A3B-Q8_0-GGUF

30B 8K ctx
Q8_0
31.88GB file 34.37GB

Qwen3-32B-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB

Qwen3-4B-abliterated-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB

Qwen3-8B-abliterated-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

QwQ-32B-abliterated-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB

QwQ-32B-Preview-abliterated-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB

QwQ-32B-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB
B

Benhaotang

1 models

gpt-oss-coder-20B-GGUF

20B 8K ctx
FP4
20GB file 22.33GB
B

Benitomartin

1 models

grumpy-chef-lfm2.5-1.2B-GGUF

1.2B 8K ctx
Q4_K_M
0.67GB file 2.69GB
Q8_0
1.28GB file 3.3GB
B

Benjaminradio

1 models

K2-Think-V2-GGUF

2B 8K ctx
Q6_K
1.63GB file 3.66GB
B

Benniekiss

1 models

llama-3.2-3B-instruct-gguf

3B 8K ctx
Q3_M
1.31GB file 3.36GB
Q3_K_XL
1.31GB file 3.36GB
Q3_K_L
1.31GB file 3.36GB
Q4_XS
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_L
1.69GB file 3.74GB
Q4_0
1.69GB file 3.74GB
Q5_K_S
2.06GB file 4.11GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_L
2.06GB file 4.11GB
Q6_K_L
2.44GB file 4.49GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
B

Benny Da Ball

4 models

LFM2.5-1.2B-Z-Image-Engineer-V4

1.2B 8K ctx
Q3_K_L
0.53GB file 2.55GB
Q3_K_M
0.53GB file 2.55GB
Q4_K_M
0.67GB file 2.69GB
Q4_K_S
0.67GB file 2.69GB
Q5_K_M
0.83GB file 2.85GB
Q5_K_S
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB

MiniMax-M2.5-REAP-139B-A10B-GGUF

139B 8K ctx
Q4_K_M
78.19GB file 82.47GB
Q5_K_M
95.56GB file 99.84GB
Q8_0
147.69GB file 151.97GB

MiniMax-M2.5-REAP-139B-A10B-MXFP4

139B 8K ctx
FP4
139GB file 143.28GB

Qwen3-4b-Z-Image-Engineer-V4

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q4_K_S
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
B

Benz003

2 models

llama3_finetune_rank16

Unknown 8K ctx
Q4_K_M
0GB file 2GB

llama3_finetune_rank32

Unknown 8K ctx
Q4_K_M
0GB file 2GB
B

Beomi

2 models

KoAlpaca-RealQA-Solar-Ko-Recovery-11B-Q8_0-GGUF

11B 8K ctx
Q8_0
11.69GB file 13.87GB

Solar-Ko-Recovery-11B-Q8_0-GGUF

11B 8K ctx
Q8_0
11.69GB file 13.87GB
B

Beowolx

1 models

CodeNinja-1.0-OpenChat-7B-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB
B

Bepisot

1 models

Qwen3-8B-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB