All Supported Models

29681 AI models · 198875 quantization formats tracked

Y

Yabs

1 models

gemma-2-27b-Q4_K_M-GGUF

27B 8K ctx
Q4_0
15.19GB file 17.63GB
FP16
54GB file 56.44GB
Y

Yadz45

3 models

iaPartnaireAnnonce

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

iaPartnaireV1

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

llama-3-8b-Instruct-bnb-4bit-Yannis-demo

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Y

Yagnik Patel 12

1 models

merged_model

Unknown 8K ctx
FP16
0GB file 2GB
Y

Yakupc55

1 models

gemma3-1b-Smart-Windows

1B 8K ctx
Q8_0
1.06GB file 3.08GB
Y

Yalexis

1 models

gemma3-1b-rpr-0327

1B 8K ctx
Q8_0
1.06GB file 3.08GB
Y

Yan Labs

6 models

gemma-3-27b-it-abliterated-normpreserve-GGUF

27B 8K ctx
Q2_K
8.44GB file 10.88GB
Q3_K_M
11.81GB file 14.25GB
Q4_XS
15.19GB file 17.63GB
Q4_K_M
15.19GB file 17.63GB
Q5_K_M
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB

gemma-3-27b-it-abliterated-normpreserve-v1-GGUF

27B 8K ctx
Q8_0
28.69GB file 31.13GB

gemma-3-4b-it-abliterated-normpreserve-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Llama-3.3-8B-Instruct-MPOA-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Seed-OSS-36B-Instruct-MPOA-GGUF

36B 8K ctx
Q2_K
11.25GB file 13.84GB
Q3_K_M
15.75GB file 18.34GB
Q4_K_M
20.25GB file 22.84GB
Q5_K_M
24.75GB file 27.34GB
Q6_K
29.25GB file 31.84GB
Q8_0
38.25GB file 40.84GB

Seed-OSS-36B-Instruct-MPOA-v1-GGUF

36B 8K ctx
FP16
72GB file 74.59GB
Y

Yana Duck81

1 models

gshot

1.5B 8K ctx
FP16
3GB file 5.02GB
Y

Yana S

2 models

llama-2-7b-langchain-chat-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

llama2-bg-GGUF

Unknown 8K ctx
Q8_0
0GB file 2GB
Q6_K
0GB file 2GB
Q5_K_M
0GB file 2GB
Q4_K_M
0GB file 2GB
Y

Yanchan2025Sep

1 models

Qwen3-30B-A3B-YOYO-V6-Q6_K-GGUF

30B 8K ctx
Q6_0
24.38GB file 26.87GB
FP16
60GB file 62.49GB
Y

Yangdonghun3

1 models

KONI-Llama3-8B-Instruct-20240729-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB