All Supported Models

29681 AI models · 198875 quantization formats tracked

Y

Yannelli

2 models

Laravel-11-Llama-3.1-8B-Instruct-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q8_0
8.5GB file 10.63GB

Laravel-11-Llama-3.2-1B-Instruct-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q8_0
1.06GB file 3.08GB
Y

Yannlaff

1 models

Meta-Llama-3.1-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q5_K_S
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
Y

Yanny 654

1 models

YAPPERTAR-ai-5B-1.0

5B 8K ctx
FP16
10GB file 12.08GB
Y

Yaovi78

1 models

MiniMax-M2.7-Abliterated-Heretic-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB
Q8_0
0GB file 2GB
Q6_K
0GB file 2GB
Q4_K_M
0GB file 2GB
Y

Yapos2

1 models

Finance-Llama-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
Y

Yard

1 models

Llama-xLAM-2-8b-fc-r-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
Y

Yarenty

1 models

llama32-datafusion-instruct-gguf

Unknown 8K ctx
FP16
0GB file 2GB
Y

Yargpt

2 models

vicuna-13b-v1.5-gguf

13B 8K ctx
FP16
26GB file 28.21GB

Vikhr-7b-0.1-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB
Y

Yarikdevcom

1 models

Seed-OSS-36B-Instruct-GGUF

36B 8K ctx
Q2_K
11.25GB file 13.84GB
Q3_K_M
15.75GB file 18.34GB
Q4_K_M
20.25GB file 22.84GB
Q6_K
29.25GB file 31.84GB
Q8_0
38.25GB file 40.84GB
Y

Yaroster

3 models

Secunda-0.1-GGUF

0.1B 8K ctx
Q2_0
0.03GB file 2.03GB
Q1_0
0.1GB file 2.1GB
Q8_0
0.11GB file 2.11GB

Secunda-0.3-GGUF

0.3B 8K ctx
Q2_0
0.09GB file 2.09GB
Q1_0
0.3GB file 2.3GB
Q8_0
0.32GB file 2.32GB

Secunda-0.5-GGUF

0.5B 8K ctx
Q2_0
0.16GB file 2.17GB
Q1_0
0.5GB file 2.51GB
Q8_0
0.53GB file 2.54GB