All Supported Models

29681 AI models · 198875 quantization formats tracked

Y

Ynead

1 models

XortronCriminalComputingConfig-heretic-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
Y

Ynsmcd

1 models

slownesd

Unknown 8K ctx
FP16
0GB file 2GB
Y

Yo Abriel

1 models

KodaLite-1.3B-GGUF

1.3B 8K ctx
Q4_K_M
0.73GB file 2.75GB
Q8_0
1.38GB file 3.4GB
Y

Yolozh

2 models

Huihui-Qwen3-4B-Instruct-2507-abliterated-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

Qwen2-1.5B-Instruct-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB
Y

Yongdong Wang

3 models

llama-3.1-8b-lora-qlora-dart-llm-gguf

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

llama-3.2-1b-lora-qlora-dart-llm-gguf

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

llama-3.2-3b-lora-qlora-dart-llm-gguf

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
Y

Yoon Choong Sung

1 models

finance-LLM-13B-Q8_0-GGUF

13B 8K ctx
Q8_0
13.81GB file 16.02GB
Y

Yorkie O H10

34 models

AceInstruct-7B-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

CodeQwen1.5-7B-Chat-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

GLM-Z1-9B-0414-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

granite-20b-code-base-Q8_0-GGUF

20B 8K ctx
Q8_0
21.25GB file 23.58GB

granite-20b-code-instruct-Q8_0-GGUF

20B 8K ctx
Q8_0
21.25GB file 23.58GB

granite-34b-code-base-Q8_0-GGUF

34B 8K ctx
Q8_0
36.13GB file 38.69GB

granite-34b-code-instruct-Q8_0-GGUF

34B 8K ctx
Q8_0
36.13GB file 38.69GB

granite-3b-code-base-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

granite-3b-code-instruct-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

granite-8b-code-base-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

granite-8b-code-instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

granite-8b-code-instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

internlm2_5-20b-chat-Q8_0-GGUF

20B 8K ctx
Q8_0
21.25GB file 23.58GB

internlm2-math-plus-7b-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Llama-3-8B-Instruct-Gradient-1048k-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Meltemi-7B-Instruct-v1-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Phi-3-medium-128k-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

phi-3-on-mac-Q2_K-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB

phi-3-on-mac-Q3_K_L-GGUF

3.8B 8K ctx
Q3_K_L
1.66GB file 3.72GB

phi-3-on-mac-Q3_K_M-GGUF

3.8B 8K ctx
Q3_K_M
1.66GB file 3.72GB

phi-3-on-mac-Q3_K_S-GGUF

3.8B 8K ctx
Q3_K_S
1.66GB file 3.72GB

phi-3-on-mac-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

phi-3-on-mac-Q4_K_M-GGUF

3.8B 8K ctx
Q4_K_M
2.14GB file 4.2GB

phi-3-on-mac-Q4_K_S-GGUF

3.8B 8K ctx
Q4_K_S
2.14GB file 4.2GB

phi-3-on-mac-Q5_0-GGUF

0B 8K ctx
Q5_0
0GB file 2GB

phi-3-on-mac-Q5_K_M-GGUF

3.8B 8K ctx
Q5_K_M
2.61GB file 4.67GB

phi-3-on-mac-Q5_K_S-GGUF

3.8B 8K ctx
Q5_K_S
2.61GB file 4.67GB

phi-3-on-mac-Q6_K-GGUF

3.8B 8K ctx
Q6_K
3.09GB file 5.15GB

phi-3-on-mac-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Phi-3.5-mini-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Qwen2.5-14B_Uncensored_Instruct-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen2.5-Coder-3B-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

starcoder2-15b-instruct-v0.1-Q8_0-GGUF

15B 8K ctx
Q8_0
15.94GB file 18.19GB
Y

Yorkze

1 models

Qwen3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
Y

Yosha

1 models

gemma-4-yakut-gguf

26B 8K ctx
Q4_K_M
14.63GB file 17.06GB
Y

You Country

3 models

gemma-4-31b-it-heretic-ara-gguf

31B 8K ctx
Q4_K_M
17.44GB file 19.95GB
BF16
62GB file 64.51GB

gemma-4-31B-it-uncensored-GGUF

31B 8K ctx
Q4_K_M
17.44GB file 19.95GB

GPT-2-XL

Unknown 8K ctx
FP16
0GB file 2GB