All Supported Models

29681 AI models · 198875 quantization formats tracked

Y

Yeonseok Zeticai

1 models

QWEN_2.5_omni_3b_decoder

3B 8K ctx
FP16
6GB file 8.05GB
Y

Yeonwoo Sung

7 models

cogito-v1-preview-llama-3B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

EXAONE-Deep-32B-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

Llama-3.1-8B-OpenO1-SFT-v0.1-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-OpenO1-SFT-v0.2-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Qwen3-0.6B-Base-Q4_K_M-GGUF

0.6B 8K ctx
Q4_0
0.34GB file 2.35GB
FP16
1.2GB file 3.21GB

Qwen3-30B-A3B-Q4_K_M-GGUF

30B 8K ctx
Q4_0
16.88GB file 19.37GB
FP16
60GB file 62.49GB

Qwen3-32B-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB
Y

Yeonwookkim

1 models

Synatra-11B-Testbench-2-Q4_K_M-GGUF

11B 8K ctx
Q4_0
6.19GB file 8.37GB
FP16
22GB file 24.18GB
Y

Yesquiteno

1 models

Phi-3-mini-4k-instruct-Q2_K-GGUF

3.8B 8K ctx
Q2_0
1.19GB file 3.25GB
FP16
7.6GB file 9.66GB
Y

Yews1234

2 models

llama-2-koen-13b-Q4_K_M-GGUF

13B 8K ctx
Q4_K_M
7.31GB file 9.52GB

Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Y

Yeyuxx

1 models

supergemma4-26b-uncensored-gguf-v2

26B 8K ctx
Q4_K_M
14.63GB file 17.06GB
Y

Ygz 08123

6 models

Llama-3.2-1B-Instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-3B-Instruct-Q2_K-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Qwen2.5-0.5B-Instruct-Q8_0-GGUF

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB

Qwen2.5-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen3-4B-Instruct-2507-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB
Y

Yh Yao

10 models

Meta-Llama-3-8B-Instruct-Q3_K_L-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Meta-Llama-3-8B-Instruct-Q3_K_M-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Meta-Llama-3-8B-Instruct-Q3_K_S-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Phi-3-mini-4k-instruct-Q3_K_L-GGUF

3.8B 8K ctx
Q3_0
1.66GB file 3.72GB
FP16
7.6GB file 9.66GB

Phi-3-mini-4k-instruct-Q3_K_M-GGUF

3.8B 8K ctx
Q3_0
1.66GB file 3.72GB
FP16
7.6GB file 9.66GB

Phi-3-mini-4k-instruct-Q3_K_S-GGUF

3.8B 8K ctx
Q3_0
1.66GB file 3.72GB
FP16
7.6GB file 9.66GB

Phi-3-mini-4k-instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

Phi-3-mini-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3-mini-4k-instruct-Q4_K_S-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB
Y

Yhhxhfh

1 models

autotrain-2n9b3-mj6my-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB
Y

Yhkim96

2 models

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB