All Supported Models

29681 AI models · 198875 quantization formats tracked

Z

Zeylei

1 models

Huihui-QwenLong-L1.5-30B-A3B-abliterated-Q4_K_M-GGUF

30B 8K ctx
Q4_0
16.88GB file 19.37GB
FP16
60GB file 62.49GB
Z

Zhangfeng026

2 models

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB
Z

Zhangmingshuo

1 models

Qwen3-1.7B-Q4_K_M-GGUF

1.7B 8K ctx
Q4_0
0.96GB file 2.99GB
FP16
3.4GB file 5.43GB
Z

Zhangranhgd

1 models

Qwen2-Boundless-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
Z

Zhangsq Nju

2 models

Qwen3-0.6B-EdgeRazor-GGUF

0.6B 8K ctx
Q2_0
0.19GB file 2.2GB
Q4_0
0.34GB file 2.35GB
Q1_0
0.6GB file 2.61GB
BF16
1.2GB file 3.21GB

Qwen3-1.7B-EdgeRazor-GGUF

1.7B 8K ctx
Q2_0
0.53GB file 2.56GB
Q4_0
0.96GB file 2.99GB
Q1_0
1.7GB file 3.73GB
BF16
3.4GB file 5.43GB
Z

Zhaoweiguo

1 models

Qwen3-0.6B-Q4_K_M-GGUF

0.6B 8K ctx
Q4_0
0.34GB file 2.35GB
FP16
1.2GB file 3.21GB
Z

Zhaoxiangshun

3 models

Llama-2-7b-hf-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Llama-3.2-1B-Instruct-Q4_0-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB

Meta-Llama-3-8B-Instruct-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Z

Zhengting

1 models

llama-3.2-3b-it-Ecommerce-ChatBot-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
Z

Zhentaoyu

4 models

Llama-2-13b-chat-hf-Q4_0-GGUF

13B 8K ctx
Q4_0
7.31GB file 9.52GB

Llama-2-7b-chat-hf-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

Llama-2-7b-chat-hf-Q4_K_S-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Llama-3-8B-Instruct-Gradient-1048k-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Z

Zhezhe

2 models

Gemma-2-9B-Chinese-Chat-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

gemma-2-9b-it-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB