All Supported Models

29681 AI models · 198875 quantization formats tracked

Z

Zhhan

1 models

adapter-Phi-3-mini-4k-instruct_code_writing

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB
Z

Zhiyuan8

9 models

RWKV-v7-0.1B-G1-GGUF

0.1B 8K ctx
FP16
0.2GB file 2.2GB

RWKV-v7-0.1B-World-v3-GGUF

0.1B 8K ctx
FP16
0.2GB file 2.2GB

RWKV-v7-0.4B-G1-GGUF

0.4B 8K ctx
Q4_K_M
0.23GB file 2.24GB
Q5_K_M
0.28GB file 2.29GB
Q8_0
0.43GB file 2.44GB

RWKV-v7-0.4B-World-v3-GGUF

0.4B 8K ctx
FP16
0.8GB file 2.81GB

RWKV-v7-1.5B-G1-GGUF

1.5B 8K ctx
Q4_K_M
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q8_0
1.59GB file 3.61GB

RWKV-v7-1.5B-World-v3-GGUF

1.5B 8K ctx
Q4_K_M
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q8_0
1.59GB file 3.61GB

RWKV-v7-2.9B-G1-GGUF

2.9B 8K ctx
Q4_K_M
1.63GB file 3.68GB
Q5_K_M
1.99GB file 4.04GB
Q8_0
3.08GB file 5.13GB

RWKV-v7-2.9B-World-v3-GGUF

2.9B 8K ctx
Q4_K_M
1.63GB file 3.68GB
Q5_K_M
1.99GB file 4.04GB
Q8_0
3.08GB file 5.13GB

RWKV-v7-7.2B-G0-GGUF

7.2B 8K ctx
Q4_K_M
4.05GB file 6.17GB
Q5_K_M
4.95GB file 7.07GB
Q8_0
7.65GB file 9.77GB
Z

Zhoucantd

2 models

qwen3-toki-pona-translate-lora

4B 8K ctx
FP16
8GB file 10.07GB

translategemma-tok-F16-GGUF

4B 8K ctx
FP16
8GB file 10.07GB
Z

Zhsh17

7 models

OLMo-2-0425-1B-Instruct-Q2_K-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
FP16
2GB file 4.02GB

OLMo-2-0425-1B-Instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

OLMoE-1B-7B-0125-Instruct-Q2_K-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
FP16
2GB file 4.02GB

Qwen3-0.6B-Q2_K-GGUF

0.6B 8K ctx
Q2_0
0.19GB file 2.2GB
FP16
1.2GB file 3.21GB

Qwen3-0.6B-Q4_K_M-GGUF

0.6B 8K ctx
Q4_0
0.34GB file 2.35GB
FP16
1.2GB file 3.21GB

Qwen3-1.7B-Q2_K-GGUF

1.7B 8K ctx
Q2_0
0.53GB file 2.56GB
FP16
3.4GB file 5.43GB

Qwen3-1.7B-Q4_0-GGUF

1.7B 8K ctx
Q4_0
0.96GB file 2.99GB
Z

Zhywyt

2 models

Qwen2.5-0.5B-Instruct-IQ4_NL-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2.5-0.5B-Instruct-Q8_0-GGUF

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB
Z

Zidsi

1 models

Zlatorog-12B-Instruct-Beta-GGUF

12B 8K ctx
Q4_K_M
6.75GB file 8.95GB
Q8_0
12.75GB file 14.95GB
BF16
24GB file 26.2GB
Z

Zihuiliu7737

1 models

CausalLM-14B-DPO-alpha-GGUF

14B 8K ctx
Q3_K_M
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q5_K_S
9.63GB file 11.86GB
Q5_K_M
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB
Z

Zilalzihar

1 models

mikrotik-routeros-v01-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Z

Zillioncart3930

1 models

phi-2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_S
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_L
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q5_0
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
Z

Zipaltrivedi

1 models

dotnet-coder-14b

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB
Q4_K_S
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB