All Supported Models

29681 AI models · 198875 quantization formats tracked

Z

Zon5000

1 models

MedLLM_merged-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_K_M
0GB file 2GB
Z

Zone Twelve

3 models

Breeze-7B-Instruct-v1_0-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Taiwan-LLM-7B-v2.0.1-chat-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Taiwan-LLM-8x7B-DPO-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Z

Zooai

2 models

coder-1

30B 8K ctx
Q4_K_M
16.88GB file 19.37GB

coder-1-gguf

1B 8K ctx
Q3_K_M
0.44GB file 2.46GB
Q4_K_M
0.56GB file 2.58GB
Z

Zoobomb

2 models

qwen-l4d2-14b-v2-GGUF

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB

qwen-l4d2-7b-v2-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Z

Zoraiz112

1 models

SecureFin-SLM-1.5B-Merged

1.5B 8K ctx
FP16
3GB file 5.02GB
Z

Zpr159

1 models

phi-2-Q4_K_M-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB
Z

Zqmalyssa

1 models

Qwen2.5-1.5B-Assistant

1.5B 8K ctx
FP16
3GB file 5.02GB
Z

Zsolx2

2 models

Phi-3.5-mini-instruct_Uncensored-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

Phi-3.5-mini-instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB
Z

Zsoolt

1 models

Qwen3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
Z

Zuze Tt

5 models

gemma-3-270m-it-heretic-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_S
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

LFM2.5-1.2B-Instruct-imatrix-GGUF

1.2B 8K ctx
Q2_K
0.38GB file 2.4GB
Q2_M
0.38GB file 2.4GB
Q2_S
0.38GB file 2.4GB
Q2_XS
0.38GB file 2.4GB
Q2_XXS
0.38GB file 2.4GB
Q3_K_L
0.53GB file 2.55GB
Q3_K_M
0.53GB file 2.55GB
Q3_K_S
0.53GB file 2.55GB
Q3_M
0.53GB file 2.55GB
Q3_S
0.53GB file 2.55GB
Q3_XS
0.53GB file 2.55GB
Q3_XXS
0.53GB file 2.55GB
Q4_0
0.67GB file 2.69GB
Q4_1
0.67GB file 2.69GB
Q4_K
0.67GB file 2.69GB
Q4_K_M
0.67GB file 2.69GB
Q4_K_S
0.67GB file 2.69GB
Q4_NL
0.67GB file 2.69GB
Q4_XS
0.67GB file 2.69GB
Q5_0
0.83GB file 2.85GB
Q5_1
0.83GB file 2.85GB
Q5_K
0.83GB file 2.85GB
Q5_K_M
0.83GB file 2.85GB
Q5_K_S
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB
Q1_M
1.2GB file 3.22GB
Q1_S
1.2GB file 3.22GB
Q8_0
1.28GB file 3.3GB
BF16
2.4GB file 4.42GB

LFM2.5-1.2B-Thinking-imatrix-GGUF

1.2B 8K ctx
Q2_K
0.38GB file 2.4GB
Q2_M
0.38GB file 2.4GB
Q2_S
0.38GB file 2.4GB
Q2_XS
0.38GB file 2.4GB
Q2_XXS
0.38GB file 2.4GB
Q3_K_L
0.53GB file 2.55GB
Q3_K_M
0.53GB file 2.55GB
Q3_K_S
0.53GB file 2.55GB
Q3_M
0.53GB file 2.55GB
Q3_S
0.53GB file 2.55GB
Q3_XS
0.53GB file 2.55GB
Q3_XXS
0.53GB file 2.55GB
Q4_0
0.67GB file 2.69GB
Q4_1
0.67GB file 2.69GB
Q4_K
0.67GB file 2.69GB
Q4_K_M
0.67GB file 2.69GB
Q4_K_S
0.67GB file 2.69GB
Q4_NL
0.67GB file 2.69GB
Q4_XS
0.67GB file 2.69GB
Q5_0
0.83GB file 2.85GB
Q5_1
0.83GB file 2.85GB
Q5_K
0.83GB file 2.85GB
Q5_K_M
0.83GB file 2.85GB
Q5_K_S
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB
Q1_M
1.2GB file 3.22GB
Q1_S
1.2GB file 3.22GB
Q8_0
1.28GB file 3.3GB
BF16
2.4GB file 4.42GB

Qwen3-4B-Thinking-2507-Heretic-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Qwen3-4B-Thinking-2507-Heretic-Imatrix-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q2_M
1.25GB file 3.32GB
Q2_S
1.25GB file 3.32GB
Q2_XS
1.25GB file 3.32GB
Q2_XXS
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q3_M
1.75GB file 3.82GB
Q3_S
1.75GB file 3.82GB
Q3_XS
1.75GB file 3.82GB
Q3_XXS
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q4_K
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_NL
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q1_M
4GB file 6.07GB
Q1_S
4GB file 6.07GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB