All Supported Models

29681 AI models · 198875 quantization formats tracked

Z

Zenlm

9 models

zen-agent-4b

4B 8K ctx
Q2_K
1.25GB file 3.32GB

zen-designer-gguf

Unknown 8K ctx
Q4_K_M
0GB file 2GB

zen-eco-4b-agent-gguf

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q4_0
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q8_0
4.25GB file 6.32GB

zen-eco-4b-instruct

4B 8K ctx
FP16
8GB file 10.07GB

zen-eco-4b-thinking

4B 8K ctx
FP16
8GB file 10.07GB

zen-nano

Unknown 8K ctx
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB
Q8_0
0GB file 2GB

zen-nano-0.6b

0.6B 8K ctx
Q4_K_M
0.34GB file 2.35GB
Q5_K_M
0.41GB file 2.42GB
Q8_0
0.64GB file 2.65GB

zen4-mini-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB

zen4-ultra-gguf

Unknown 8K ctx
Q2_K
0GB file 2GB
Z

Zeongzaehoon

1 models

llama3.1_korean_v0.1_sft_by_aidx-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB
Z

Zero Agency

5 models

Zero-Mistral-24B-gguf

24B 8K ctx
Q4_K_M
13.5GB file 15.89GB
Q4_NL
13.5GB file 15.89GB
Q4_XS
13.5GB file 15.89GB
Q6_K
19.5GB file 21.89GB
Q6_K_L
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB
BF16
48GB file 50.39GB

Zero-Mistral-Small-24B-Instruct-2501-BF16

24B 8K ctx
BF16
48GB file 50.39GB

Zero-Mistral-Small-24B-Instruct-2501-F16

24B 8K ctx
FP16
48GB file 50.39GB

Zero-Mistral-Small-24B-Instruct-2501-Q4_K_M

24B 8K ctx
Q4_K_M
13.5GB file 15.89GB

Zero-Mistral-Small-24B-Instruct-2501-Q8_0

24B 8K ctx
Q8_0
25.5GB file 27.89GB
Z

Zero F L N

1 models

Cerata

8B 8K ctx
Q8_0
8.5GB file 10.63GB
Z

Zero Ww

124 models

amoral-gemma3-4B-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Art-0-8B-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

aya-expanse-8b-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Celeste-12B-V1.6-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB
Q6_0
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

cogito-v1-preview-llama-3B-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

cogito-v1-preview-llama-8B-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

DarkIdol-Llama-3.1-8B-Instruct-1.0-Uncensored-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

DarkIdol-Llama-3.1-8B-Instruct-1.0-Uncensored-SILLY

8B 8K ctx
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB

DeepSeek-R1-0528-Qwen3-8B-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

DeepSeek-R1-Distill-Qwen-7B-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

EuroLLM-1.7B-Instruct-GGUF

1.7B 8K ctx
Q5_0
1.17GB file 3.2GB
Q6_0
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB

EXAONE-Deep-2.4B-GGUF

2.4B 8K ctx
Q5_0
1.65GB file 3.69GB
Q6_0
1.95GB file 3.99GB
Q8_0
2.55GB file 4.59GB

EXAONE-Deep-7.8B-GGUF

7.8B 8K ctx
Q5_0
5.36GB file 7.49GB
Q6_0
6.34GB file 8.47GB
Q8_0
8.29GB file 10.42GB

Falcon-H1-7B-Instruct-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Fallen-Gemma3-4B-v1-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

gemma-2-2b-it-abliterated-GGUF

2B 8K ctx
Q5_0
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

gemma-2-2b-it-abliterated-SILLY

2B 8K ctx
Q8_0
2.13GB file 4.16GB
FP16
4GB file 6.03GB

gemma-2-2b-it-GGUF

2B 8K ctx
Q5_0
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

gemma-2-2b-it-SILLY

2B 8K ctx
Q8_0
2.13GB file 4.16GB
FP16
4GB file 6.03GB

Gemma-2-9B-It-SPPO-Iter3-GGUF

9B 8K ctx
Q5_0
6.19GB file 8.34GB
Q6_0
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

Gemma-2-9B-It-SPPO-Iter3-SILLY

9B 8K ctx
Q8_0
9.56GB file 11.71GB
FP16
18GB file 20.15GB

gemma-2-Ifable-9B-GGUF

9B 8K ctx
Q5_0
6.19GB file 8.34GB
Q6_0
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

gemma-3-1b-it-abliterated-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

gemma-3-1b-it-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

gemma-3-270m-it-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

gemma-3-4b-it-abliterated-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

gemma-3-4b-it-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Gemma-3-R1-4B-v1-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Gemmasutra-9B-v1b-SILLY

9B 8K ctx
Q8_0
9.56GB file 11.71GB
FP16
18GB file 20.15GB

Gemmasutra-Mini-2B-v1-GGUF

2B 8K ctx
Q5_0
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

Gemmasutra-Mini-2B-v1-SILLY

2B 8K ctx
Q8_0
2.13GB file 4.16GB
FP16
4GB file 6.03GB

ghost-8b-beta-1608-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

ghost-8b-beta-1608-SILLY

8B 8K ctx
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB

ghost-8b-beta-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

ghost-8b-beta-SILLY

8B 8K ctx
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB

GLM-4-9B-0414-GGUF

9B 8K ctx
Q5_0
6.19GB file 8.34GB
Q6_0
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

GLM-Z1-9B-0414-GGUF

9B 8K ctx
Q5_0
6.19GB file 8.34GB
Q6_0
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

granite-3.1-2b-instruct-GGUF

2B 8K ctx
Q5_0
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

granite-3.1-3b-a800m-instruct-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

granite-3.1-8b-instruct-abliterated-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

granite-3.1-8b-instruct-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

granite-3.2-2b-instruct-GGUF

2B 8K ctx
Q5_0
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

granite-3.3-2b-instruct-GGUF

2B 8K ctx
Q5_0
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

granite-3.3-8b-instruct-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Hunyuan-7B-Instruct-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

internlm3-8b-instruct-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Josiefied-Qwen3-8B-abliterated-v1-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

L3.1-8B-Celeste-V1.5-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

L3.1-8B-Celeste-V1.5-SILLY

8B 8K ctx
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB

L3.2-Rogue-Creative-Instruct-Uncensored-Abliterated-7B-D_AU-SILLY

7B 8K ctx
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB

Llama-3.1-Minitron-4B-Width-Base-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Llama-3.1-Nemotron-Nano-8B-v1-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3.1-Storm-8B-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3.1-Storm-8B-SILLY

8B 8K ctx
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB

Llama-3.2-1B-Instruct-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

Llama-3.2-3B-Instruct-abliterated-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Llama-3.2-3B-Instruct-abliterated-SILLY

3B 8K ctx
Q8_0
3.19GB file 5.24GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Instruct-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Llama-3.3-8B-Instruct-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-Deepsync-1B-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

Llama3.1-8B-Enigma-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama3.1-8B-Enigma-SILLY

8B 8K ctx
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB

Llama3.1-8B-ShiningValiant2-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama3.1-8B-ShiningValiant2-SILLY

8B 8K ctx
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB

Lumimaid-v0.2-12B-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB
Q6_0
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

Lumimaid-v0.2-12B-SILLY

12B 8K ctx
Q8_0
12.75GB file 14.95GB
FP16
24GB file 26.2GB

Lumimaid-v0.2-8B-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Lumimaid-v0.2-8B-SILLY

8B 8K ctx
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB

Marco-o1-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

Marco-o1-SILLY

Unknown 8K ctx
FP16
0GB file 2GB
Q8_0
0GB file 2GB

medgemma-4b-it-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Meta-Llama-3.1-8B-Claude-39fail-3000total-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Meta-Llama-3.1-8B-Instruct-abliterated-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Meta-Llama-3.1-8B-Instruct-abliterated-SILLY

8B 8K ctx
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Instruct-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Meta-Llama-3.1-8B-Instruct-SILLY

8B 8K ctx
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB

Mistral-7B-Instruct-v0.3-SILLY

7B 8K ctx
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB

Mistral-Nemo-12B-ArliAI-RPMax-v1.2-GGUF

12B 8K ctx
Q5_0
8.25GB file 10.45GB
Q6_0
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

Mistral-Nemo-12B-ArliAI-RPMax-v1.2-SILLY

12B 8K ctx
Q8_0
12.75GB file 14.95GB
FP16
24GB file 26.2GB

Mistral-Nemo-Base-2407-GGUF

2407B 8K ctx
Q5_0
1654.81GB file 1696.25GB
Q6_0
1955.69GB file 1997.13GB
Q8_0
2557.44GB file 2598.88GB

Mistral-Nemo-Instruct-2407-GGUF

2407B 8K ctx
Q5_0
1654.81GB file 1696.25GB
Q6_0
1955.69GB file 1997.13GB
Q8_0
2557.44GB file 2598.88GB

Mistral-Nemo-Instruct-2407-SILLY

12B 8K ctx
Q8_0
12.75GB file 14.95GB
FP16
24GB file 26.2GB

Mistral-NeMo-Minitron-8B-Instruct-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

neural-chat-7b-v3-3-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

neural-chat-7b-v3-3-SILLY

7B 8K ctx
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB

OpenELM-3B-Instruct-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

OpenThinker3-7B-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Phi-3-mini-4k-instruct-GGUF

3.8B 8K ctx
Q5_0
2.61GB file 4.67GB
Q6_0
3.09GB file 5.15GB
Q8_0
4.04GB file 6.1GB

Phi-3.5-mini-instruct_Uncensored-GGUF

3.8B 8K ctx
Q5_0
2.61GB file 4.67GB
Q6_0
3.09GB file 5.15GB
Q8_0
4.04GB file 6.1GB

Phi-3.5-mini-instruct_Uncensored-SILLY

3.8B 8K ctx
Q8_0
4.04GB file 6.1GB
FP16
7.6GB file 9.66GB

Phi-3.5-mini-instruct-GGUF

3.8B 8K ctx
Q5_0
2.61GB file 4.67GB
Q6_0
3.09GB file 5.15GB
Q8_0
4.04GB file 6.1GB

Phi-3.5-mini-instruct-SILLY

3.8B 8K ctx
Q8_0
4.04GB file 6.1GB
FP16
7.6GB file 9.66GB

Phi-4-mini-instruct-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Phi-4-mini-reasoning-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

phi3-uncensored-chat-GGUF

Unknown 8K ctx
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

Phi3Unlocked-GGUF

Unknown 8K ctx
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

Phi3Unlocked-SILLY

Unknown 8K ctx
FP16
0GB file 2GB
Q8_0
0GB file 2GB

Qwen2.5-1.5B-Instruct-GGUF

1.5B 8K ctx
Q5_0
1.03GB file 3.05GB
Q6_0
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

Qwen2.5-3B-Instruct-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Qwen2.5-7B-Instruct-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Qwen3-0.6B-GGUF

0.6B 8K ctx
Q5_0
0.41GB file 2.42GB
Q6_0
0.49GB file 2.5GB
Q8_0
0.64GB file 2.65GB

Qwen3-1.7B-GGUF

1.7B 8K ctx
Q5_0
1.17GB file 3.2GB
Q6_0
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB

Qwen3-4B-abliterated-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Qwen3-4B-Esper3-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Qwen3-4B-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Qwen3-4B-Instruct-2507-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Qwen3-4B-Thinking-2507-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Qwen3-8B-abliterated-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Qwen3-8B-Esper3-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Qwen3-8B-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Qwen3.5-2B-GGUF

2B 8K ctx
Q5_0
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

Qwen3.5-4B-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Qwen3.5-9B-GGUF

9B 8K ctx
Q5_0
6.19GB file 8.34GB
Q6_0
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

QwQ-LCoT-3B-Instruct-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Replete-LLM-Qwen2-7b_Beta-Preview-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Replete-LLM-Qwen2-7b_Beta-Preview-SILLY

7B 8K ctx
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB

Seed-Coder-8B-Instruct-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Seed-Coder-8B-Reasoning-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

shieldgemma-2b-GGUF

2B 8K ctx
Q5_0
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

SOLAR-10.7B-Instruct-v1.0-GGUF

10.7B 8K ctx
Q5_0
7.36GB file 9.54GB
Q6_0
8.69GB file 10.87GB
Q8_0
11.37GB file 13.55GB

SOLAR-10.7B-Instruct-v1.0-SILLY

10.7B 8K ctx
Q8_0
11.37GB file 13.55GB
FP16
21.4GB file 23.58GB

Symbol-LLM-8B-Instruct-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

TwinLlama-3.1-8B-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

TwinLlama-3.1-8B-SILLY

8B 8K ctx
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB
Z

Zero X Clem

28 models

L3-Aspire-Heart-Matrix-8B-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

L3-Aspire-Heart-Matrix-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

L3-Aspire-Heart-Matrix-8B-Q5_0-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB

L3-Aspire-Heart-Matrix-8B-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB

L3-Aspire-Heart-Matrix-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

L3.1-Pneuma-Allades-8B-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

L3.1-Pneuma-Allades-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

L3.1-Pneuma-Allades-8B-Q5_0-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB

Llama-3.1-8B-SuperTulu-LexiNova-Q5_0-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB

Llama-3.1-8B-SuperTulu-LexiNova-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-SuperTulu-LexiNova-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama3.1-DarkStorm-Aspire-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama3.1-DarkStorm-Aspire-8B-Q4_K_S-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama3.1-DarkStorm-Aspire-8B-Q5_0-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB

Llama3.1-DarkStorm-Aspire-8B-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

Llama3.1-DarkStorm-Aspire-8B-Q5_K_S-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

Llama3.1-DarkStorm-Aspire-8B-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB

Llama3.1-DarkStorm-Aspire-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

LLama3.1-Hawkish-Theia-Fireball-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

LLama3.1-Hawkish-Theia-Fireball-8B-Q5_0-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB

LLama3.1-Hawkish-Theia-Fireball-8B-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

LLama3.1-Hawkish-Theia-Fireball-8B-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB

LLama3.1-Hawkish-Theia-Fireball-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Qwen2.5-7B-HomerAnvita-NerdMix-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

Qwen2.5-7B-HomerAnvita-NerdMix-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

Qwen2.5-7B-HomerAnvita-NerdMix-Q6_K-GGUF

7B 8K ctx
Q6_0
5.69GB file 7.8GB
FP16
14GB file 16.11GB

Qwen2.5-7B-HomerAnvita-NerdMix-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Qwen3-4B-Wrist-On-Hermes-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB
Z

Zero21

1 models

OncoScope

4B 8K ctx
Q8_0
4.25GB file 6.32GB
Z

Zesquirrelnator

1 models

moondream2-finetuneV2

Unknown 8K ctx
FP16
0GB file 2GB
Z

Zetasepic

3 models

Qwen2.5-32B-Instruct-abliterated-v2-GGUF

32B 8K ctx
Q3_K_M
14GB file 16.52GB
Q4_K_M
18GB file 20.52GB
Q4_XS
18GB file 20.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB

Qwen2.5-72B-Instruct-abliterated-GGUF

72B 8K ctx
Q3_K_M
31.5GB file 34.68GB
Q4_K_M
40.5GB file 43.68GB
Q6_K
58.5GB file 61.68GB

Qwen2.5-72B-Instruct-abliterated-v2-GGUF

72B 8K ctx
Q2_K
22.5GB file 25.68GB
Q3_K_M
31.5GB file 34.68GB
Q3_M
31.5GB file 34.68GB
Q4_K_M
40.5GB file 43.68GB
Q4_XS
40.5GB file 43.68GB
Q6_K
58.5GB file 61.68GB
Q8_0
76.5GB file 79.68GB
Z

Zeuvue

3 models

GLM-4-9B-0414-Q4_K_S-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

kurage-ar-Q5_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q5_0
0GB file 2GB

paya-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB