All Supported Models

29681 AI models · 198875 quantization formats tracked

C

Chenly124

6 models

Nanbeige4.1-3B-heretic-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

phi3-uncensored-chat-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

phi3-uncensored-chat-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Qwen3-4B-Instruct-2507-MPOA-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB

Qwen3-4B-Thinking-2507-MPOA-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB

Qwen3.5-4B-PaperWitch-heresy-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB
FP16
8GB file 10.07GB
C

Chenyingjie

1 models

fortunetelling

Unknown 8K ctx
Q8_0
0GB file 2GB
C

Cherry David

5 models

kanana-1.5-8b-instruct-2505-IQ4_NL-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Qwen3-0.6B-Q8_0-GGUF

0.6B 8K ctx
Q8_0
0.64GB file 2.65GB

Qwen3-1.7B-Q4_K_M-GGUF

1.7B 8K ctx
Q4_0
0.96GB file 2.99GB
FP16
3.4GB file 5.43GB

Qwen3-1.7B-Q8_0-GGUF

1.7B 8K ctx
Q8_0
1.81GB file 3.84GB

T3Q-qwen2.5-14b-v1.2-e2-Q4_0-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
C

Cheuv

1 models

Darwin-4B-Genesis-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB
C

Chevyenvy

1 models

Qwen3-30B-A3B-Instruct-2507-Q4_K_M-GGUF

30B 8K ctx
Q4_0
16.88GB file 19.37GB
FP16
60GB file 62.49GB
C

Chfm

1 models

Huihui-Qwen3.6-27B-abliterated-Q4_K_M-GGUF

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB
C

Chhatramani

1 models

nyayalm1.7B_civil9law

1.7B 8K ctx
Q4_K_M
0.96GB file 2.99GB
C

Chi Koi7

13 models

Falcon3-1B-Instruct-Heretic-GGUF

1B 8K ctx
Q3_K_L
0.44GB file 2.46GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_S
0.44GB file 2.46GB
Q3_M
0.44GB file 2.46GB
Q3_XS
0.44GB file 2.46GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q4_NL
0.56GB file 2.58GB
Q4_XS
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

Falcon3-3B-Instruct-Heretic-GGUF

3B 8K ctx
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q3_M
1.31GB file 3.36GB
Q3_XS
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q4_NL
1.69GB file 3.74GB
Q4_XS
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Falcon3-7B-Instruct-Heretic-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Falcon3-7B-Instruct-Heretic-v2-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

FuseChat-Qwen-2.5-7B-Instruct-Heretic-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_NL
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Gemma-2-Llama-Swallow-2b-it-v0.1-Heretic-GGUF

2B 8K ctx
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q3_M
0.88GB file 2.91GB
Q3_XS
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q4_NL
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

Gemma-2-Llama-Swallow-9b-it-v0.1-Heretic-GGUF

9B 8K ctx
Q3_K_L
3.94GB file 6.09GB
Q3_K_M
3.94GB file 6.09GB
Q3_K_S
3.94GB file 6.09GB
Q3_M
3.94GB file 6.09GB
Q3_XS
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q4_NL
5.06GB file 7.21GB
Q4_XS
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

GLM-4.7-Flash-Heretic-MXFP4-GGUF

4B 8K ctx
FP4
4GB file 6.07GB

Llama-3-ELYZA-JP-8B-Heretic-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3.1-8B-Lexi-Uncensored-V2-Heretic-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

SmolLM2-1.7B-Instruct-Heretic-GGUF

1.7B 8K ctx
Q3_K_L
0.74GB file 2.77GB
Q3_K_M
0.74GB file 2.77GB
Q3_K_S
0.74GB file 2.77GB
Q3_M
0.74GB file 2.77GB
Q3_XS
0.74GB file 2.77GB
Q4_K_M
0.96GB file 2.99GB
Q4_K_S
0.96GB file 2.99GB
Q4_NL
0.96GB file 2.99GB
Q4_XS
0.96GB file 2.99GB
Q5_K_M
1.17GB file 3.2GB
Q5_K_S
1.17GB file 3.2GB
Q6_K
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB

stablelm-zephyr-3b-Heretic-GGUF

3B 8K ctx
Q3_K
1.31GB file 3.36GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q3_M
1.31GB file 3.36GB
Q3_XS
1.31GB file 3.36GB
Q4_K
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q4_NL
1.69GB file 3.74GB
Q4_XS
1.69GB file 3.74GB
Q5_K
2.06GB file 4.11GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

TinyLlama-1.1B-Chat-v1.0-Heretic-GGUF

1.1B 8K ctx
Q3_K_L
0.48GB file 2.5GB
Q3_K_M
0.48GB file 2.5GB
Q3_K_S
0.48GB file 2.5GB
Q3_M
0.48GB file 2.5GB
Q3_XS
0.48GB file 2.5GB
Q4_K_M
0.62GB file 2.64GB
Q4_K_S
0.62GB file 2.64GB
Q4_NL
0.62GB file 2.64GB
Q4_XS
0.62GB file 2.64GB
Q5_K_M
0.76GB file 2.78GB
Q5_K_S
0.76GB file 2.78GB
Q6_K
0.89GB file 2.91GB
Q8_0
1.17GB file 3.19GB
C

Chi1818

1 models

meta-Llama-3.1-8B-nursing

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
C

Chienweichang

6 models

Breeze-7B-32k-Instruct-v1_0-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB

Llama-3-8B-Instruct-Gradient-1048k-GGUF

8B 8K ctx
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB

Llama-3-Taiwan-70B-Instruct-GGUF

70B 8K ctx
Q2_0
21.88GB file 25.03GB
Q3_0
30.63GB file 33.78GB
Q4_0
39.38GB file 42.53GB
Q4_1
39.38GB file 42.53GB
Q5_0
48.13GB file 51.28GB
Q6_0
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB

Llama-3-Taiwan-8B-Instruct-128k-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3-Taiwan-8B-Instruct-DPO-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3-Taiwan-8B-Instruct-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB