All Supported Models

29681 AI models · 198875 quantization formats tracked

K

Kalio12

1 models

mistraltrained

7B 8K ctx
Q8_0
7.44GB file 9.55GB
K

Kalle07

11 models

apertus-8b_instruct-2509-heretic_R7_K005_q8_0-gguf

8B 8K ctx
Q8_0
8.5GB file 10.63GB

gemma-3-4b-it-heretic_R18_K005-bf16-gguf

4B 8K ctx
BF16
8GB file 10.07GB

GLM-4.6V-Flash-heretic_R18_K001-gguf

001B 8K ctx
Q4_K_M
0.56GB file 2.58GB
Q8_0
1.06GB file 3.08GB

GLM-Z1-9B-0414-heretic_R9_KL0015-gguf

9B 8K ctx
Q4_0
5.06GB file 7.21GB
Q8_0
9.56GB file 11.71GB

granite-3.2-2b-instruct-heretic_R3_K002-gguf

8B 8K ctx
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

granite-3.2-8b-instruct-heretic_R5_K003-q8_0-gguf

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3.2-3B-Instruct-heretic_R5_KL003-bf16-gguf

3B 8K ctx
BF16
6GB file 8.05GB

llama-3.3-8b-instruct-heretic_R7_KL008_q8_0-gguf

8B 8K ctx
Q8_0
8.5GB file 10.63GB

mem-agent-thinking-heretic_R8_KL001-bf16-gguf

16B 8K ctx
BF16
32GB file 34.26GB

ministral_3-3b-instruct-2512-heretic_R3_KL0029-bf16-gguf

3B 8K ctx
BF16
6GB file 8.05GB

phi-4-mini-instruct-heretic_R6_K007_bf16-gguf

16B 8K ctx
BF16
32GB file 34.26GB
K

Kaln Rangelov

1 models

landing-page-gen-1.5b

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
Q8_0
1.59GB file 3.61GB
FP16
3GB file 5.02GB
K

Kalomaze

1 models

Mistral-7b-MoEified-8x

7B 8K ctx
FP16
14GB file 16.11GB
K

Kalpsnuti

1 models

llama-213-chat-gguf

13B 8K ctx
Q5_0
8.94GB file 11.15GB
FP16
26GB file 28.21GB
K

Kalq18

1 models

llama4chan

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
K

Kam1K4Dze

3 models

Llama-3.2-3B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Qwen2.5-0.5B-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB
K

Kamets

1 models

Qwen3.5-0.8B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

0.8B 8K ctx
Q2_K
0.25GB file 2.26GB
Q3_K_L
0.35GB file 2.36GB
Q3_K_M
0.35GB file 2.36GB
Q3_K_S
0.35GB file 2.36GB
Q4_K_M
0.45GB file 2.46GB
Q4_K_S
0.45GB file 2.46GB
Q5_K_M
0.55GB file 2.56GB
Q5_K_S
0.55GB file 2.56GB
Q6_K
0.65GB file 2.66GB
Q8_0
0.85GB file 2.86GB
BF16
1.6GB file 3.61GB
K

Kaminglui

1 models

karin-lora

Unknown 8K ctx
FP16
0GB file 2GB
K

Kanakjr

2 models

homebot-qwen3.5-2b-gguf

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

homebot-qwen3.5-4b-gguf

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB