All Supported Models

29681 AI models · 198875 quantization formats tracked

K

King Cane

4 models

Astral-Noctra-12B-Q6_K-GGUF

12B 8K ctx
Q6_0
9.75GB file 11.95GB
FP16
24GB file 26.2GB

Dans-PersonalityEngine-V1.2.0-24b-Q4_K_M-GGUF

24B 8K ctx
Q4_0
13.5GB file 15.89GB
FP16
48GB file 50.39GB

Dans-PersonalityEngine-V1.3.0-24b-Q4_K_M-GGUF

24B 8K ctx
Q4_0
13.5GB file 15.89GB
FP16
48GB file 50.39GB

XortronCriminalComputingConfig-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
K

Kingabzpro

2 models

Llama-3.2-3b-it-customer-support

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB

llama-3.2-3b-it-Ecommerce-ChatBot

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
K

Kingcade

1 models

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
K

Kingson H O

4 models

gemma-2-9b-it-Q4_0-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB

Meta-Llama-3-8B-Instruct-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Meta-Llama-3-8B-Instruct-Q5_0-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB

Meta-Llama-3-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
K

Kironlau

1 models

MiniCPM4-8B-IQ4_XS-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
K

Kirp

1 models

TinyLlama-1.1B-Chat-v0.2-gguf

1.1B 8K ctx
Q2_0
0.34GB file 2.36GB
Q3_0
0.48GB file 2.5GB
Q4_0
0.62GB file 2.64GB
Q5_0
0.76GB file 2.78GB
K

Kirstus

1 models

CodeLlama-7b-Instruct-hf

7B 8K ctx
Q8_0
7.44GB file 9.55GB
K

Kitty Cat9 Lives

1 models

Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

27B 8K ctx
Q2_K
8.44GB file 10.88GB
Q3_K_M
11.81GB file 14.25GB
Q3_K_S
11.81GB file 14.25GB
Q4_K_M
15.19GB file 17.63GB
Q4_K_S
15.19GB file 17.63GB
Q8_0
28.69GB file 31.13GB
BF16
54GB file 56.44GB
K

Kjaedhrbgo

2 models

Meta-Llama-3.1-8B-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
K

Kkioikk

8 models

ERNIE-4.5-21B-A3B-Thinking-Q3_K_S-GGUF

21B 8K ctx
Q3_0
9.19GB file 11.53GB
FP16
42GB file 44.34GB

gemma-2-2b-it-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB

gemma-2-9b-it-Q4_K_S-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

glm-4-9b-chat-hf-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

MiniCPM4-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Qwen3-4B-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB

QwQ-32B-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

Seed-Coder-8B-Instruct-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB