All Supported Models

29681 AI models · 198875 quantization formats tracked

K

Khetterman

6 models

AbominationScience-12B-v4-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

CursedMatrix-8B-v9-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

DarkAtom-12B-v3-GGUF

12B 8K ctx
Q2_K
3.75GB file 5.95GB
Q3_K_S
5.25GB file 7.45GB
Q3_K_M
5.25GB file 7.45GB
Q3_K_L
5.25GB file 7.45GB
Q4_K_M
6.75GB file 8.95GB
Q4_K_S
6.75GB file 8.95GB
Q4_1
6.75GB file 8.95GB
Q4_0
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q5_K_S
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

Kosmos-8B-v1-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3.2-Kapusta-3B-v8-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Llama-3.2-Kapusta-JapanChibi-3B-v1-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
K

Khjvgvyfc

1 models

Qwen2.5-Coder-7B-Instruct-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB
K

Kholiavko

6 models

18-07-ministral-8b

8B 8K ctx
BF16
16GB file 18.13GB

ministral-8B-13-08-25

8B 8K ctx
Q8_0
8.5GB file 10.63GB

ministral-8B-28-09-25

8B 8K ctx
Q8_0
8.5GB file 10.63GB

ministral-8B-30-10-25

8B 8K ctx
BF16
16GB file 18.13GB

ministral-8B-test

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

ministral-8B-test-new-template

8B 8K ctx
BF16
16GB file 18.13GB
K

Kholil Lil

1 models

wazuh-model

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q8_0
8.5GB file 10.63GB
K

Khulann118

1 models

dipmodel-Qwen2.5-1.5B-merged

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB
K

Khurram123

2 models

Fanar-1-9B-Instruct-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

Qwen-Urdu-Shaheen-7B-Instruct-v1

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
K

Khursani8

1 models

mesollama2v2

Unknown 8K ctx
Q4_K
0GB file 2GB
K

Khushiee

1 models

llama-3.1-8b-instruct-gguf

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
K

Kibble Code

1 models

Qwen3-Coder-Next-GGUF

57B 8K ctx
Q4_K_M
32.06GB file 34.99GB
Q5_K_M
39.19GB file 42.12GB
Q5_0
39.19GB file 42.12GB
Q6_K
46.31GB file 49.24GB
Q8_0
60.56GB file 63.49GB
K

Kichan05

1 models

Novel-Kaguya

1.3B 8K ctx
FP16
2.6GB file 4.62GB