All Supported Models

29681 AI models · 198875 quantization formats tracked

K

Kavindu Hansaka

1 models

granite-4.0-h-tiny-gguf

Unknown 8K ctx
Q4_0
0GB file 2GB
K

Kawaimasa

6 models

wanabi_24b_preview_gguf

24B 8K ctx
Q4_0
13.5GB file 15.89GB
FP16
48GB file 50.39GB

wanabi_24b_v1_GGUF

24B 8K ctx
Q4_0
13.5GB file 15.89GB
Q5_0
16.5GB file 18.89GB
Q6_0
19.5GB file 21.89GB
FP16
48GB file 50.39GB

wanabi_24b_v2_GGUF

24B 8K ctx
Q4_K_M
13.5GB file 15.89GB
Q4_XS
13.5GB file 15.89GB
Q5_K_M
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB

wanabi_mini_12b_GGUF

12B 8K ctx
Q4_K_M
6.75GB file 8.95GB
Q4_XS
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

Wanabi-Novelist-12B-GGUF

12B 8K ctx
Q3_K_M
5.25GB file 7.45GB
Q3_XXS
5.25GB file 7.45GB
Q4_K_M
6.75GB file 8.95GB
Q4_XS
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB
BF16
24GB file 26.2GB

Wanabi-Novelist-24B-GGUF

24B 8K ctx
Q3_K_M
10.5GB file 12.89GB
Q3_XXS
10.5GB file 12.89GB
Q4_K_M
13.5GB file 15.89GB
Q4_XS
13.5GB file 15.89GB
Q5_K_M
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB
BF16
48GB file 50.39GB
K

Kawasumi

6 models

Tema_Q-R-4B-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB

Tema_Q-R12.2-GGUF

12.2B 8K ctx
Q4_K_M
6.86GB file 9.06GB

Tema_Q-R3.1-GGUF

3.1B 8K ctx
Q4_K_M
1.74GB file 3.79GB

Tema_Q-R4.2-GGUF

4.2B 8K ctx
Q2_K
1.31GB file 3.38GB
Q4_K_M
2.36GB file 4.43GB
Q5_K_M
2.89GB file 4.96GB

Tema_Q-R7.0-GGUF

12B 8K ctx
Q3_K_S
5.25GB file 7.45GB
Q4_K_M
6.75GB file 8.95GB

Tema_Q-X-GGUF

Unknown 8K ctx
Q3_K_M
0GB file 2GB
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB
K

Kawchar85

3 models

NuminaMath-7B-TIR-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

NuminaMath-7B-TIR-Q6_K-GGUF

7B 8K ctx
Q6_0
5.69GB file 7.8GB
FP16
14GB file 16.11GB

NuminaMath-7B-TIR-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB
K

Kay6888

1 models

DeepSeek-Coder-V2-Lite-Instruct-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q2_M
0GB file 2GB
Q2_S
0GB file 2GB
Q2_XS
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_M
0GB file 2GB
Q3_XS
0GB file 2GB
Q3_XXS
0GB file 2GB
Q4_K_L
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_K_L
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q6_K_L
0GB file 2GB
Q8_0
0GB file 2GB
K

Kayomarz97

1 models

IatrogeniX

2B 8K ctx
Q5_0
1.38GB file 3.41GB
FP16
4GB file 6.03GB
K

Kazu Kita

1 models

gemma-2-9b-it-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB
K

Kbuwel

1 models

kanana-nano-2.1b-base-Q4_K_M-GGUF

2.1B 8K ctx
Q4_0
1.18GB file 3.21GB
FP16
4.2GB file 6.23GB
K

Kcirtapfromspace

1 models

cliniq-gemma4-e2b-unsloth-v62

2B 8K ctx
FP16
4GB file 6.03GB
K

Kebengdou

1 models

Qwen3-Coder-Next-GGUF

57B 8K ctx
Q2_K
17.81GB file 20.74GB
Q2_K_L
17.81GB file 20.74GB
Q2_K_XL
17.81GB file 20.74GB
Q2_XXS
17.81GB file 20.74GB
Q3_K_M
24.94GB file 27.87GB
Q3_K_S
24.94GB file 27.87GB
Q3_K_XL
24.94GB file 27.87GB
Q3_XXS
24.94GB file 27.87GB
Q4_0
32.06GB file 34.99GB
Q4_1
32.06GB file 34.99GB
Q4_K_M
32.06GB file 34.99GB
Q4_K_S
32.06GB file 34.99GB
Q4_K_XL
32.06GB file 34.99GB
Q4_NL
32.06GB file 34.99GB
Q4_XS
32.06GB file 34.99GB
Q5_K_M
39.19GB file 42.12GB
Q5_K_S
39.19GB file 42.12GB
Q5_K_XL
39.19GB file 42.12GB
Q6_K
46.31GB file 49.24GB
Q6_K_XL
46.31GB file 49.24GB
FP4
57GB file 59.93GB
Q1_0
57GB file 59.93GB
Q1_M
57GB file 59.93GB
Q1_S
57GB file 59.93GB
Q8_0
60.56GB file 63.49GB
Q8_K_XL
60.56GB file 63.49GB
BF16
114GB file 116.93GB