All Supported Models

29681 AI models · 198875 quantization formats tracked

K

Kaan35

1 models

Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB
K

Kabachuha

2 models

gemma-2-2b-it-abl-rudpo-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

gemma-2-2b-it-abl-rudpo-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB
K

Kabanovagency

1 models

gemma3-aerophobia-lora

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB
K

Kabotarnet01

1 models

SmolLM2-360M-Instruct-ita-Q2_K-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q2_0
0GB file 2GB
K

Kabriel

2 models

Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
K

Kadzaki

1 models

medgemma-4b-it-french-medical-assistant-Q5_K_M-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
FP16
8GB file 10.07GB
K

Kaetemi

18 models

gemma-2-2b-it-Q4_0-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB

gemma-2-2b-Q4_0-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB

Llama-3.2-3B-Q4_0-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB

Meta-Llama-3-8B-Q2_K-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
FP16
16GB file 18.13GB

Meta-Llama-3-8B-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Meta-Llama-3-8B-Q4_K_M-GGUF-c3o12

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3-8B-Q5_0-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB

Meta-Llama-3.1-8B-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Meta-Llama-3.1-8B-Q4_0-GGUF-old

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Meta-Llama-3.1-8B-Q4_K_M-GGUF-4lc

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Q4_K_M-GGUF-c3o12

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Q4_K_M-GGUF-c3o14

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Q4_K_M-GGUF-old

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Phi-3-mini-4k-instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

Qwen2-7B-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Qwen2.5-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-7B-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB
K

Kafirind17

1 models

dolphin-2.9-llama3-8b-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_S
2.5GB file 4.63GB
Q2_XS
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_K_L
2.5GB file 4.63GB
Q3_K_XL
3.5GB file 5.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q3_S
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_L
4.5GB file 6.63GB
Q4_0
4.5GB file 6.63GB
Q5_K_S
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_L
5.5GB file 7.63GB
Q6_K_L
6.5GB file 8.63GB
Q6_K
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB
K

Kai Os

3 models

Carnice-27b-GGUF

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB

Carnice-9b-GGUF

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

MiroThinker-1.7-mini-Q3_K_M-GGUF

Unknown 8K ctx
Q3_K_M
0GB file 2GB
K

Kaiest

1 models

QuranTafsir_gpt2

Unknown 8K ctx
FP16
0GB file 2GB