All Supported Models

29681 AI models · 198875 quantization formats tracked

K

Komrxn

1 models

LegAI_beta_v0.2_Q4_K_M

Unknown 8K ctx
Q4_K_M
0GB file 2GB
K

Kondara

26 models

gemma-2-2b-it-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

gemma-2-2b-it-Q6_K-GGUF

2B 8K ctx
Q6_0
1.63GB file 3.66GB
FP16
4GB file 6.03GB

gemma-2-2b-it-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB

gemma-2-9b-it-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

gemma-2-9b-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

internlm2_5-1_8b-chat-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

internlm2_5-1_8b-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

internlm2_5-20b-Q4_K_M-GGUF

20B 8K ctx
Q4_0
11.25GB file 13.58GB
FP16
40GB file 42.33GB

internlm2_5-7b-chat-1m-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Llama-3.2-1B-Instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Instruct-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Instruct-Q6_K-GGUF

3B 8K ctx
Q6_0
2.44GB file 4.49GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Instruct-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Meta-Llama-3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Phi-3-medium-128k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3-medium-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3-mini-128k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3-mini-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Qwen2-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-7B-Instruct-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen3-14B-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
K

Kono Zio Da

1 models

php-java-code-vuln-detector

Unknown 8K ctx
FP16
0GB file 2GB
K

Konpep

1 models

Aether-Coder-v2.0-GGUF

1.7B 8K ctx
FP16
3.4GB file 5.43GB
K

Konz00

7 models

Cetus-Sea-7b-128k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Echidna-7b-128k-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

EvilxEchidna-7b-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Hex-Macaroniac-7b-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Kunocchini-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Pasta-Lake-7b-GGUF

7B 8K ctx
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Toppy-M2-7B-GGUF

7B 8K ctx
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
K

Koolen Dasheppi

1 models

gpt-oss-20b-heretic-v2-Q5_K_M-GGUF

20B 8K ctx
Q5_0
13.75GB file 16.08GB
FP16
40GB file 42.33GB
K

Kooten

3 models

DaringMaid-13B-GGUF

13B 8K ctx
Q3_K_M
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q5_K_M
8.94GB file 11.15GB

DaringMaid-20B-GGUF

20B 8K ctx
Q2_XS
6.25GB file 8.58GB
Q2_XXS
6.25GB file 8.58GB
Q3_K_M
8.75GB file 11.08GB
Q4_K_M
11.25GB file 13.58GB
Q5_K_M
13.75GB file 16.08GB

DaringMaid-20B-V1.1-GGUF

20B 8K ctx
Q3_K_M
8.75GB file 11.08GB
Q4_K_M
11.25GB file 13.58GB
Q5_K_M
13.75GB file 16.08GB
Q6_K
16.25GB file 18.58GB
K

Korea Virtual Reality

1 models

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
K

Korkmazemin1

1 models

gguf_gemma

4B 8K ctx
Q8_0
4.25GB file 6.32GB
K

Kostakoff

2 models

Mixtral-8x7B-Instruct-v0.1-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q8_0
7.44GB file 9.55GB

Qwen3-Coder-Next-GGUF

57B 8K ctx
Q4_K_M
32.06GB file 34.99GB
Q5_0
39.19GB file 42.12GB
Q5_K_M
39.19GB file 42.12GB
Q6_K
46.31GB file 49.24GB
Q8_0
60.56GB file 63.49GB