All Supported Models

29681 AI models · 198875 quantization formats tracked

K

Kartoffel Toby

2 models

Qwen3.6-27B-Claude-Opus-Reasoning-Distilled-GGUF

27B 8K ctx
Q8_0
28.69GB file 31.13GB

Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-Q8_0-GGUF

35B 8K ctx
Q8_0
37.19GB file 39.76GB
K

Kashif0912

1 models

ULTRON-V2

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
K

Kasimat

1 models

Qwen3.6-27B-AEON-Ultimate-Uncensored-GGUF

27B 8K ctx
Q2_K
8.44GB file 10.88GB
Q3_K_M
11.81GB file 14.25GB
Q3_M
11.81GB file 14.25GB
Q4_K_M
15.19GB file 17.63GB
Q4_K_S
15.19GB file 17.63GB
Q4_XS
15.19GB file 17.63GB
Q5_K_M
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB
K

Kask

1 models

llama-3b-finnish-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
K

Kaspar Z

11 models

llama-2-7b-hitl

7B 8K ctx
FP16
14GB file 16.11GB

llama-2-7b-hitl-axolotl

7B 8K ctx
FP16
14GB file 16.11GB

Mistral-7B-v0.1-hitl

7B 8K ctx
FP16
14GB file 16.11GB

mtext-050625_mistral-7B-v0.3_merged

7B 8K ctx
Q8_0
7.44GB file 9.55GB

mtext-111025_mistral-7B-v0.3_merged

7B 8K ctx
Q8_0
7.44GB file 9.55GB

mtext-141024_mistral-7B-v0.1_merged

7B 8K ctx
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB

mtext-20251122_lucie-7b_merged

7B 8K ctx
Q8_0
7.44GB file 9.55GB

mtext-20251122_qwen3-14b-base_merged

14B 8K ctx
Q8_0
14.88GB file 17.11GB

mtext-20251122_qwen3-14b-base_merged_modified_special

14B 8K ctx
Q8_0
14.88GB file 17.11GB

mtext-210525_mistral-7B-v0.1_merged_II

7B 8K ctx
Q8_0
7.44GB file 9.55GB

mtext-250525_mistral-7B-v0.3_merged

7B 8K ctx
Q8_0
7.44GB file 9.55GB
K

Kasper Bankler

1 models

gemma-4-E2B-uncensored

2B 8K ctx
FP16
4GB file 6.03GB
K

Kasukarma

1 models

your-llama-3.1-8b-finetuned-iteration-1

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
K

Kat33

2 models

Llama-3-8B-Instruct-Gradient-1048k-Q6_K-GGUF

8B 8K ctx
Q6_K
6.5GB file 8.63GB

pulchra-c32k-all

Unknown 8K ctx
Q4_K_M
0GB file 2GB
K

Katanemo

11 models

Arch-Agent-1.5B.gguf

1.5B 8K ctx
FP16
3GB file 5.02GB

Arch-Agent-32B.gguf

32B 8K ctx
FP16
64GB file 66.52GB

Arch-Agent-3B.gguf

3B 8K ctx
FP16
6GB file 8.05GB

Arch-Agent-7B.gguf

7B 8K ctx
FP16
14GB file 16.11GB

Arch-Function-1.5B.gguf

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_L
0.66GB file 2.68GB
Q3_K_M
0.66GB file 2.68GB
Q3_K_S
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q4_K_S
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q5_K_S
1.03GB file 3.05GB
Q6_K
1.22GB file 3.24GB

Arch-Function-3B.gguf

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB

Arch-Function-7B.gguf

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB

Arch-Function-Chat-1.5B.gguf

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_L
0.66GB file 2.68GB
Q3_K_M
0.66GB file 2.68GB
Q3_K_S
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q4_K_S
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q5_K_S
1.03GB file 3.05GB
Q6_K
1.22GB file 3.24GB

Arch-Function-Chat-3B.gguf

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB

Arch-Function-Chat-7B.gguf

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB

Arch-Router-1.5B.gguf

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_L
0.66GB file 2.68GB
Q3_K_M
0.66GB file 2.68GB
Q3_K_S
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q4_K_S
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q5_K_S
1.03GB file 3.05GB
Q6_K
1.22GB file 3.24GB
K

Kath Ahegao

8 models

gemma-3-1b-it-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Qwen2.5-3B-Instruct-Q2_K-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
FP16
6GB file 8.05GB

Qwen2.5-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Qwen2.5-3B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Qwen3-1.7B-Q2_K-GGUF

1.7B 8K ctx
Q2_0
0.53GB file 2.56GB
FP16
3.4GB file 5.43GB

Qwen3-1.7B-Q4_K_M-GGUF

1.7B 8K ctx
Q4_0
0.96GB file 2.99GB
FP16
3.4GB file 5.43GB

Qwen3-4B-Instruct-2507-Q2_K-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
FP16
8GB file 10.07GB

Qwen3-4B-Instruct-2507-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB