All Supported Models

29681 AI models · 198875 quantization formats tracked

K

Katopz

2 models

kbtg-kpoint-v1-fused

3B 8K ctx
FP16
6GB file 8.05GB

llama-3-typhoon-v1.5x-8b-instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
K

Katsukiono

2 models

gemma3-270m-pred-dpo

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

gemma3-270m-pred-sft

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
K

Katy The Cutie

5 models

Infracelestial-27B-Q6_K-GGUF

27B 8K ctx
Q6_0
21.94GB file 24.38GB
FP16
54GB file 56.44GB

Infracelestial-7B-Q6_K-GGUF

7B 8K ctx
Q6_0
5.69GB file 7.8GB
FP16
14GB file 16.11GB

Lemonade-RP-0.1-GGUF

0.1B 8K ctx
Q4_K_S
0.06GB file 2.06GB

LemonadeRP-4.5.3-GGUF

5.3B 8K ctx
Q2_K
1.66GB file 3.75GB
Q3_K_L
2.32GB file 4.41GB
Q3_K_M
2.32GB file 4.41GB
Q3_K_S
2.32GB file 4.41GB
Q4_0
2.98GB file 5.07GB
Q4_1
2.98GB file 5.07GB
Q4_K_M
2.98GB file 5.07GB
Q4_K_S
2.98GB file 5.07GB
Q5_K_S
3.64GB file 5.73GB
Q5_K_M
3.64GB file 5.73GB
Q5_1
3.64GB file 5.73GB
Q5_0
3.64GB file 5.73GB
Q6_K
4.31GB file 6.4GB
Q8_0
5.63GB file 7.72GB

qwen-1.8B-guanaco-GGUF

1.8B 8K ctx
Q8_0
1.91GB file 3.94GB
K

Katya228

1 models

xinyuan-llm-14b-0428-heretic-psychology-gguf-q4_0

14B 8K ctx
Q4_0
7.88GB file 10.11GB
K

Kaushalkrishnax

1 models

auroic-router-0.6b

0.6B 8K ctx
Q2_0
0.19GB file 2.2GB
Q3_0
0.26GB file 2.27GB
Q4_0
0.34GB file 2.35GB
Q5_0
0.41GB file 2.42GB
Q6_0
0.49GB file 2.5GB
Q8_0
0.64GB file 2.65GB
K

Kaushall13

1 models

Qwen3.5-9B-GGUF-SBGQ

9B 8K ctx
Q4_XS
5.06GB file 7.21GB
K

Kaushik2202

3 models

diet-advisor-qwen-qlora

8B 8K ctx
FP16
16GB file 18.13GB

lifestyle-advisor-qwen-qlora

8B 8K ctx
FP16
16GB file 18.13GB

medical-advisor-qlora

8B 8K ctx
FP16
16GB file 18.13GB
K

Kaushiksiva07

5 models

Meta-Llama-3-8B-Instruct-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Mistral-7B-Instruct-v0.2-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

Phi-3-mini-4k-instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

Phi-3-mini-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB
K

Kausik A

1 models

Huihui-Qwen3.5-9B-abliterated-GGUF

9B 8K ctx
Q3_K_S
3.94GB file 6.09GB
Q3_K_M
3.94GB file 6.09GB
Q4_0
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q4_K_M
5.06GB file 7.21GB
Q5_K_S
6.19GB file 8.34GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
K

Kaveri Kavita

1 models

llama-3-8b-testcaseGenerator

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB