All Supported Models

29681 AI models · 198875 quantization formats tracked

K

Kota123

1 models

gemma-7b

7B 8K ctx
FP16
14GB file 16.11GB
K

Kowlick

5 models

Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Phi-3-mini-128k-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Qwen2-72B-Instruct-Q4_K_M-GGUF

72B 8K ctx
Q4_0
40.5GB file 43.68GB
FP16
144GB file 147.18GB

Qwen2-72B-Instruct-Q4_K_S-GGUF

72B 8K ctx
Q4_0
40.5GB file 43.68GB
FP16
144GB file 147.18GB

Qwen2-7B-Instruct-Q4_K_S-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
K

Kozynthetaquito

1 models

Dolphin-Mistral-24B-Venice-Edition-exl2-6bpw-Q4_K_M-GGUF

24B 8K ctx
Q4_0
13.5GB file 15.89GB
FP16
48GB file 50.39GB
K

Kpd81

1 models

supergemma4-26b-uncensored-gguf-v2

26B 8K ctx
Q4_K_M
14.63GB file 17.06GB
K

Kpkiosk66

2 models

llama-3-typhoon-v1.5-8b-instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

typhoon2.5-qwen3-30b-a3b-Q4_K_M-GGUF

30B 8K ctx
Q4_0
16.88GB file 19.37GB
FP16
60GB file 62.49GB
K

Kpranav22

1 models

Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
K

Kpsok

1 models

Qwen3-24B-A4B-Freedom-HQ-Thinking-Abliterated-Heretic-NEOMAX-Imatrix-GGUF

4B 8K ctx
Q2_M
1.25GB file 3.32GB
Q3_M
1.75GB file 3.82GB
Q4_XS
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
K

Kquant03

2 models

BioMistral-7B-TIES-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

TechxGenus-starcoder2-15b-instruct-GGUF

15B 8K ctx
Q2_0
4.69GB file 6.94GB
Q3_0
6.56GB file 8.81GB
Q4_0
8.44GB file 10.69GB
Q5_0
10.31GB file 12.56GB
Q6_0
12.19GB file 14.44GB
Q8_0
15.94GB file 18.19GB
FP16
30GB file 32.25GB
K

Kr4Phy

9 models

gemma-3-270m-Q2_K-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
FP16
2GB file 4.02GB

gemma-3-270m-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

kanana-1.5-8b-instruct-2505-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Midm-2.0-Base-Instruct-Q4_K_M-GGUF

2.0B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

Midm-2.0-Mini-Instruct-Q2_K-GGUF

Unknown 8K ctx
Q2_0
0GB file 2GB
FP16
0GB file 2GB

Midm-2.0-Mini-Instruct-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB

Qwen3-0.6B-Q4_K_M-GGUF

0.6B 8K ctx
Q4_0
0.34GB file 2.35GB
FP16
1.2GB file 3.21GB

SmolLM2-135M-Instruct-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB

SmolLM2-135M-Instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
K

Kramp

1 models

ruvltra-claude-code

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB