All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Anikifoss

13 models

DeepSeek-R1-0528-DQ4_K_R4

671B 8K ctx
Q4_K_R4
377.44GB file 390.43GB

DeepSeek-V3.1-HQ4_K

236B 8K ctx
Q4_K
132.75GB file 138.62GB

DeepSeek-V3.1-Terminus-HQ4_K

236B 8K ctx
Q4_K
132.75GB file 138.62GB

GLM-4.5-Air-HQ4_K

Unknown 8K ctx
Q4_K
0GB file 2GB

GLM-4.5-HQ4_K

Unknown 8K ctx
Q4_K
0GB file 2GB

GLM-4.6-HQ4_K

Unknown 8K ctx
Q4_K
0GB file 2GB

Kimi-K2-Instruct-0905-HQ4_K

2B 8K ctx
Q4_K
1.13GB file 3.16GB

Kimi-K2-Instruct-DQ4_K

2B 8K ctx
Q4_K
1.13GB file 3.16GB

MiniMax-M2-HQ4_K

Unknown 8K ctx
Q4_K
0GB file 2GB

MiniMax-M2.1-HQ4_K-GGUF

Unknown 8K ctx
Q4_K
0GB file 2GB

Qwen3-235B-A22B-Instruct-2507-HQ4_K

235B 8K ctx
Q4_K
132.19GB file 138.04GB

Qwen3-235B-A22B-Thinking-2507-HQ4_K

235B 8K ctx
Q4_K
132.19GB file 138.04GB

Qwen3-Coder-480B-A35B-Instruct-HQ4_K

480B 8K ctx
Q4_K
270GB file 279.86GB
A

Anilguven

9 models

Llama3.1-8b-TrSummarization-unsloth-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama3.2-1b-instruct-OpenOrcaTr-unsloth-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB
Q8_0
1.06GB file 3.08GB

Llama3.2-1b-InstrucTurca-tr-unsloth-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB
Q8_0
1.06GB file 3.08GB

Llama3.2-1b-TrSummarization-unsloth-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB
Q8_0
1.06GB file 3.08GB

Llama3.2-3b-instruct-OpenOrcaTr-unsloth-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q8_0
3.19GB file 5.24GB

Llama3.2-3b-InstrucTurca-tr-unsloth

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q8_0
3.19GB file 5.24GB

Llama3.2-3b-TrSummarization-unsloth-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q8_0
3.19GB file 5.24GB

Qwen2.5-0.5B-TrSummarization-unsloth-GGUF

0.5B 8K ctx
Q4_K_M
0.28GB file 2.29GB
Q8_0
0.53GB file 2.54GB

Qwen2.5-1.5B-TrSummarization-unsloth-GGUF

1.5B 8K ctx
Q4_K_M
0.84GB file 2.86GB
Q8_0
1.59GB file 3.61GB
A

Aniljava

1 models

Meta-Llama-3.1-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q8_0
8.5GB file 10.63GB
A

Anime Sssh

2 models

granite-3.0-8b-instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

granite-guardian-3.0-8b-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
A

Anir 1995

1 models

ministral-safety-gguf

3B 8K ctx
FP16
6GB file 8.05GB
A

Aniris

1 models

Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB
A

Anirudh J M24

1 models

Llama3-ChatQA-1.5-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
A

Anishproshort

1 models

llama3_ft

Unknown 8K ctx
FP16
0GB file 2GB
A

Ankandrew

1 models

cogito-v1-preview-llama-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
A

Ankitajadhav

1 models

Phi-3-mini-4k-instruct-q4.gguf

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB