All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Abhinav S E

1 models

Meta-Llama-3-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
A

Abhinav Tyagi

1 models

synapse-slm

3B 8K ctx
FP16
6GB file 8.05GB
A

Abhinav0231

1 models

Lily-1.5b-v0.1-GGUF

1.5B 8K ctx
Q4_K_M
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q8_0
1.59GB file 3.61GB
A

Abhishek Venkatachalam06

11 models

Phi-3-mini-128k-instruct-Q2_K-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB

Phi-3-mini-128k-instruct-Q3_K_L-GGUF

3.8B 8K ctx
Q3_K_L
1.66GB file 3.72GB

Phi-3-mini-128k-instruct-Q3_K_M-GGUF

3.8B 8K ctx
Q3_K_M
1.66GB file 3.72GB

Phi-3-mini-128k-instruct-Q3_K_S-GGUF

3.8B 8K ctx
Q3_K_S
1.66GB file 3.72GB

Phi-3-mini-128k-instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

Phi-3-mini-128k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_K_M
2.14GB file 4.2GB

Phi-3-mini-128k-instruct-Q4_K_S-GGUF

3.8B 8K ctx
Q4_K_S
2.14GB file 4.2GB

Phi-3-mini-128k-instruct-Q5_0-GGUF

0B 8K ctx
Q5_0
0GB file 2GB

Phi-3-mini-128k-instruct-Q5_K_M-GGUF

3.8B 8K ctx
Q5_K_M
2.61GB file 4.67GB

Phi-3-mini-128k-instruct-Q5_K_S-GGUF

3.8B 8K ctx
Q5_K_S
2.61GB file 4.67GB

Phi-3-mini-128k-instruct-Q6_K-GGUF

3.8B 8K ctx
Q6_K
3.09GB file 5.15GB
A

Abhishekbhakat

1 models

stella_en_1.5B_v5_GGUF

1.5B 8K ctx
FP16
3GB file 5.02GB
A

Abirami1213

1 models

unslothMeta-Llama-3.1-8B

8B 8K ctx
FP16
16GB file 18.13GB
A

Abiray

22 models

Assistant-100M-Guardian

Unknown 8K ctx
FP16
0GB file 2GB

gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

31B 8K ctx
Q3_K_M
13.56GB file 16.07GB
Q4_K_M
17.44GB file 19.95GB
Q5_K_M
21.31GB file 23.82GB
Q6_K
25.19GB file 27.7GB
Q8_0
32.94GB file 35.45GB

gemma-4-31B-it-Claude-Opus-Distill-GGUF

31B 8K ctx
Q3_K_M
13.56GB file 16.07GB
Q4_K_M
17.44GB file 19.95GB
Q5_K_M
21.31GB file 23.82GB
Q6_K
25.19GB file 27.7GB
Q8_0
32.94GB file 35.45GB
BF16
62GB file 64.51GB

gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-GGUF

4B 8K ctx
Q3_K_M
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

gemma-4-E4B-it-OBLITERATED-GGUF

4B 8K ctx
Q3_K_M
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

gemma-4-E4B-it-The-DECKARD-HERETIC-UNCENSORED-Thinking-GGUF

4B 8K ctx
Q3_K_M
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Huihui-Ministral-3B-Instruct-2512-abliterated-GGUF

3B 8K ctx
Q3_K_M
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Huihui-Qwen3.5-9B-abliterated-GGUF

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

Huihui-Qwen3.6-27B-abliterated-GGUF

27B 8K ctx
Q3_K_M
11.81GB file 14.25GB
Q4_K_M
15.19GB file 17.63GB
Q4_K_S
15.19GB file 17.63GB
Q5_K_M
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB

Huihui-Qwen3.6-27B-abliterated-Q4_K_M-GGUF

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB

Josiefied-Qwen3.5-0.8B-gabliterated-v1-GGUF

0.8B 8K ctx
Q4_K_M
0.45GB file 2.46GB
Q6_K
0.65GB file 2.66GB
Q8_0
0.85GB file 2.86GB

LocoTrainer-4B-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

MiniMax-M2.7-Q3_K_M-GGUF

Unknown 8K ctx
Q3_K_M
0GB file 2GB

MiniMax-M2.7-Q4_K_M-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB

Mistral-Medium-3.5-128B-Q4_K_M-GGUF

128B 8K ctx
Q4_K_M
72GB file 76.1GB

Qwen3-30B-A3B-Instruct-2507-REAM-heretic-GGUF

30B 8K ctx
Q3_K_M
13.13GB file 15.62GB
Q4_K_M
16.88GB file 19.37GB
Q5_K_M
20.63GB file 23.12GB
Q6_K
24.38GB file 26.87GB
Q8_0
31.88GB file 34.37GB

Qwen3.5-4B-Python-Coder-GGUF

4B 8K ctx
Q3_K_M
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Qwen3.6-27B-AEON-Ultimate-Uncensored-GGUF

27B 8K ctx
Q3_0
11.81GB file 14.25GB
Q3_K_M
11.81GB file 14.25GB
Q4_0
15.19GB file 17.63GB
Q4_K_M
15.19GB file 17.63GB
Q4_K_S
15.19GB file 17.63GB
Q5_0
18.56GB file 21GB
Q5_K_M
18.56GB file 21GB
Q6_0
21.94GB file 24.38GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB
BF16
54GB file 56.44GB

Qwen3.6-27B-heretic-ARA-GGUF

27B 8K ctx
Q3_K_M
11.81GB file 14.25GB
Q4_K_M
15.19GB file 17.63GB
Q4_K_S
15.19GB file 17.63GB
Q5_K_M
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB

supergemma4-e4b-abliterated-GGUF

4B 8K ctx
Q3_K_M
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Sutra-Instruct-350M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_K_M
0GB file 2GB
Q8_0
0GB file 2GB

ZAYA1-8B-GGUF

8B 8K ctx
Q3_K_M
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
A

Abirhossen

1 models

Qwen3-Coder-30B-A3B-Instruct-Q8_0-GGUF

30B 8K ctx
Q8_0
31.88GB file 34.37GB
A

Abobasnik

1 models

HiperAI-v2.4-14.5B-UP

14.5B 8K ctx
Q4_K_M
8.16GB file 10.4GB
A

Abody0055

1 models

Qwen2.5-0.5B-Instruct-Q2_K-GGUF

0.5B 8K ctx
Q2_0
0.16GB file 2.17GB
FP16
1GB file 3.01GB