All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Abanm

1 models

Dubs-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
A

Abbas8910

1 models

Shiksha-AI

1.5B 8K ctx
FP16
3GB file 5.02GB
A

Abc7347

4 models

Dolphy-1.0-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

Huihui-Qwen3-4B-Instruct-2507-abliterated-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

Llama-3.1-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3.2-3B-Overthinker-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB
A

Abcvvpro

1 models

gemma-4-E4B-it-OBLITERATED

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q8_0
4.25GB file 6.32GB
A

Abdelkareem

1 models

gemma3-ar-toolcall-best-gguf

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB
A

Abderrahman Skiredj1

2 models

GemMaroc-27b-it-GGUF

27B 8K ctx
Q2_K
8.44GB file 10.88GB
Q3_K_L
11.81GB file 14.25GB
Q3_K_M
11.81GB file 14.25GB
Q3_K_S
11.81GB file 14.25GB
Q4_XS
15.19GB file 17.63GB
Q4_K_S
15.19GB file 17.63GB
Q4_K_M
15.19GB file 17.63GB
Q5_K_M
18.56GB file 21GB
Q5_K_S
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB

GemMaroc-4b-tulu-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB
A

Abdoul A I

3 models

gemma-3-1b-it-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

Qwen3-0.6B-GGUF

0.6B 8K ctx
Q2_0
0.19GB file 2.2GB
Q3_0
0.26GB file 2.27GB
Q4_0
0.34GB file 2.35GB
Q5_0
0.41GB file 2.42GB
Q6_0
0.49GB file 2.5GB
Q8_0
0.64GB file 2.65GB

Qwen3-1.7B-GGUF

1.7B 8K ctx
Q2_0
0.53GB file 2.56GB
Q3_0
0.74GB file 2.77GB
Q4_0
0.96GB file 2.99GB
Q5_0
1.17GB file 3.2GB
Q6_0
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB
A

Abdul889

1 models

Qwen2.5-3B-Instruct-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
A

Abdulhanan2006

1 models

WaifuAI-L3-8B-8k-gguf

8B 8K ctx
Q8_0
8.5GB file 10.63GB
A

Abdullah

1 models

AceGPT-7B-chat-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB