All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Atmpushout

2 models

Llama-3.2-3B-Instruct-uncensored-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q2_K_L
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q3_K_XL
1.31GB file 3.36GB
Q3_M
1.31GB file 3.36GB
Q3_XS
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_K_L
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q4_XS
1.69GB file 3.74GB
Q5_K_L
2.06GB file 4.11GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q6_K_L
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

supergemma4-26b-uncensored-gguf-v2

26B 8K ctx
Q4_K_M
14.63GB file 17.06GB
A

Atomic Chat

4 models

gemma-4-26B-A4B-it-assistant-GGUF

26B 8K ctx
Q4_K_M
14.63GB file 17.06GB
Q4_K_S
14.63GB file 17.06GB
Q5_K_M
17.88GB file 20.31GB
Q8_0
27.63GB file 30.06GB

gemma-4-31B-it-assistant-GGUF

31B 8K ctx
Q4_K_M
17.44GB file 19.95GB
Q4_K_S
17.44GB file 19.95GB
Q5_K_M
21.31GB file 23.82GB
Q8_0
32.94GB file 35.45GB

gemma-4-E2B-it-assistant-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q8_0
2.13GB file 4.16GB

gemma-4-E4B-it-assistant-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q8_0
4.25GB file 6.32GB
A

Atomic Germ

1 models

gpt-oss-coder-20B-GGUF

20B 8K ctx
FP16
40GB file 42.33GB
A

Attashe

1 models

gemma-2-9b-it-russian-function-calling-GGUF-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB
A

Audreyt

9 models

Breeze-7B-Base-v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Breeze-7B-Instruct-64k-v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

CyberNeurova-DeepSeek-V4-Flash-abliterated-GGUF

Unknown 8K ctx
Q2_0
0GB file 2GB
Q2_K
0GB file 2GB
Q4_0
0GB file 2GB
Q8_0
0GB file 2GB

nemotron-cascade-2-attn-repeat-L5-GGUF

30B 8K ctx
Q4_K_M
16.88GB file 19.37GB

Taiwan-LLaMa-v1.0-GGUF

1.0B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_L
0.44GB file 2.46GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_S
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q5_1
0.69GB file 2.71GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

Taiwan-LLM-13B-v2.0-chat-GGUF

13B 8K ctx
Q3_K_S
5.69GB file 7.9GB
Q4_0
7.31GB file 9.52GB
Q4_1
7.31GB file 9.52GB
Q5_0
8.94GB file 11.15GB
Q5_1
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

Taiwan-LLM-7B-v2.0-chat-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Taiwan-LLM-7B-v2.0.1-chat-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Taiwan-LLM-7B-v2.1-chat-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
A

Augustinpoelmans

1 models

Qwen2.5-Coder-7B-DontTrustMe-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q4_K_M
3.94GB file 6.05GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
A

Aumghag

1 models

ft-llama-3.1-8B-capstone-personifAI-edu-GGUF

8B 8K ctx
FP16
16GB file 18.13GB
A

Aumosita

1 models

ko-platypus-kiwi-13B-Q4_K_M-GGUF

13B 8K ctx
Q4_0
7.31GB file 9.52GB
FP16
26GB file 28.21GB
A

Aungzaythant

3 models

gemma-4-E2B-astrology-v2

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
BF16
4GB file 6.03GB

gemma-4-E2B-astrology-v3

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
BF16
4GB file 6.03GB

gemma-4-E2B-astrology-v4

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
BF16
4GB file 6.03GB
A

Auroraventures

3 models

cipher-sft-merged-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

cipher-sft25-merged-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

cipher-simpo-merged-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB