All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Asdgad

3 models

Qwen3-Coder-30B-A3B-Instruct-Q4_K_M-GGUF

30B 8K ctx
Q4_0
16.88GB file 19.37GB
FP16
60GB file 62.49GB

QwQ-32B-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

VibeThinker-1.5B-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB
A

Asdwvv

2 models

kanana-1.5-15.7b-a3b-instruct-Q4_K_M-GGUF

15.7B 8K ctx
Q4_0
8.83GB file 11.09GB
FP16
31.4GB file 33.66GB

Smoothie-Qwen3-32B-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB
A

Asedmammad

3 models

gemma-2b-it-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_1
1.38GB file 3.41GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

gemma-7b-it-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

PersianMind-v1.0-GGUF

1.0B 8K ctx
Q2_K
0.31GB file 2.33GB
Q3_K_L
0.44GB file 2.46GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_S
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q5_K_S
0.69GB file 2.71GB
Q5_K_M
0.69GB file 2.71GB
Q5_0
0.69GB file 2.71GB
Q5_1
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
A

Asgaae

2 models

gemma-2-2b-it-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

gemma-2-9b-it-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB
A

Ash 412001

5 models

Llama-3.1-8B-Instruct-Q2_K-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3.2-1B-Instruct-IQ4_NL-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Meta-Llama-3-8B-Instruct-IQ4_NL-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3-8B-Instruct-Q2_K-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
FP16
16GB file 18.13GB
A

Ash Riple

1 models

Qwen2-0.5B-Q4_0-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
A

Ash1Shkushwaha

1 models

GLM-4.7-Flash-Uncensored-Heretic-NEO-CODE-Imatrix-MAX-GGUF

Unknown 8K ctx
Q2_M
0GB file 2GB
Q8_0
0GB file 2GB
Q6_K
0GB file 2GB
Q5_K_S
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_1
0GB file 2GB
Q4_XS
0GB file 2GB
Q4_NL
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_1
0GB file 2GB
Q3_M
0GB file 2GB
A

Ash2813

1 models

llm-jp-4-32b-a3b-thinking-gguf

32B 8K ctx
Q4_K_M
18GB file 20.52GB
A

Ashaaz

1 models

Aeon-14B-Instruct-v1

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB
A

Ashank Gupta

1 models

tinyllama-email-reply

1.1B 8K ctx
Q4_K_M
0.62GB file 2.64GB