All Supported Models

29681 AI models · 198875 quantization formats tracked

M

Mshojaei77

3 models

Gemma-2-2b-fa

2B 8K ctx
Q8_0
2.13GB file 4.16GB

gemma-2-2b-fa-v2

2B 8K ctx
Q8_0
2.13GB file 4.16GB

gemma-3-4b-persian-v0

4B 8K ctx
Q8_0
4.25GB file 6.32GB
M

Msilich

2 models

ocp416_llama32

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q8_0
8.5GB file 10.63GB

refusal-llama3-8b-gguf

8B 8K ctx
Q8_0
8.5GB file 10.63GB
M

Msimou

4 models

Meta-Llama-3-8B-Instruct-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_K
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_K
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Meta-Llama-3.1-8B-Instruct-GGUF

8B 8K ctx
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_K
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_K
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Qwen2-0.5B-Instruct-GGUF

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB
Q3_K_L
0.22GB file 2.23GB
Q3_K_M
0.22GB file 2.23GB
Q3_K_S
0.22GB file 2.23GB
Q4_K_M
0.28GB file 2.29GB
Q4_K_S
0.28GB file 2.29GB
Q5_K_M
0.34GB file 2.35GB
Q5_K_S
0.34GB file 2.35GB
Q6_K
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB

Qwen2-7B-Instruct-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
M

Msu Rcc Lair

1 models

RuadaptQwen2.5-32B-instruct-GGUF

32B 8K ctx
Q2_K
10GB file 12.52GB
Q3_K_M
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_K_M
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_K_M
22GB file 24.52GB
Q6_K
26GB file 28.52GB
Q8_0
34GB file 36.52GB
M

Mswaringen

1 models

GritLM-7B-GGUF-quantized

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q8_0
7.44GB file 9.55GB
M

Msyu1020

15 models

gemma-3-1b-it-Q3_K_M-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
FP16
2GB file 4.02GB

gemma-3-1b-it-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

gemma-3-1b-it-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

Llama-2-7b-chat-hf-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

Llama-2-7b-chat-hf-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-7B-Instruct-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

Qwen2.5-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen3-1.7B-Q3_K_M-GGUF

1.7B 8K ctx
Q3_0
0.74GB file 2.77GB
FP16
3.4GB file 5.43GB

Qwen3-1.7B-Q4_K_M-GGUF

1.7B 8K ctx
Q4_0
0.96GB file 2.99GB
FP16
3.4GB file 5.43GB

Qwen3-1.7B-Q5_K_M-GGUF

1.7B 8K ctx
Q5_0
1.17GB file 3.2GB
FP16
3.4GB file 5.43GB

Qwen3-4B-Instruct-2507-Q3_K_M-GGUF

4B 8K ctx
Q3_0
1.75GB file 3.82GB
FP16
8GB file 10.07GB

Qwen3-4B-Instruct-2507-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

Qwen3-4B-Instruct-2507-Q5_K_M-GGUF

4B 8K ctx
Q5_0
2.75GB file 4.82GB
FP16
8GB file 10.07GB

Qwen3-8B-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Qwen3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
M

Msyukorai

10 models

gemma-2-2b-it-Q4_0-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB

granite-3.1-2b-instruct-Q4_0-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB

granite-3.1-8b-instruct-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

granite-3.2-8b-instruct-preview-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

granite-3b-code-instruct-128k-Q4_0-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB

Llama-3.2-3B-Instruct-Q4_0-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB

phi-4-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

SmolLM2-1.7B-Instruct-Q4_0-GGUF

1.7B 8K ctx
Q4_0
0.96GB file 2.99GB

YuE-s1-7B-anneal-en-cot-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

YuE-s2-1B-general-Q4_0-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
M

Mtamplier

1 models

gemma-2-2b-it-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB
M

Mtr666

1 models

gemma-4-E4B-it-OBLITERATED

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q8_0
4.25GB file 6.32GB
M

Mtrajan

1 models

sarvam-30b-GGUF

30B 8K ctx
Q4_0
16.88GB file 19.37GB
FP16
60GB file 62.49GB