All Supported Models

29681 AI models · 198875 quantization formats tracked

M

Melvin56

43 models

DeepScaleR-1.5B-Preview-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_M
0.66GB file 2.68GB
Q3_M
0.66GB file 2.68GB
Q3_S
0.66GB file 2.68GB
Q3_XS
0.66GB file 2.68GB
Q3_XXS
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q4_XS
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

DeepSeek-R1-Distill-Llama-8B-Enkrypt-Aligned-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

DeepSeek-R1-Distill-Qwen-7B-abliterated-v2-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_K_S
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

DeepSeek-R1-ReDistill-Qwen-1.5B-v1.1-GGUF

1.5B 8K ctx
Q3_K_M
0.66GB file 2.68GB
Q4_0
0.84GB file 2.86GB
Q4_K_M
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

DeepSeek-R1-ReDistill-Qwen-7B-v1.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_K_S
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Dria-Agent-a-3B-abliterated-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q2_K_S
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Elita-0.1-Distilled-R1-abliterated-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q2_K_S
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

EXAONE-3.5-2.4B-Instruct-abliterated-IQ4_XS-GGUF

2.4B 8K ctx
Q4_0
1.35GB file 3.39GB
FP16
4.8GB file 6.84GB

EXAONE-3.5-2.4B-Instruct-abliterated-Q2_K-GGUF

2.4B 8K ctx
Q2_0
0.75GB file 2.79GB
FP16
4.8GB file 6.84GB

EXAONE-3.5-7.8B-Instruct-abliterated-IQ4_XS-GGUF

7.8B 8K ctx
Q4_0
4.39GB file 6.52GB
FP16
15.6GB file 17.73GB

GLM-4-9B-0414-abliterated-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_L
3.94GB file 6.09GB
Q3_K_M
3.94GB file 6.09GB
Q3_K_S
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB

GLM-4-9B-0414-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_M
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB

GLM-Z1-9B-0414-abliterated-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_L
3.94GB file 6.09GB
Q3_K_M
3.94GB file 6.09GB
Q3_K_S
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB

GLM-Z1-9B-0414-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_M
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB

Hammer2.1-0.5b-GGUF

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB
Q2_K_S
0.16GB file 2.17GB
Q3_K_M
0.22GB file 2.23GB
Q4_0
0.28GB file 2.29GB
Q4_K_M
0.28GB file 2.29GB
Q5_K_M
0.34GB file 2.35GB
Q6_K
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB

Hammer2.1-1.5b-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q2_K_S
0.47GB file 2.49GB
Q3_K_M
0.66GB file 2.68GB
Q4_0
0.84GB file 2.86GB
Q4_K_M
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

Hammer2.1-3b-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q2_K_S
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Hammer2.1-7b-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_K_S
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

kanana-nano-2.1b-instruct-abliterated-GGUF

2.1B 8K ctx
Q2_K
0.66GB file 2.69GB
Q2_K_S
0.66GB file 2.69GB
Q3_K_M
0.92GB file 2.95GB
Q4_K_M
1.18GB file 3.21GB
Q5_K_M
1.44GB file 3.47GB
Q6_K
1.71GB file 3.74GB
Q8_0
2.23GB file 4.26GB

kanana-nano-2.1b-instruct-GGUF

2.1B 8K ctx
Q2_K
0.66GB file 2.69GB
Q2_K_S
0.66GB file 2.69GB
Q3_K_M
0.92GB file 2.95GB
Q4_K_M
1.18GB file 3.21GB
Q5_K_M
1.44GB file 3.47GB
Q6_K
1.71GB file 3.74GB
Q8_0
2.23GB file 4.26GB

ko-r1-7b-v2.0.3-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q2_K_S
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

MicroThinker-1B-Preview-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

MicroThinker-3B-Preview-Q4_0-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB

MicroThinker-3B-Preview-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Nidum-Llama-3.2-3B-Uncensored-IQ4_XS-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Nidum-Llama-3.2-3B-Uncensored-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Nidum-Llama-3.2-3B-Uncensored-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Phi-4-mini-instruct-abliterated-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q2_K_S
4.38GB file 6.61GB
Q3_K_L
6.13GB file 8.36GB
Q3_K_M
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Phi-4-mini-instruct-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q2_K_S
4.38GB file 6.61GB
Q3_K_L
6.13GB file 8.36GB
Q3_K_M
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Qwen2.5-7B-Instruct-abliterated-v3-IQ4_XS-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-7B-Instruct-abliterated-v3-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

Qwen2.5-7B-Instruct-abliterated-v3-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-Coder-7B-Instruct-abliterated-IQ4_XS-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-Coder-7B-Instruct-abliterated-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-Coder-7B-Instruct-abliterated-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Qwen2.5-Math-1.5B-Instruct-IQ4_XS-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Qwen2.5-Math-1.5B-Instruct-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Qwen3-0.6B-abliterated-GGUF

0.6B 8K ctx
Q2_K
0.19GB file 2.2GB
Q3_K_M
0.26GB file 2.27GB
Q4_K_M
0.34GB file 2.35GB
Q4_XS
0.34GB file 2.35GB
Q5_K_M
0.41GB file 2.42GB
Q6_K
0.49GB file 2.5GB
Q8_0
0.64GB file 2.65GB
BF16
1.2GB file 3.21GB

Qwen3-1.7B-abliterated-GGUF

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q3_K_M
0.74GB file 2.77GB
Q4_K_M
0.96GB file 2.99GB
Q4_XS
0.96GB file 2.99GB
Q5_K_M
1.17GB file 3.2GB
Q6_K
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB
BF16
3.4GB file 5.43GB

Qwen3-4B-abliterated-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Qwen3-4B-ik_GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
Q4_K
2.25GB file 4.32GB
Q5_K
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
BF16
8GB file 10.07GB

Qwen3-8B-abliterated-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

UIGEN-T2-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB
M

Memphi

1 models

typhoon2.1-gemma3-4b-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB
M

Mendrika261

1 models

DeepHat-V1-7B-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
M

Mengmeong

1 models

meng-programming-skill-finetune

0.15B 8K ctx
Q8_0
0.16GB file 2.16GB
FP16
0.3GB file 2.3GB
M

Menlo

4 models

Jan-nano-128k-gguf

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

Jan-nano-gguf

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

Lucy-128k-gguf

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

Lucy-gguf

Unknown 8K ctx
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB
M

Menuthaw98

1 models

Llama-2-7b-chat-hf-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB
M

Merhabalad

1 models

phi-1_5-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB
M

Merlin Safety

1 models

Qwen3.5-4B-Safety-Thinking

4B 8K ctx
Q4_0
2.25GB file 4.32GB
M

Merlinoz11

1 models

Broken-Tutu-24B-Q6_K-GGUF

24B 8K ctx
Q6_0
19.5GB file 21.89GB
FP16
48GB file 50.39GB
M

Merterbak

4 models

Llama-3.2-3B-Instruct-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_1
2.06GB file 4.11GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Mistral-Small-3.1-24B-Instruct-2503-GGUF

24B 8K ctx
Q2_K
7.5GB file 9.89GB
Q3_K_L
10.5GB file 12.89GB
Q3_K_M
10.5GB file 12.89GB
Q3_K_S
10.5GB file 12.89GB
Q4_0
13.5GB file 15.89GB
Q4_1
13.5GB file 15.89GB
Q4_K_M
13.5GB file 15.89GB
Q4_K_S
13.5GB file 15.89GB
Q5_0
16.5GB file 18.89GB
Q5_1
16.5GB file 18.89GB
Q5_K_M
16.5GB file 18.89GB
Q5_K_S
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB

Qwen3-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Trendyol-LLM-7B-chat-v4.1.0-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB