All Supported Models

29681 AI models · 198875 quantization formats tracked

G

Glyphsoftware

1 models

qwen3.5-9b-opus4.6-distilled

9B 8K ctx
Q4_0
5.06GB file 7.21GB
BF16
18GB file 20.15GB
G

Gmguarino

1 models

eurollm-1b-climateguard-rl-merged-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
G

Gmonsoon

1 models

QwQ-32B-Preview-abliterated-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB
G

Gnayo

1 models

chronicle-llm-v0

Unknown 8K ctx
FP16
0GB file 2GB
G

Gnigguhface

4 models

Hermes-4-14B-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB

Hermes-4.3-36B-Q4_K_M-GGUF

36B 8K ctx
Q4_0
20.25GB file 22.84GB
FP16
72GB file 74.59GB

Hermes-4.3-36B-Q5_K_M-GGUF

36B 8K ctx
Q5_0
24.75GB file 27.34GB
FP16
72GB file 74.59GB

Llama-3.1-8B-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB
G

Gobean

2 models

autotrain-mixtral-8x7b-orpo-v1-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB

autotrain-mixtral-8x7b-orpo-v2-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB
G

Godspeed1006

3 models

Qwen2.5-0.5B-Instruct-Q2_K-GGUF

0.5B 8K ctx
Q2_0
0.16GB file 2.17GB
FP16
1GB file 3.01GB

Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2.5-0.5B-Instruct-Q6_K-GGUF

0.5B 8K ctx
Q6_0
0.41GB file 2.42GB
FP16
1GB file 3.01GB
G

Goekdeniz Guelmez

15 models

dolphin-2.8-gemma-2b_gguf

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_1
1.38GB file 3.41GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

Hyperion-2.0-Mistral-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Hyperion-2.1-Mistral-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

J.O.S.I.E.3-Beta12-7B-slerp-gguf

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB

J.O.S.I.E.3-Beta3-slerp-gguf

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB

josie-3b-v6.0-Q5_K_M-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

josie-7b-v6.0-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1-gguf

0.5B 8K ctx
Q2_K
0.16GB file 2.17GB
Q3_K_L
0.22GB file 2.23GB
Q3_K_M
0.22GB file 2.23GB
Q3_K_S
0.22GB file 2.23GB
Q4_0
0.28GB file 2.29GB
Q4_1
0.28GB file 2.29GB
Q4_K_M
0.28GB file 2.29GB
Q4_K_S
0.28GB file 2.29GB
Q5_0
0.34GB file 2.35GB
Q5_1
0.34GB file 2.35GB
Q5_K_M
0.34GB file 2.35GB
Q5_K_S
0.34GB file 2.35GB
Q6_K
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB

Josiefied-Qwen2.5-14B-Instruct-abliterated-v4-gguf

14B 8K ctx
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q5_1
9.63GB file 11.86GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Josiefied-Qwen2.5-Coder-7B-Instruct-abliterated-v1-gguf

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Josiefied-Qwen3-0.6B-abliterated-v1-gguf

0.6B 8K ctx
Q4_0
0.34GB file 2.35GB
Q5_0
0.41GB file 2.42GB
Q6_0
0.49GB file 2.5GB
Q8_0
0.64GB file 2.65GB
FP16
1.2GB file 3.21GB

Josiefied-Qwen3-1.7B-abliterated-v1-gguf

1.7B 8K ctx
Q4_0
0.96GB file 2.99GB
Q5_0
1.17GB file 3.2GB
Q6_0
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB
FP16
3.4GB file 5.43GB

Josiefied-Qwen3-4B-abliterated-v1-gguf

4B 8K ctx
Q4_0
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
FP16
8GB file 10.07GB

NousResearch-Genstruct-7B-GGUF

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

ThoughtStream-4B-v0.2-gguf

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q2_M
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q3_M
1.75GB file 3.82GB
Q3_XS
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
G

Gog E D

1 models

Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
G

Goingmerry91

1 models

Llama-3.2-3B-Instruct-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q2_K_L
0.94GB file 2.99GB
Q2_K_XL
0.94GB file 2.99GB
Q2_M
0.94GB file 2.99GB
Q2_XXS
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q3_K_XL
1.31GB file 3.36GB
Q3_XXS
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q4_K_XL
1.69GB file 3.74GB
Q4_NL
1.69GB file 3.74GB
Q4_XS
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q5_K_XL
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q6_K_XL
2.44GB file 4.49GB
Q1_M
3GB file 5.05GB
Q1_S
3GB file 5.05GB
Q8_0
3.19GB file 5.24GB
Q8_K_XL
3.19GB file 5.24GB
BF16
6GB file 8.05GB