All Supported Models

29681 AI models · 198875 quantization formats tracked

G

Gapsar

3 models

Phi-3-mini-128k-instruct-abliterated-v3-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Qwen1.5-MoE-A2.7B-Chat-Q3_K_M-GGUF

2.7B 8K ctx
Q3_0
1.18GB file 3.22GB
FP16
5.4GB file 7.44GB

Qwen1.5-MoE-A2.7B-Chat-Q3_K_S-GGUF

2.7B 8K ctx
Q3_0
1.18GB file 3.22GB
FP16
5.4GB file 7.44GB
G

Gardeviance

1 models

MS-Gardventure-MW-V1-22B-IQ4_NL-GGUF

22B 8K ctx
Q4_NL
12.38GB file 14.74GB
G

Gardner

2 models

llama-3.2-3b-reflection

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB

OpenCoder-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
G

Gargaz

5 models

brain.ai

Unknown 8K ctx
FP16
0GB file 2GB

Gemma-2b-GGUF

2B 8K ctx
Q5_K_M
1.38GB file 3.41GB

GPT-2-gguf

2B 8K ctx
FP16
4GB file 6.03GB

Llama-2-new-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB

LLAMA2-GOOD-GGUF

Unknown 8K ctx
Q5_K_M
0GB file 2GB
G

Garrofe

2 models

Phi-3.5-mini-instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

Phi-3.5-mini-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB
G

Gaston895

1 models

Qwen3-14B-Claude-4.5-Opus-High-Reasoning-Distill-GGUF

14B 8K ctx
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB
G

Gate369

1 models

Phi-3-mini-128k-instruct-IQ4_XS-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB
G

Gaunernst

1 models

gemma-3-1b-it-int4-gguf

1B 8K ctx
Q4_0
0.56GB file 2.58GB
G

Gaz Trab

1 models

Qwen3.6-27B-MTP-UD-IQ3_XXS-GGUF

27B 8K ctx
Q3_XXS
11.81GB file 14.25GB
G

Gccaxh

1 models

Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_S
3.94GB file 6.09GB
Q3_K_M
3.94GB file 6.09GB
Q3_K_L
3.94GB file 6.09GB
Q4_K_S
5.06GB file 7.21GB
Q4_K_M
5.06GB file 7.21GB
Q5_K_S
6.19GB file 8.34GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB