All Supported Models

29681 AI models · 198875 quantization formats tracked

G

Guo9

1 models

Llama-3.2-3B-Instruct-Q2_K-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
FP16
6GB file 8.05GB
G

Guodayang

2 models

ERNIE-4.5-21B-A3B-Thinking-Q4_K_M-GGUF

21B 8K ctx
Q4_0
11.81GB file 14.15GB
FP16
42GB file 44.34GB

Seed-OSS-36B-Instruct-Q8_0-GGUF

36B 8K ctx
Q8_0
38.25GB file 40.84GB
G

Guray16

1 models

Qwen3-4B-Instruct-2507-20250808-233922-0-i1-GGUF

4B 8K ctx
Q2_XXS
1.25GB file 3.32GB
Q2_M
1.25GB file 3.32GB
Q2_S
1.25GB file 3.32GB
Q2_K_S
1.25GB file 3.32GB
Q2_K
1.25GB file 3.32GB
Q2_XS
1.25GB file 3.32GB
Q3_S
1.75GB file 3.82GB
Q3_XS
1.75GB file 3.82GB
Q3_XXS
1.75GB file 3.82GB
Q3_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_L
1.75GB file 3.82GB
Q4_K_S
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q4_NL
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q4_0
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q1_S
4GB file 6.07GB
Q1_M
4GB file 6.07GB
G

Gurro

1 models

Llama-3.1-8B-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
G

Gus Puffy

1 models

sentient-simulations-pydecompiler-3.7-6.7b-v0.9-GGUF

6.7B 8K ctx
Q2_K
2.09GB file 4.2GB
Q3_K_L
2.93GB file 5.04GB
Q3_K_M
2.93GB file 5.04GB
Q3_K_S
2.93GB file 5.04GB
Q4_0
3.77GB file 5.88GB
Q4_K_M
3.77GB file 5.88GB
Q4_K_S
3.77GB file 5.88GB
Q5_K_M
4.61GB file 6.72GB
Q5_K_S
4.61GB file 6.72GB
Q5_0
4.61GB file 6.72GB
Q6_K
5.44GB file 7.55GB
Q8_0
7.12GB file 9.23GB
G

Gustav098

1 models

BioMistral-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
G

Gvij

1 models

qwen3-0.6b-gguf

0.6B 8K ctx
Q4_0
0.34GB file 2.35GB
Q5_0
0.41GB file 2.42GB
Q8_0
0.64GB file 2.65GB
FP16
1.2GB file 3.21GB
G

Gxnnd

1 models

MT-Gen6fix-gemma-2-9B-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB
G

Gyan A I Systems

1 models

Qwen2.5-3B-Instruct-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
FP16
6GB file 8.05GB
G

Gyroing

1 models

Loxa-3B-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB