All Supported Models

29681 AI models · 198875 quantization formats tracked

G

Gia Uh

2 models

cecilia-2b-instruct-v1

2B 8K ctx
FP16
4GB file 6.03GB

cecilia-2b-instruct-v1-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
G

Gianloko

1 models

apex-coder-1.5b-GGUF

1.5B 8K ctx
Q4_K_M
0.84GB file 2.86GB
G

Gianni D P C

2 models

Qwen3.6-27B-IQ4_NL-with-MTP-GGUF

27B 8K ctx
Q4_NL
15.19GB file 17.63GB

Qwen3.6-27B-IQ4_XS-pure-with-MTP-GGUF

27B 8K ctx
Q4_XS
15.19GB file 17.63GB
G

Giannisan

1 models

dolphin-mixtral-2x7b

7B 8K ctx
FP16
14GB file 16.11GB
G

Gianson

1 models

sygnif-lora-v3

9B 8K ctx
FP16
18GB file 20.15GB
G

Gideon531

4 models

Huihui-Qwen3-8B-abliterated-v2-Q5_0-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB

Huihui-Qwen3-8B-abliterated-v2-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

MiniCPM4.1-8B-Q3_K_L-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

MiniCPM4.1-8B-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB
G

Gidigi

1 models

gidigi_54caa91a_0002

32B 8K ctx
Q2_0
10GB file 12.52GB
Q3_0
14GB file 16.52GB
FP16
64GB file 66.52GB
G

Giip

1 models

Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
G

Gijl

1 models

ai

Unknown 8K ctx
FP16
0GB file 2GB
G

Giladgd

7 models

Apertus-70B-Instruct-2509-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_S
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_L
30.63GB file 33.78GB
Q4_K_S
39.38GB file 42.53GB
Q4_K_M
39.38GB file 42.53GB
Q4_0
39.38GB file 42.53GB
Q5_K_S
48.13GB file 51.28GB
Q5_0
48.13GB file 51.28GB
Q5_K_M
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
FP4
70GB file 73.15GB
Q8_0
74.38GB file 77.53GB

Apertus-8B-Instruct-2509-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_L
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
FP4
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB

gpt-oss-120b-GGUF

120B 8K ctx
FP4
120GB file 123.97GB

gpt-oss-20b-GGUF

20B 8K ctx
FP4
20GB file 22.33GB

Qwen3-4B-Thinking-2507-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q4_K_S
2.25GB file 4.32GB
Q4_0
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Qwen3-Coder-30B-A3B-Instruct-Q4_K_M-GGUF

30B 8K ctx
Q4_0
16.88GB file 19.37GB
FP16
60GB file 62.49GB

Seed-OSS-36B-Instruct-GGUF

36B 8K ctx
Q2_K
11.25GB file 13.84GB
Q3_K_S
15.75GB file 18.34GB
Q3_K_L
15.75GB file 18.34GB
Q3_K_M
15.75GB file 18.34GB
Q4_K_M
20.25GB file 22.84GB
Q4_K_S
20.25GB file 22.84GB
Q4_0
20.25GB file 22.84GB
Q5_0
24.75GB file 27.34GB
Q5_K_S
24.75GB file 27.34GB
Q5_K_M
24.75GB file 27.34GB
Q6_K
29.25GB file 31.84GB
FP4
36GB file 38.59GB
Q8_0
38.25GB file 40.84GB