All Supported Models

29681 AI models · 198875 quantization formats tracked

G

Grc Iit

1 models

llama31-8b-aurora-chat-v3-gguf

8B 8K ctx
FP16
16GB file 18.13GB
G

Greasert

1 models

amoral-gemma3-12B-v2-Q8_0-GGUF

12B 8K ctx
Q8_0
12.75GB file 14.95GB
G

Greellow343

1 models

Huihui-Qwen3-8B-abliterated-v2-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
G

Green Eyed Devil

9 models

Monika-106B-GGUFs

106B 8K ctx
Q2_0
33.13GB file 36.87GB
Q3_K_M
46.38GB file 50.12GB
Q4_K_M
59.63GB file 63.37GB
Q5_K_M
72.88GB file 76.62GB
Q6_K
86.13GB file 89.87GB
Q1_0
106GB file 109.74GB

Monika-122B

122B 8K ctx
Q3_K_M
53.38GB file 57.38GB
Q4_K_M
68.63GB file 72.63GB
Q5_K_M
83.88GB file 87.88GB
Q6_K
99.13GB file 103.13GB
BF16
244GB file 248GB

Monika-12B-GGUFs

12B 8K ctx
Q4_K_M
6.75GB file 8.95GB
Q6_K
9.75GB file 11.95GB

Monika-12B-V1.1-GGUFs

12B 8K ctx
Q4_K_M
6.75GB file 8.95GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

Monika-24B-GGUFs

24B 8K ctx
Q4_K_M
13.5GB file 15.89GB
Q6_K
19.5GB file 21.89GB

Monika-49B-GGUFs

49B 8K ctx
Q4_K_M
27.56GB file 30.36GB
Q6_K
39.81GB file 42.61GB
Q8_0
52.06GB file 54.86GB

Monika-70B-GGUFs

70B 8K ctx
Q4_K_M
39.38GB file 42.53GB
Q6_K
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB

Monika-8B-GGUFs

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB

Monika-9B

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
BF16
18GB file 20.15GB
G

Green Map

2 models

qwen3.5-2b-ru-json-extractor-GGUF

2B 8K ctx
BF16
4GB file 6.03GB

qwen3.5-2b-ru-norm-link-extractor-GGUF

2B 8K ctx
BF16
4GB file 6.03GB
G

Green Sky

1 models

Ernie-Image-Prompt-Enhancer-Ministral-3B-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB
G

Greenwich157

7 models

Llama-3.1-Minitron-4B-Width-Base-Q4_0-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB

Llama-3.2-3B-Q4_0-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB

OTel-LLM-1B-IT-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

OTel-LLM-1B-IT-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

OTel-LLM-20B-IT-Q4_K_M-GGUF

20B 8K ctx
Q4_0
11.25GB file 13.58GB
FP16
40GB file 42.33GB

OTel-LLM-20B-Reasoning-Q8_0-GGUF

20B 8K ctx
Q8_0
21.25GB file 23.58GB

Qwen2.5-1.5B-Q4_0-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
G

Gregor Biswanger

1 models

GritLM-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
G

Greninja Op

1 models

ipc-legal-assistant-qwen35

32B 8K ctx
Q8_0
34GB file 36.52GB
FP16
64GB file 66.52GB
G

Grey Manul

1 models

MiniMax-M2.7-Abliterated-Heretic-GGUF-UD

Unknown 8K ctx
Q4_XS
0GB file 2GB