All Supported Models

29681 AI models · 198875 quantization formats tracked

G

Gplsi

2 models

Aitana-2B-S-base-1.0

2B 8K ctx
BF16
4GB file 6.03GB

Aitana-2B-S-tourism-base-1.0

2B 8K ctx
FP16
4GB file 6.03GB
G

Gpugobrrr

1 models

Qwen3-0.6B-Farsi-GGUF

0.6B 8K ctx
Q3_K_S
0.26GB file 2.27GB
Q4_0
0.34GB file 2.35GB
Q4_K_M
0.34GB file 2.35GB
Q6_K
0.49GB file 2.5GB
Q8_0
0.64GB file 2.65GB
BF16
1.2GB file 3.21GB
G

Gpustack

1 models

Llama-3.2-3B-Instruct-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_K_M
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB
FP16
6GB file 8.05GB
G

Grabaketak

1 models

Latxa-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
G

Grabbe Gymnasium Detmold

5 models

grabbe-ai

Unknown 8K ctx
Q8_0
0GB file 2GB
Q4_K_M
0GB file 2GB

grabbe-ai-2b

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

grabbe-ai-llama-3.2-3b

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB

grabbe-ai-mistral-nemo

12B 8K ctx
Q4_K_M
6.75GB file 8.95GB
Q8_0
12.75GB file 14.95GB

grabbe-ai-qwen2.5-3b

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
G

Grace Zhang48

7 models

Llama-3.2-1B-Instruct-Q5_0-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB

Llama-3.2-1B-Q3_K_M-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
FP16
2GB file 4.02GB

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Phi-4-mini-instruct-Q2_K-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
FP16
28GB file 30.23GB

Phi-4-mini-instruct-Q3_K_M-GGUF

14B 8K ctx
Q3_0
6.13GB file 8.36GB
FP16
28GB file 30.23GB

Phi-4-mini-instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

Phi-4-mini-reasoning-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB
G

Grach0

1 models

Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

35B 8K ctx
Q4_K_M
19.69GB file 22.26GB
Q5_K_M
24.06GB file 26.63GB
Q6_K
28.44GB file 31.01GB
Q8_0
37.19GB file 39.76GB
G

Grah Lnn

1 models

Hy-MT2-30B-A3B-4bit-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q3_K_M
13.13GB file 15.62GB
Q4_K_M
16.88GB file 19.37GB
G

Grassblade

1 models

Llama-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
G

Gravit295

1 models

dotcode-1-mini-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB