All Supported Models

29681 AI models · 198875 quantization formats tracked

G

Gimling

1 models

Qwen1.5-14B-Chat-Q4_0-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
G

Gincy

1 models

mistral7b-finetuned-second-llm

7B 8K ctx
FP16
14GB file 16.11GB
G

Gingdev

4 models

gemma2b-qlora-ictu

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

ictu-vinallama-gguf

Unknown 8K ctx
FP16
0GB file 2GB

llama7b-ictu

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

llama7b-ictu-v2

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
G

Giocorte

1 models

travis-qwen3-4b

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
G

Giordano Lucas T

1 models

model

Unknown 8K ctx
Q8_0
0GB file 2GB
Q5_K_M
0GB file 2GB
Q4_K_M
0GB file 2GB
G

Giux78

1 models

zefiro-7b-beta-ITA-v0.1-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
G

Gjlaubenstein

2 models

grep-adapter-F16-GGUF

4B 8K ctx
FP16
8GB file 10.07GB

grep-adapter-v2-F16-GGUF

16B 8K ctx
FP16
32GB file 34.26GB
G

Gkf123

1 models

Nanbeige4.1-3B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
G

Gkraker04

1 models

Ornstein-Hermes-3.6-27B-SABER

27B 8K ctx
Q2_K
8.44GB file 10.88GB
Q2_K_S
8.44GB file 10.88GB
Q2_S
8.44GB file 10.88GB
Q3_K_L
11.81GB file 14.25GB
Q3_K_S
11.81GB file 14.25GB
Q3_M
11.81GB file 14.25GB
Q3_S
11.81GB file 14.25GB
Q3_XS
11.81GB file 14.25GB
Q3_XXS
11.81GB file 14.25GB
Q4_0
15.19GB file 17.63GB
Q4_1
15.19GB file 17.63GB
Q4_K_S
15.19GB file 17.63GB
Q4_NL
15.19GB file 17.63GB
Q5_0
18.56GB file 21GB
Q5_K_S
18.56GB file 21GB
Q8_0
28.69GB file 31.13GB
BF16
54GB file 56.44GB
G

Glogwa68

7 models

granite-4.0-h-1b-DISTILL-glm-4.7-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q5_1
0.69GB file 2.71GB
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

granite-4.0-h-1b-DISTILL-glm-4.7-think-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q5_1
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB

granite-4.0-h-350m-DISTILL-gemini-think-GGUF

Unknown 8K ctx
Q5_0
0GB file 2GB
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q5_1
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

granite-4.0-h-micro-DISTILL-OPUS-4.5-think-GGUF

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q8_0
0GB file 2GB
Q6_0
0GB file 2GB

granite-4.0-h-tiny-DISTILL-OPUS-4.5-think-GGUF

Unknown 8K ctx
Q4_1
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB
Q4_0
0GB file 2GB
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB

olmo-3-DISTILL-glm-4.7-think-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
Q8_0
0GB file 2GB
Q6_0
0GB file 2GB
Q5_1
0GB file 2GB
Q5_0
0GB file 2GB
Q4_1
0GB file 2GB
Q3_0
0GB file 2GB
Q2_0
0GB file 2GB

Qwen3-0.6B-DISTILL-glm-4.7-think-GGUF

0.6B 8K ctx
Q2_0
0.19GB file 2.2GB
Q3_0
0.26GB file 2.27GB
Q4_0
0.34GB file 2.35GB
Q4_1
0.34GB file 2.35GB
Q5_0
0.41GB file 2.42GB
Q5_1
0.41GB file 2.42GB
Q6_0
0.49GB file 2.5GB
Q8_0
0.64GB file 2.65GB