All Supported Models

29681 AI models · 198875 quantization formats tracked

G

Georgia47

3 models

Llama-2-7b-chat-hf-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Meta-Llama-3-8B-Instruct-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Qwen2-0.5B-Instruct-Q4_0-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
G

Georgy G U F

2 models

MAI-DS-R1-q8-with-bf16-embedding-and-bf16-output.gguf

Unknown 8K ctx
Q8_0
0GB file 2GB

MAI-DS-R1-tq1_0.gguf

Unknown 8K ctx
Q1_0
0GB file 2GB
G

Gercamjr

1 models

DeepCoder-14B-Preview-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB
G

Gestalt Labs

3 models

Ornstein-3.6-27B-GGUF

27B 8K ctx
Q3_K_L
11.81GB file 14.25GB
Q3_K_M
11.81GB file 14.25GB
Q3_K_S
11.81GB file 14.25GB
Q3_M
11.81GB file 14.25GB
Q4_0
15.19GB file 17.63GB
Q4_K_M
15.19GB file 17.63GB
Q4_K_S
15.19GB file 17.63GB
Q4_NL
15.19GB file 17.63GB
Q4_XS
15.19GB file 17.63GB
Q5_0
18.56GB file 21GB
Q5_K_M
18.56GB file 21GB
Q5_K_S
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB

Ornstein-3.6-27B-RYS-GGUF

27B 8K ctx
Q2_0
8.44GB file 10.88GB
Q3_0
11.81GB file 14.25GB
Q4_0
15.19GB file 17.63GB
Q6_0
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB

Ornstein-Hermes-3.6-27b-SABER-GGUF

27B 8K ctx
Q2_M
8.44GB file 10.88GB
Q3_K_M
11.81GB file 14.25GB
Q4_XS
15.19GB file 17.63GB
Q4_K_M
15.19GB file 17.63GB
Q5_K_M
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB
G

Get Solo Tech

4 models

gemma-3-1b-endocronology-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

Gemma3-Code-Reasoning-4B-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

GPT-OSS-Code-Reasoning-20B-GGUF

20B 8K ctx
Q3_K_M
8.75GB file 11.08GB
Q4_K_M
11.25GB file 13.58GB
Q5_K_M
13.75GB file 16.08GB
Q8_0
21.25GB file 23.58GB

Qwen3-Code-Reasoning-4B-GGUF

4B 8K ctx
Q3_K_M
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
G

Gg0999Vaja

1 models

venice-uncensored-Q2_K-GGUF

Unknown 8K ctx
Q2_0
0GB file 2GB
FP16
0GB file 2GB
G

Ggbetz

2 models

Llama-3.1-Argunaut-1-8B-SFT-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

xVerify-32B-I-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB
G

Ggfox00000

3 models

gpt-oss-20b-GGUF

20B 8K ctx
Q4_K_M
11.25GB file 13.58GB
Q5_K_M
13.75GB file 16.08GB
Q8_0
21.25GB file 23.58GB

Ministral-3-14B-Reasoning-2512-GGUF

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q8_0
14.88GB file 17.11GB

Qwen3-14B-GGUF

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q8_0
14.88GB file 17.11GB
G

Gghfez

17 models

DeepSeek-R1-Zero-IQ2_KS

671B 8K ctx
Q2_K
209.69GB file 222.68GB

DeepSeek-R1-Zero-IQ3_KS

671B 8K ctx
Q3_K
293.56GB file 306.55GB

DeepSeek-V3-0324-IQ2_KS

236B 8K ctx
Q2_K
73.75GB file 79.62GB

DeepSeek-V3-0324-IQ3_KS

236B 8K ctx
Q3_K
103.25GB file 109.12GB

DeepSeek-V3.1-IQ2_KS

236B 8K ctx
Q2_K
73.75GB file 79.62GB

Devstral-2-123B-Instruct-2512-control-vectors

123B 8K ctx
FP16
246GB file 250.02GB

gemma-4-31b-it-control-vectors

31B 8K ctx
FP16
62GB file 64.51GB

GLM-4.5-Air-control-vectors

Unknown 8K ctx
FP16
0GB file 2GB

GLM-4.6-control-vectors

Unknown 8K ctx
FP16
0GB file 2GB

GLM-5-control-vectors

Unknown 8K ctx
FP16
0GB file 2GB

gpt-oss-20b-Derestricted-Q4_K_M-GGUF

20B 8K ctx
Q4_0
11.25GB file 13.58GB
FP16
40GB file 42.33GB

Kimi-K2-0905-no-not-X-but-Y-cv

Unknown 8K ctx
FP16
0GB file 2GB

Kimi-K2-Instruct-0905-control-vectors

2B 8K ctx
FP16
4GB file 6.03GB

Kimi-K2.6-control-vectors

Unknown 8K ctx
FP16
0GB file 2GB

openwebui-title-generator-270m-gguf

Unknown 8K ctx
BF16
0GB file 2GB
Q8_0
0GB file 2GB

Qwen3.5-27b-control-vectors

27B 8K ctx
FP16
54GB file 56.44GB

WizardLM-2-22b-RP-GGUF

22B 8K ctx
Q4_0
12.38GB file 14.74GB
Q5_0
15.13GB file 17.49GB
Q6_0
17.88GB file 20.24GB
FP16
44GB file 46.36GB
G

Gghozzit

1 models

mistral-v0.3-7b-Quran

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB