All Supported Models

29681 AI models · 198875 quantization formats tracked

G

Ggml Org

20 models

functiongemma-270m-it-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB

LoRA-Deepthink-Reasoning-Qwen2.5-7B-Instruct-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Meta-Llama-3.1-8B-Instruct-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Qwen2.5-Coder-0.5B-Q8_0-GGUF

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB

Qwen2.5-Coder-1.5B-32B-speculative-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

Qwen2.5-Coder-1.5B-Instruct-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

Qwen2.5-Coder-1.5B-IQ3_XXS-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
FP16
3GB file 5.02GB

Qwen2.5-Coder-1.5B-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

Qwen2.5-Coder-14B-Instruct-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB

Qwen2.5-Coder-14B-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB

Qwen2.5-Coder-3B-Instruct-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Qwen2.5-Coder-3B-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Qwen2.5-Coder-7B-Instruct-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Qwen2.5-Coder-7B-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Qwen3-30B-A3B-Instruct-2507-Q8_0-GGUF

30B 8K ctx
Q8_0
31.88GB file 34.37GB

Qwen3-30B-A3B-Thinking-2507-Q8_0-GGUF

30B 8K ctx
Q8_0
31.88GB file 34.37GB

Qwen3-4B-Instruct-2507-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB

Qwen3-4B-Thinking-2507-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB

Qwen3-Coder-30B-A3B-Instruct-Q8_0-GGUF

30B 8K ctx
Q8_0
31.88GB file 34.37GB

stories15M_MOE

Unknown 8K ctx
Q8_0
0GB file 2GB
G

Gguf Org

5 models

fastvlm-gguf

0.5B 8K ctx
Q2_0
0.16GB file 2.17GB
Q3_0
0.22GB file 2.23GB
Q4_0
0.28GB file 2.29GB
Q4_1
0.28GB file 2.29GB
Q5_0
0.34GB file 2.35GB
Q5_1
0.34GB file 2.35GB
Q6_0
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB
BF16
1GB file 3.01GB

gemma-3-1b-it-gguf

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q5_1
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
FP4
1GB file 3.02GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

gemma-3-1b-pt-gguf

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q5_1
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

gemma-3-270m-gguf

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q5_1
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
FP4
1GB file 3.02GB
Q1_0
1GB file 3.02GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

gemma-3-270m-it-gguf

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q5_1
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
FP4
1GB file 3.02GB
Q1_0
1GB file 3.02GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB
G

Ghiwook

1 models

A.X-4.0-Light-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB
G

Ghost A1

1 models

Ghost-AI-Echo-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
G

Ghost Actual

1 models

Qwen3.5-27B-Claude-Opus-4.6-Distilled-heretic-GGUF

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB
G

Ghost Mopey115

1 models

gemma-finetuned-transformers

Unknown 8K ctx
FP16
0GB file 2GB
G

Ghost The Shadow

1 models

Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

27B 8K ctx
Q2_K
8.44GB file 10.88GB
Q3_K_M
11.81GB file 14.25GB
Q3_K_S
11.81GB file 14.25GB
Q4_K_M
15.19GB file 17.63GB
Q4_K_S
15.19GB file 17.63GB
Q8_0
28.69GB file 31.13GB
BF16
54GB file 56.44GB
G

Ghost X

3 models

ghost-7b-alpha-gguf

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB

ghost-7b-v0.9.1-gguf

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q8_0
7.44GB file 9.55GB

ghost-8b-beta-1608-gguf

8B 8K ctx
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB
G

Ghostai1

6 models

Chrismas-Spirit7b

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_0
7GB file 9.11GB

Easter-Spirit2b

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q1_0
2GB file 4.03GB
Q8_0
2.13GB file 4.16GB

Egypt_Historical7b

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q1_0
7GB file 9.11GB

GHOSTAI-Spooky

Unknown 8K ctx
Q1_0
0GB file 2GB
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB

halloween1.3b_poltergeist

1.3B 8K ctx
Q2_K
0.41GB file 2.43GB
Q3_K_M
0.57GB file 2.59GB
Q3_K_S
0.57GB file 2.59GB
Q4_K_M
0.73GB file 2.75GB
Q4_K_S
0.73GB file 2.75GB
Q5_K_M
0.89GB file 2.91GB
Q5_K_S
0.89GB file 2.91GB
Q6_K
1.06GB file 3.08GB
Q1_0
1.3GB file 3.32GB
Q8_0
1.38GB file 3.4GB

NewYears1.5b

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_M
0.66GB file 2.68GB
Q3_K_S
0.66GB file 2.68GB
Q5_K_M
1.03GB file 3.05GB
Q5_K_S
1.03GB file 3.05GB
Q6_K
1.22GB file 3.24GB
Q1_0
1.5GB file 3.52GB
Q8_0
1.59GB file 3.61GB
G

Gi K A Graphy

2 models

ProductLlama-finetunedV2

8B 8K ctx
Q8_0
8.5GB file 10.63GB

TestModel-gemma-9b-gguf

9B 8K ctx
FP16
18GB file 20.15GB