All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Arrio

2 models

Gemma-2-9B-Chinese-Chat-Q2_K-GGUF

9B 8K ctx
Q2_0
2.81GB file 4.96GB
FP16
18GB file 20.15GB

Qwen2-1.5B-Instruct-Q4_K_S-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB
A

Arthu1

1 models

starlight-mini-Q5_0-GGUF

0B 8K ctx
Q5_0
0GB file 2GB
A

Artificialvlad

1 models

gemma-2-9b-it-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB
A

Artples

1 models

L-MChat-7b-Q4_K_M-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
A

Arturo Vitale

1 models

Minerva-1B-base-v1.0-Q4_K_M-GGUF

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB
A

Artus Dev

14 models

allura-org_Gemma-3-Glitter-4B-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q3_M
1.75GB file 3.82GB
Q3_XS
1.75GB file 3.82GB
Q3_XXS
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

gemma-3-27b-fujin-GGUF

27B 8K ctx
Q2_K
8.44GB file 10.88GB
Q2_XS
8.44GB file 10.88GB
Q2_XXS
8.44GB file 10.88GB
Q3_K_L
11.81GB file 14.25GB
Q3_K_M
11.81GB file 14.25GB
Q3_K_S
11.81GB file 14.25GB
Q3_XS
11.81GB file 14.25GB
Q3_XXS
11.81GB file 14.25GB
Q4_K_M
15.19GB file 17.63GB
Q4_K_S
15.19GB file 17.63GB
Q4_XS
15.19GB file 17.63GB
Q5_K_M
18.56GB file 21GB
Q5_K_S
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB

Qwen3-235B-A22B-GGUF

235B 8K ctx
Q6_K
190.94GB file 196.79GB

ToastyPigeon_g3-27b-part1-glitter-GGUF

27B 8K ctx
Q2_K
8.44GB file 10.88GB
Q2_M
8.44GB file 10.88GB
Q3_K_L
11.81GB file 14.25GB
Q3_K_M
11.81GB file 14.25GB
Q3_K_S
11.81GB file 14.25GB
Q3_M
11.81GB file 14.25GB
Q3_XS
11.81GB file 14.25GB
Q3_XXS
11.81GB file 14.25GB
Q4_K_M
15.19GB file 17.63GB
Q4_K_S
15.19GB file 17.63GB
Q4_XS
15.19GB file 17.63GB
Q5_K_M
18.56GB file 21GB
Q5_K_S
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB

ToastyPigeon_gemma-3-27b-experiment-v2-merge-B-GGUF

27B 8K ctx
Q5_K_M
18.56GB file 21GB
Q5_K_S
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB

ToastyPigeon_gemma-3-27b-experiment-v2-merge-GGUF

27B 8K ctx
Q5_K_S
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB

ToastyPigeon_Gemma-3-Confetti-12B-GGUF

12B 8K ctx
Q2_K
3.75GB file 5.95GB
Q3_K_L
5.25GB file 7.45GB
Q3_K_M
5.25GB file 7.45GB
Q3_K_S
5.25GB file 7.45GB
Q3_M
5.25GB file 7.45GB
Q3_XS
5.25GB file 7.45GB
Q3_XXS
5.25GB file 7.45GB
Q4_K_M
6.75GB file 8.95GB
Q4_K_S
6.75GB file 8.95GB
Q4_XS
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q5_K_S
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

ToastyPigeon_Gemma-3-Starshine-12B-Alt-GGUF

12B 8K ctx
Q5_K_M
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

ToastyPigeon_Gemma-3-Starshine-12B-GGUF

12B 8K ctx
Q5_K_M
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

ToastyPigeon_glitterfetti-merge-A3-GGUF

3B 8K ctx
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

ToastyPigeon_glitterfetti-merge-B-GGUF

Unknown 8K ctx
Q5_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

ToastyPigeon_glitterfetti-merge-B2-GGUF

2B 8K ctx
Q5_K_M
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

ToastyPigeon_glitterfetti-merge-C-GGUF

Unknown 8K ctx
Q5_K_M
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

ToastyPigeon_glitterfetti-merge-C2-GGUF

2B 8K ctx
Q5_K_M
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
A

Artvv

2 models

Markov_chain_modelization_gguf

Unknown 8K ctx
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB
Q8_0
0GB file 2GB

philosophical-surgeon-v1

Unknown 8K ctx
BF16
0GB file 2GB
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB
A

Arun Kr

2 models

gemma-3-270m-it-web-agent-gguf

1B 8K ctx
Q8_0
1.06GB file 3.08GB

SmolLM-135M-Instruct-manim-gguf

Unknown 8K ctx
BF16
0GB file 2GB
Q8_0
0GB file 2GB
A

Arunsrajan

2 models

Llama-3.2-3B-Instruct-unsloth-bnb-4bit-godot-code

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB

Qwen3-4B-Thinking-2507-bnb-4bit-godot-lora

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
A

Arunvpp05

1 models

zephyr-gguf

7B 8K ctx
Q5_0
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB