All Supported Models

29681 AI models · 198875 quantization formats tracked

M

M C Z K

25 models

ArrowPro-7B-KUJIRA-GGUF

7B 8K ctx
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

ArrowPro-7B-RobinHood-GGUF

7B 8K ctx
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Assistance-7B-GGUF

7B 8K ctx
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

EZO-Common-9B-gemma-2-it-GGUF

9B 8K ctx
Q3_K_M
3.94GB file 6.09GB
Q3_M
3.94GB file 6.09GB
Q3_S
3.94GB file 6.09GB
Q3_XS
3.94GB file 6.09GB
Q3_XXS
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q4_XS
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

EZO-Common-T2-2B-gemma-2-it-GGUF

2B 8K ctx
Q3_K_M
0.88GB file 2.91GB
Q3_M
0.88GB file 2.91GB
Q3_S
0.88GB file 2.91GB
Q3_XS
0.88GB file 2.91GB
Q3_XXS
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

EZO-gemma-2-2b-jpn-it-GGUF

2B 8K ctx
Q3_K_M
0.88GB file 2.91GB
Q3_M
0.88GB file 2.91GB
Q3_S
0.88GB file 2.91GB
Q3_XS
0.88GB file 2.91GB
Q3_XXS
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

EZO-Humanities-9B-gemma-2-it-GGUF

9B 8K ctx
Q3_K_M
3.94GB file 6.09GB
Q3_M
3.94GB file 6.09GB
Q3_S
3.94GB file 6.09GB
Q3_XS
3.94GB file 6.09GB
Q3_XXS
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q4_XS
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

gemma-2-2b-it-GGUF

2B 8K ctx
Q3_K_M
0.88GB file 2.91GB
Q3_M
0.88GB file 2.91GB
Q3_S
0.88GB file 2.91GB
Q3_XS
0.88GB file 2.91GB
Q3_XXS
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

gemma-2-2b-jpn-it-GGUF

2B 8K ctx
Q3_K_M
0.88GB file 2.91GB
Q3_M
0.88GB file 2.91GB
Q3_S
0.88GB file 2.91GB
Q3_XS
0.88GB file 2.91GB
Q3_XXS
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

Gemma-2-9B-It-SPPO-Iter3-GGUF

9B 8K ctx
Q3_K_M
3.94GB file 6.09GB
Q3_M
3.94GB file 6.09GB
Q3_S
3.94GB file 6.09GB
Q3_XS
3.94GB file 6.09GB
Q3_XXS
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q4_XS
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

gemma-2-baku-2b-it-GGUF

2B 8K ctx
Q3_K_M
0.88GB file 2.91GB
Q3_M
0.88GB file 2.91GB
Q3_S
0.88GB file 2.91GB
Q3_XS
0.88GB file 2.91GB
Q3_XXS
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

granite-3.0-2b-instruct-GGUF

2B 8K ctx
Q3_K_M
0.88GB file 2.91GB
Q3_M
0.88GB file 2.91GB
Q3_S
0.88GB file 2.91GB
Q3_XS
0.88GB file 2.91GB
Q3_XXS
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

granite-3.0-3b-a800m-instruct-GGUF

3B 8K ctx
Q3_K_M
1.31GB file 3.36GB
Q3_M
1.31GB file 3.36GB
Q3_S
1.31GB file 3.36GB
Q3_XS
1.31GB file 3.36GB
Q3_XXS
1.31GB file 3.36GB
Q4_XS
1.69GB file 3.74GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Llama-3-Swallow-8B-Instruct-v0.1-GGUF

8B 8K ctx
Q3_K_M
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_S
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3.1-8B-EZO-1.1-it-GGUF

8B 8K ctx
Q3_K_M
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_S
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-3.2-3B-Instruct-GGUF

3B 8K ctx
Q3_K_M
1.31GB file 3.36GB
Q3_M
1.31GB file 3.36GB
Q3_S
1.31GB file 3.36GB
Q3_XS
1.31GB file 3.36GB
Q3_XXS
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q4_XS
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Llama3-ArrowSE-8B-v0.3-GGUF

8B 8K ctx
Q3_K_M
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_S
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Ninja-V2-7B-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Ninja-V3-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Qwen2-0.5B-Instruct-GGUF

0.5B 8K ctx
Q3_K_M
0.22GB file 2.23GB
Q3_M
0.22GB file 2.23GB
Q3_S
0.22GB file 2.23GB
Q3_XS
0.22GB file 2.23GB
Q3_XXS
0.22GB file 2.23GB
Q4_K_M
0.28GB file 2.29GB
Q4_K_S
0.28GB file 2.29GB
Q4_XS
0.28GB file 2.29GB
Q5_K_M
0.34GB file 2.35GB
Q5_K_S
0.34GB file 2.35GB
Q6_K
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB

Qwen2-1.5B-Instruct-GGUF

1.5B 8K ctx
Q3_K_M
0.66GB file 2.68GB
Q3_M
0.66GB file 2.68GB
Q3_S
0.66GB file 2.68GB
Q3_XS
0.66GB file 2.68GB
Q3_XXS
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q4_K_S
0.84GB file 2.86GB
Q4_XS
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q5_K_S
1.03GB file 3.05GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

Qwen2-7B-Instruct-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Tora-7B-v0.1-GGUF

7B 8K ctx
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Tora-7B-v0.2-GGUF

7B 8K ctx
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Vecteus-V2-7B-GGUF

7B 8K ctx
Q3_K_M
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_S
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q3_XXS
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
M

M E G H T

1 models

qwen3-finetuned-search

32B 8K ctx
FP16
64GB file 66.52GB
M

M G M E

1 models

Gemma-2b-Uncensored-v1-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB
M

M Hasnain Sabqi

1 models

Qwen3-Coder-Next

57B 8K ctx
Q4_K_M
32.06GB file 34.99GB
Q5_0
39.19GB file 42.12GB
Q5_K_M
39.19GB file 42.12GB
Q6_K
46.31GB file 49.24GB
Q8_0
60.56GB file 63.49GB
M

M L Rookie3123

1 models

Customer-Service-gguf

8B 8K ctx
FP16
16GB file 18.13GB
M

M Lking2

2 models

Llama-3.2-1B-Instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Instruct-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB
M

M O L U O K A

2 models

Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2.5-Coder-1.5B-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB
M

M Polignano

4 models

ANITA-NEXT-20B-gpt-oss-ITA-GGUF

24B 8K ctx
Q4_K_M
13.5GB file 15.89GB
Q8_0
25.5GB file 27.89GB

ANITA-NEXT-24B-Dolphin-Mistral-UNCENSORED-ITA-GGUF

24B 8K ctx
Q4_K_M
13.5GB file 15.89GB
Q8_0
25.5GB file 27.89GB

ANITA-NEXT-24B-Magistral-2506-ITA-GGUF

24B 8K ctx
Q4_K_M
13.5GB file 15.89GB
Q8_0
25.5GB file 27.89GB

ANITA-NEXT-24B-Magistral-2506-VISION-ITA-GGUF

24B 8K ctx
Q4_K_M
13.5GB file 15.89GB
Q8_0
25.5GB file 27.89GB
M

M R Eder

3 models

Gemma-2B-IT-WIKI-30K-v4-merged

2B 8K ctx
Q5_K_M
1.38GB file 3.41GB

TinyLlama-wiki-de-v2

Unknown 8K ctx
Q4_K_M
0GB file 2GB

tinyllamatestbymarcel

Unknown 8K ctx
Q4_K_M
0GB file 2GB
M

M Rockatansky

6 models

Cogidonia-24B

24B 8K ctx
FP16
48GB file 50.39GB

Cogidonia-24B-Lora-Q8_0-GGUF

24B 8K ctx
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB

Cogidonia-v2-24B-GGUF

24B 8K ctx
Q3_K_M
10.5GB file 12.89GB
Q3_K_S
10.5GB file 12.89GB
Q4_K_M
13.5GB file 15.89GB
Q4_XS
13.5GB file 15.89GB
Q5_K_M
16.5GB file 18.89GB
Q5_K_S
16.5GB file 18.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB

Cogidonia-v2-24B-imatrix-GGUF

24B 8K ctx
Q3_XXS
10.5GB file 12.89GB
Q4_K_M
13.5GB file 15.89GB
Q4_XS
13.5GB file 15.89GB
Q6_K
19.5GB file 21.89GB

Gemma-4-31B-storymaxxed-GGUF

31B 8K ctx
Q4_K_M
17.44GB file 19.95GB
BF16
62GB file 64.51GB

Gemma-4-31B-storymaxxed2-GGUF

31B 8K ctx
Q4_K_M
17.44GB file 19.95GB
Q4_XS
17.44GB file 19.95GB
Q5_K_S
21.31GB file 23.82GB
BF16
62GB file 64.51GB