All Supported Models

29681 AI models · 198875 quantization formats tracked

A

About0

1 models

qwen-chat-GGUF-14B

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_L
6.13GB file 8.36GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q5_1
9.63GB file 11.86GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB
A

Abrasdaosfjnps

1 models

supergemma4-26b-uncensored-gguf-v2

26B 8K ctx
Q4_K_M
14.63GB file 17.06GB
A

Absolucy

1 models

laserxtral-sota-GGUF

Unknown 8K ctx
Q2_XS
0GB file 2GB
Q2_XXS
0GB file 2GB
Q3_K_XS
0GB file 2GB
Q3_XXS
0GB file 2GB
A

Absurd T

1 models

Qwen3-1.7B-Q5_K_M-GGUF

1.7B 8K ctx
Q5_0
1.17GB file 3.2GB
FP16
3.4GB file 5.43GB
A

Abtee X A I Lab

68 models

lumynax-chat-hermes-3-llama31-8b-gguf

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

lumynax-chat-yi-15-34b-gguf

34B 8K ctx
Q4_K_M
19.13GB file 21.69GB

lumynax-coder-codellama-70b-instruct-gguf

70B 8K ctx
Q4_K_M
39.38GB file 42.53GB

lumynax-coder-codeqwen15-7b-chat-gguf

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

lumynax-coder-deepseek-coder-33b-gguf

33B 8K ctx
Q4_K_M
18.56GB file 21.1GB

lumynax-coder-deepseek-v2-lite-16b-gguf

16B 8K ctx
Q4_K_M
9GB file 11.26GB

lumynax-coder-qwen25-05b-instruct-gguf

05B 8K ctx
Q4_0
2.81GB file 4.89GB
FP16
10GB file 12.08GB

lumynax-coder-qwen25-14b-instruct-gguf

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

lumynax-coder-qwen25-15b-instruct-gguf

15B 8K ctx
Q4_0
8.44GB file 10.69GB
FP16
30GB file 32.25GB

lumynax-coder-qwen25-7b-instruct-gguf

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

lumynax-coder-qwen25-coder-32b-gguf

32B 8K ctx
Q4_K_M
18GB file 20.52GB

lumynax-coder-starcoder2-15b-gguf

15B 8K ctx
Q4_K_M
8.44GB file 10.69GB

lumynax-coder-yi-coder-9b-gguf

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB

lumynax-frontier-coder-deepseek-v25-1210-gguf

1210B 8K ctx
Q4_K_M
680.63GB file 702.45GB

lumynax-frontier-coder-qwen3-480b-a35b-gguf

480B 8K ctx
Q4_K_M
270GB file 279.86GB

lumynax-frontier-dbrx-instruct-132b-gguf

132B 8K ctx
Q2_K
41.25GB file 45.41GB

lumynax-frontier-minimax-m2-230b

230B 8K ctx
Q4_K_M
129.38GB file 135.15GB

lumynax-frontier-minimax-m25-unsloth

Unknown 8K ctx
Q1_0
0GB file 2GB

lumynax-frontier-mixtral-8x22b-instruct-gguf

22B 8K ctx
Q4_K_M
12.38GB file 14.74GB

lumynax-frontier-phi-35-moe-instruct-gguf

3.8B 8K ctx
Q4_K_M
2.14GB file 4.2GB

lumynax-frontier-phi-4-14b-gguf

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB

lumynax-frontier-qwen25-72b-instruct-gguf

72B 8K ctx
Q4_K_M
40.5GB file 43.68GB

lumynax-frontier-qwen3-235b-a22b-instruct

235B 8K ctx
Q4_K_M
132.19GB file 138.04GB

lumynax-infused-gemma-e4b-text-gguf

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

lumynax-infused-gemma4-26b-a4b-gguf

26B 8K ctx
Q4_0
14.63GB file 17.06GB
FP16
52GB file 54.43GB

lumynax-infused-granite31-1b-a400m-gguf

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

lumynax-infused-granite33-2b-gguf

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

lumynax-infused-granite33-8b-gguf

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

lumynax-infused-mistral-7b-v03-gguf

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

lumynax-infused-mistral-small-text-gguf

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

lumynax-infused-olmo2-1b-0425-gguf

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

lumynax-infused-olmo2-7b-1124-gguf

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

lumynax-infused-phi-4-text-gguf

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

lumynax-infused-phi3-mini-4k-gguf

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

lumynax-infused-phi4-mini-instruct-gguf

Unknown 8K ctx
Q4_K_M
0GB file 2GB

lumynax-infused-qwen25-15b-instruct-gguf

15B 8K ctx
Q4_0
8.44GB file 10.69GB
FP16
30GB file 32.25GB

lumynax-infused-qwen25-3b-instruct-gguf

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

lumynax-infused-qwen25-7b-instruct-gguf

7B 8K ctx
Q3_0
3.06GB file 5.17GB
FP16
14GB file 16.11GB

lumynax-infused-qwen3-06b-gguf

06B 8K ctx
Q8_0
6.38GB file 8.48GB

lumynax-infused-qwen3-14b-gguf

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB

lumynax-infused-qwen3-17b-gguf

17B 8K ctx
Q8_0
18.06GB file 20.34GB

lumynax-infused-qwen3-30b-a3b-gguf

30B 8K ctx
Q4_0
16.88GB file 19.37GB
FP16
60GB file 62.49GB

lumynax-infused-qwen3-8b-gguf

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

lumynax-infused-qwen3-coder-30b-a3b-gguf

30B 8K ctx
Q4_0
16.88GB file 19.37GB
FP16
60GB file 62.49GB

lumynax-infused-qwen3-text-gguf

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

lumynax-infused-smollm-135m-gguf

Unknown 8K ctx
Q4_K_M
0GB file 2GB

lumynax-infused-smollm2-17b-gguf

17B 8K ctx
Q4_0
9.56GB file 11.84GB
FP16
34GB file 36.28GB

lumynax-infused-smollm2-360m-gguf

Unknown 8K ctx
Q8_0
0GB file 2GB

lumynax-infused-smollm3-3b-gguf

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB

lumynax-infused-zephyr-7b-beta-gguf

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

lumynax-longctx-glm4-9b-chat-1m-gguf

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB

lumynax-longctx-qwen25-7b-1m-gguf

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

lumynax-math-qwen25-math-7b-gguf

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

lumynax-moe-moonlight-16b-a3b-gguf

16B 8K ctx
Q4_0
9GB file 11.26GB
FP16
32GB file 34.26GB

lumynax-moe-olmoe-1b-7b-0924-instruct-gguf

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB

lumynax-moe-olmoe-1b-7b-gguf

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

lumynax-nz-qwen25-coder-3b-gguf

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

lumynax-reasoning-deepseek-distill-text-gguf

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

lumynax-reasoning-deepseek-prover-v2-671b-gguf

671B 8K ctx
Q4_K_M
377.44GB file 390.43GB

lumynax-reasoning-deepseek-r1-distill-llama-70b-gguf

70B 8K ctx
Q4_K_M
39.38GB file 42.53GB

lumynax-reasoning-deepseek-r1-qwen-15b-gguf

15B 8K ctx
Q4_K_M
8.44GB file 10.69GB

lumynax-reasoning-deepseek-r1-qwen-7b-gguf

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

lumynax-reasoning-glm46-355b-moe

355B 8K ctx
Q4_K_M
199.69GB file 207.51GB

lumynax-reasoning-gpt-oss-20b-gguf

20B 8K ctx
FP4
20GB file 22.33GB

lumynax-reasoning-internlm3-8b-gguf

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

lumynax-reasoning-phi4-mini-gguf

Unknown 8K ctx
Q4_K_M
0GB file 2GB

lumynax-reasoning-qwq-32b-gguf

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

lumynax-tiny-qwen25-05b-gguf

05B 8K ctx
Q4_0
2.81GB file 4.89GB
FP16
10GB file 12.08GB
A

Abyrne55

1 models

nuextract-1.5-tiny-mealie-ingredient-parser

Unknown 8K ctx
Q8_0
0GB file 2GB
A

Ac3Xx

2 models

gemma-2-2b-it-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

gemma-2-2b-it-Q6_K-GGUF

2B 8K ctx
Q6_0
1.63GB file 3.66GB
FP16
4GB file 6.03GB
A

Acelogic A I

2 models

Qwen2.5-Coder-1.5B-Instruct-GGUF

1.5B 8K ctx
Q2_0
0.47GB file 2.49GB
Q3_0
0.66GB file 2.68GB
Q4_0
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q6_0
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

Qwen2.5-Coder-3B-Instruct-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
FP16
6GB file 8.05GB
A

Acen20

1 models

Meta-Llama-3-8B-Q2_K-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
FP16
16GB file 18.13GB
A

Acer Test359

1 models

Phi-3.5-mini-instruct-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB
Q2_K_L
1.19GB file 3.25GB
Q2_M
1.19GB file 3.25GB
Q3_K_L
1.66GB file 3.72GB
Q3_K_M
1.66GB file 3.72GB
Q3_K_S
1.66GB file 3.72GB
Q3_K_XL
1.66GB file 3.72GB
Q3_M
1.66GB file 3.72GB
Q3_XS
1.66GB file 3.72GB
Q4_0
2.14GB file 4.2GB
Q4_K_L
2.14GB file 4.2GB
Q4_K_M
2.14GB file 4.2GB
Q4_K_S
2.14GB file 4.2GB
Q4_XS
2.14GB file 4.2GB
Q5_K_L
2.61GB file 4.67GB
Q5_K_M
2.61GB file 4.67GB
Q5_K_S
2.61GB file 4.67GB
Q6_K
3.09GB file 5.15GB
Q6_K_L
3.09GB file 5.15GB
Q8_0
4.04GB file 6.1GB