All Supported Models

29681 AI models · 198875 quantization formats tracked

2

24Bean

2 models

Llama-2-ko-7B-Chat-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB

Llama-2-ko-7B-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB
2

26643As

1 models

Meta-Llama-3-8B-Instruct-abliterated-v3-GGUF

8B 8K ctx
Q2_M
2.5GB file 4.63GB
Q2_K
2.5GB file 4.63GB
Q2_S
2.5GB file 4.63GB
Q2_XS
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q4_XS
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
2

2Etatg

1 models

Qwen3-Next-80B-A3B-Thinking-GRPO-Uncensored-gguf

80B 8K ctx
Q2_K
25GB file 28.31GB
Q4_K_M
45GB file 48.31GB
Q8_0
85GB file 88.31GB
2

2P8Xx

1 models

Foundation-Sec-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_L
3.5GB file 5.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
2

2Stacks

1 models

qwen3-8b-andrew-resume-v2

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
3

3 Simplex

1 models

Meta-Llama-3.1-8B-Instruct-gguf

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q4_0
4.5GB file 6.63GB
3

323Danni

1 models

Qwen2-0.5B-GGUF

0.5B 8K ctx
Q4_NL
0.28GB file 2.29GB
3

39Mk39Mk

1 models

DeepSeek-R1-Distill-Qwen-1.5B-GGUF

1.5B 8K ctx
Q2_XXS
0.47GB file 2.49GB
Q2_M
0.47GB file 2.49GB
Q2_K_XL
0.47GB file 2.49GB
Q2_K_L
0.47GB file 2.49GB
Q2_K
0.47GB file 2.49GB
Q3_XXS
0.66GB file 2.68GB
Q3_K_XL
0.66GB file 2.68GB
Q3_K_M
0.66GB file 2.68GB
Q4_XS
0.84GB file 2.86GB
Q4_K_XL
0.84GB file 2.86GB
Q4_K_M
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q6_K
1.22GB file 3.24GB
Q1_M
1.5GB file 3.52GB
Q1_S
1.5GB file 3.52GB
Q8_0
1.59GB file 3.61GB
BF16
3GB file 5.02GB
3

3Amthoughts

2 models

DeepLink-R1-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

zenfinance-3b

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
3

3Dsabh

2 models

Mistral-7B-v0.1-Q2_K-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB

Mistral-7B-v0.1-Q4_K_M-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB