All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Airmongsity

1 models

Qwen2.5-3B-Paper-Quality-Filter

3B 8K ctx
Q8_0
3.19GB file 5.24GB
A

Aisingapore

6 models

Apertus-SEA-LION-v4-8B-IT-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Gemma-SEA-LION-v4-27B-IT-GGUF

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB
Q8_0
28.69GB file 31.13GB
BF16
54GB file 56.44GB

Llama-SEA-LION-v3-70B-IT-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_M
30.63GB file 33.78GB
Q4_0
39.38GB file 42.53GB
Q4_K_M
39.38GB file 42.53GB
Q5_0
48.13GB file 51.28GB
Q5_K_M
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB

Llama-SEA-LION-v3-8B-IT-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Llama-SEA-LION-v3.5-70B-R-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_M
30.63GB file 33.78GB
Q4_0
39.38GB file 42.53GB
Q4_K_M
39.38GB file 42.53GB
Q5_0
48.13GB file 51.28GB
Q5_K_M
48.13GB file 51.28GB
Q6_K
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB

Llama-SEA-LION-v3.5-8B-R-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
A

Aisquared

1 models

bolt-instruct-1b-gguf

1B 8K ctx
FP16
2GB file 4.02GB
A

Aistuffllm

1 models

Llama-2-7b-chat-hf-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
A

Aiwanwan

1 models

Llama-3.2-1B-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB
A

Aiworksofbt

1 models

gpt-oss-20b-GGUF

20B 8K ctx
Q2_K
6.25GB file 8.58GB
Q2_K_L
6.25GB file 8.58GB
Q3_K_M
8.75GB file 11.08GB
Q3_K_S
8.75GB file 11.08GB
Q4_0
11.25GB file 13.58GB
Q4_1
11.25GB file 13.58GB
Q4_K_M
11.25GB file 13.58GB
Q4_K_S
11.25GB file 13.58GB
Q4_K_XL
11.25GB file 13.58GB
Q5_K_M
13.75GB file 16.08GB
Q5_K_S
13.75GB file 16.08GB
Q6_K
16.25GB file 18.58GB
Q6_K_XL
16.25GB file 18.58GB
Q8_0
21.25GB file 23.58GB
Q8_K_XL
21.25GB file 23.58GB
A

Aixk

19 models

granite-4.0-h-350m-base-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB

haru-180m

Unknown 8K ctx
FP16
0GB file 2GB

haru-180m-gguf

Unknown 8K ctx
Q1_S
0GB file 2GB
Q2_XXS
0GB file 2GB
Q3_K_M
0GB file 2GB
Q4_K_M
0GB file 2GB

haru-390m

Unknown 8K ctx
FP16
0GB file 2GB
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB

haru-390m-gguf

Unknown 8K ctx
FP16
0GB file 2GB
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB

korean-test-gguf

Unknown 8K ctx
FP16
0GB file 2GB

Kori-390M

Unknown 8K ctx
FP16
0GB file 2GB

Kori-390M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB

kosine_TEST-GGUF-F16

Unknown 8K ctx
FP16
0GB file 2GB

kosine-GGUF-F16

Unknown 8K ctx
FP16
0GB file 2GB

kosmo-TEST-GGUF

Unknown 8K ctx
FP16
0GB file 2GB

Qwen2.5-0.5B-Instruct-GGUF

0.5B 8K ctx
Q2_XXS
0.16GB file 2.17GB
Q3_K_M
0.22GB file 2.23GB
Q4_K_M
0.28GB file 2.29GB
Q1_S
0.5GB file 2.51GB

Qwen2.5-Coder-0.5B-Instruct-GGUF

0.5B 8K ctx
Q2_XXS
0.16GB file 2.17GB
Q3_K_M
0.22GB file 2.23GB
Q4_K_M
0.28GB file 2.29GB
Q1_S
0.5GB file 2.51GB

SmolLM2-135M-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB

SmolLM2-360M-Instruct-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB

twiny-stack-L01-gguf

01B 8K ctx
FP16
2GB file 4.02GB

twiny-stack-L02-gguf

02B 8K ctx
FP16
4GB file 6.03GB

twiny-stack-L03-gguf

03B 8K ctx
FP16
6GB file 8.05GB

twiny-stack-L04-GGUF-F16

04B 8K ctx
FP16
8GB file 10.07GB
A

Aizukanne

1 models

Atani-002-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q8_0
7.44GB file 9.55GB
A

Ajay 21

2 models

bling-phi-2-v0-GGUF

0B 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q8_0
0GB file 2GB

dragon-mistral-7b-v0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB
A

Ajeetcoolkarni

1 models

Medhavi-14B-Expert-GGUF

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB
Q6_K
11.38GB file 13.61GB