All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Altomek

10 models

GPT-OSS-20B-Heretic-ARA-V3-GGUF

20B 8K ctx
BF16
40GB file 42.33GB

Llama-3.2-3B-Instruct-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB

Lo101-3B-AnD-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q4_NL
1.69GB file 3.74GB
Q8_0
3.19GB file 5.24GB

Nemotron-3-Nano-30B-A3B-XXL-GGUF

30B 8K ctx
Q5_K_XXL
20.63GB file 23.12GB

Phil-18B-il1-GGUF

18B 8K ctx
Q4_0
10.13GB file 12.42GB
Q4_K_M
10.13GB file 12.42GB
Q8_0
19.13GB file 21.42GB

polka-1.1b-chat-Q4_0_4_4-GGUF

1.1B 8K ctx
Q4_0
0.62GB file 2.64GB

Qwen3-30B-A3B-XXL-GGUF

30B 8K ctx
Q6_K_XXL
24.38GB file 26.87GB

RE-70B-AS3D-GGUF

70B 8K ctx
Q2_M
21.88GB file 25.03GB
Q2_XS
21.88GB file 25.03GB
Q3_K
30.63GB file 33.78GB
Q3_M
30.63GB file 33.78GB
Q3_XS
30.63GB file 33.78GB
Q4_K
39.38GB file 42.53GB
Q4_NL
39.38GB file 42.53GB
Q4_XS
39.38GB file 42.53GB
Q5_K
48.13GB file 51.28GB
Q1_S
70GB file 73.15GB

Seed-OSS-36B-Instruct-XXL-GGUF

36B 8K ctx
Q5_K_XXL
24.75GB file 27.34GB

YiSM-34B-0rn-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB
Q3_K
14.88GB file 17.44GB
Q4_1
19.13GB file 21.69GB
Q4_0
19.13GB file 21.69GB
Q5_0
23.38GB file 25.94GB
Q6_K
27.63GB file 30.19GB
Q8_0
36.13GB file 38.69GB
A

Alumin Hydro

1 models

Qwen3.5-9B-Physics

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
A

Alvarobartt

2 models

lince-zero-7b-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB

UltraCM-13B-GGUF

13B 8K ctx
Q4_0
7.31GB file 9.52GB
Q5_0
8.94GB file 11.15GB
A

Alvinrach

2 models

Phi-3.5-mini-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB
A

Alvinxjm

2 models

Llama-2-7b-chat-finetune

7B 8K ctx
FP16
14GB file 16.11GB

mistral_7b_threat_merged

7B 8K ctx
FP16
14GB file 16.11GB
A

Alwosaby

1 models

csv_2_json

Unknown 8K ctx
FP16
0GB file 2GB
A

Alxstuff

1 models

Lumen-7b-v2

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
A

Amai Gsu

15 models

Qwen1.5-0.5B-Chat-Q4_0-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB

Qwen1.5-0.5B-Chat-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen1.5-0.5B-Chat-Q4_K_S-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen1.5-1.8B-Chat-Q4_0-GGUF

1.8B 8K ctx
Q4_0
1.01GB file 3.04GB

Qwen1.5-1.8B-Chat-Q4_K_M-GGUF

1.8B 8K ctx
Q4_0
1.01GB file 3.04GB
FP16
3.6GB file 5.63GB

Qwen1.5-1.8B-Chat-Q4_K_S-GGUF

1.8B 8K ctx
Q4_0
1.01GB file 3.04GB
FP16
3.6GB file 5.63GB

SmolLM2-1.7B-Instruct-Q4_0-GGUF

1.7B 8K ctx
Q4_0
0.96GB file 2.99GB

SmolLM2-1.7B-Instruct-Q4_K_M-GGUF

1.7B 8K ctx
Q4_0
0.96GB file 2.99GB
FP16
3.4GB file 5.43GB

SmolLM2-1.7B-Instruct-Q4_K_S-GGUF

1.7B 8K ctx
Q4_0
0.96GB file 2.99GB
FP16
3.4GB file 5.43GB

SmolLM2-135M-Instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

SmolLM2-135M-Instruct-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB

SmolLM2-135M-Instruct-Q4_K_S-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB

SmolLM2-360M-Instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

SmolLM2-360M-Instruct-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB

SmolLM2-360M-Instruct-Q4_K_S-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
A

Amakhov

1 models

tiny-random-llama

Unknown 8K ctx
FP16
0GB file 2GB
A

Amal David

1 models

datagemma-rag-27b-it-Q5_K_M-GGUF

27B 8K ctx
Q5_0
18.56GB file 21GB
FP16
54GB file 56.44GB