All Supported Models

29681 AI models · 198875 quantization formats tracked

S

Sentient Donut

3 models

gemma-2-2b-it-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

gemma-2-2b-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

gemma-3-270m-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
S

Sepolian

1 models

Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated-Q4_K_M

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB
S

Ser13Volk

1 models

llama-3.1-8b-chat-vika

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
S

Serena W U

1 models

unsloth_deepseek.Q8_0.gguf

8B 8K ctx
Q8_0
8.5GB file 10.63GB
S

Serena97

2 models

SmolLM2-1.7B-Instruct-Q4_K_M-GGUF

1.7B 8K ctx
Q4_0
0.96GB file 2.99GB
FP16
3.4GB file 5.43GB

SmolLM2-1.7B-Instruct-Q8_0-GGUF

1.7B 8K ctx
Q8_0
1.81GB file 3.84GB
S

Serge U S S

2 models

Llama-2-7B-Chat-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_S
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Llama-2-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_0
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
S

Sergey Z

4 models

fr-4B-sreason-40k-model

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

ft-1.5B-117k-og-model

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

ft-1.5B-47k-wo-model

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

ft-1.5Br2-117k-og-mod

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB
S

Serial Kicked

3 models

GPT-OSS-20B-Heretic-GGUF

20B 8K ctx
Q4_NL
11.25GB file 13.58GB
Q5_1
13.75GB file 16.08GB
FP4
20GB file 22.33GB
Q8_0
21.25GB file 23.58GB

Hermes-4.3-36B-heretic-GGUF-IQ4_XS

36B 8K ctx
Q4_XS
20.25GB file 22.84GB

QwentileLambda2.5-32B-Instruct-GGUF-IQ4_NL

32B 8K ctx
Q4_NL
18GB file 20.52GB
S

Serjio42

1 models

gemma4-e2b-finetuned-caregivers

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB
S

Serkan007

1 models

qwen2-gguf

0.5B 8K ctx
Q2_0
0.16GB file 2.17GB
Q3_0
0.22GB file 2.23GB
Q4_0
0.28GB file 2.29GB
Q5_0
0.34GB file 2.35GB
Q6_0
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB
FP16
1GB file 3.01GB