All Supported Models

29681 AI models · 198875 quantization formats tracked

S

Sh111111111111111

6 models

Qwen3-4B-Instruct-2507-GGUF-MX-1

4B 8K ctx
Q3_K_S
1.75GB file 3.82GB

Qwen3-4B-Instruct-2507-GGUF-MX-2

4B 8K ctx
Q3_K_S
1.75GB file 3.82GB

Qwen3-4B-Instruct-2507-ShapeLearn-GGUF

4B 8K ctx
FP16
8GB file 10.07GB

Qwen3-4B-Instruct-2507-ShapeLearn2-GGUF

4B 8K ctx
Q3_K_S
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Qwen3.5-9B-ShapeLearn-GGUF

9B 8K ctx
FP16
18GB file 20.15GB

Qwen3.5-9B-ShapeLearn2-GGUF

9B 8K ctx
Q3_K_S
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
S

Shaba Hu

2 models

Qwen2.5-0.5B-Instruct-Q4_0-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB

Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB
S

Shafire

6 models

AgentZero-F16-GGUF

16B 8K ctx
FP16
32GB file 34.26GB

AgentZero-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

SkynetZero

8B 8K ctx
FP16
16GB file 18.13GB

talktoai-F16-GGUF

16B 8K ctx
FP16
32GB file 34.26GB

talktoaiQ

8B 8K ctx
FP16
16GB file 18.13GB

talktoaiZERO

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB
S

Shahansha

1 models

Manthan-1.5B

1.5B 8K ctx
Q4_K_M
0.84GB file 2.86GB
Q8_0
1.59GB file 3.61GB
S

Shahidul034

1 models

KUETLLM_Zephyr7b_gguf

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
S

Shahzaib201

1 models

llama-2-7b-chat-hf-phr_mental_therapy-GGUF

7B 8K ctx
Q4_K
3.94GB file 6.05GB
S

Shahzeb Khoso

3 models

gemma-3-4b-it

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_M
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q4_0
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
FP16
8GB file 10.07GB

Qwen2.5-Coder-7B-Instruct

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB

Qwen3-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_0
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
FP16
16GB file 18.13GB
S

Shaikehsan

1 models

sqlCoder-Qwen2.5-8bit-F16-GGUF

32B 8K ctx
FP16
64GB file 66.52GB
S

Shaileshsarda

1 models

Llama-3.1-8B-Instruct-Q2_K-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
FP16
16GB file 18.13GB
S

Shajmaan

1 models

Qwen2-7B-Instruct-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB