All Supported Models

29681 AI models · 198875 quantization formats tracked

S

Sagemax

1 models

Qwen2.5.1-Coder-7B-Instruct-GGUF

7B 8K ctx
Q2_K_L
2.19GB file 4.3GB
Q2_K
2.19GB file 4.3GB
Q2_M
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q3_K_XL
3.06GB file 5.17GB
Q3_M
3.06GB file 5.17GB
Q3_XS
3.06GB file 5.17GB
Q4_K_L
3.94GB file 6.05GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q4_XS
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_L
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q6_K_L
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
S

Sagicc

1 models

granite-8b-code-instruct-Q5_K_M-GGUF

8B 8K ctx
Q5_K_M
5.5GB file 7.63GB
S

Sahil70090

1 models

yoda-phi3-mini-4k

Unknown 8K ctx
Q8_0
0GB file 2GB
FP16
0GB file 2GB
S

Sahilagrawal

2 models

Qwen2.5-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Qwen3-14B-Q4_0-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
S

Sai Santhosh

1 models

text-2-sql-gguf

Unknown 8K ctx
FP16
0GB file 2GB
S

Saikiran2603

1 models

Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
S

Saint Honey

1 models

PersonalManV1.0

Unknown 8K ctx
FP16
0GB file 2GB
S

Sairamn

1 models

Phi3-Legal-Finetuned

Unknown 8K ctx
FP16
0GB file 2GB
S

Sais Experiments

2 models

granite-4.0-tiny-preview-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

kanana-1.5-15.7b-a3b-instruct-Q8_0-GGUF

15.7B 8K ctx
Q8_0
16.68GB file 18.94GB
S

Saishf

3 models

Fett-Eris-Mix-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

HuginnV5.6-12.6B-GGUF

12.6B 8K ctx
Q2_K
3.94GB file 6.15GB
Q3_K_M
5.51GB file 7.72GB
Q3_K_S
5.51GB file 7.72GB
Q4_K_M
7.09GB file 9.3GB
Q5_K_M
8.66GB file 10.87GB
Q6_K
10.24GB file 12.45GB

Nous-Lotus-10.7B-GGUF

10.7B 8K ctx
Q2_K
3.34GB file 5.52GB
Q3_K_M
4.68GB file 6.86GB
Q4_K_M
6.02GB file 8.2GB
Q5_K_M
7.36GB file 9.54GB
Q6_K
8.69GB file 10.87GB
Q8_0
11.37GB file 13.55GB