All Supported Models

29681 AI models · 198875 quantization formats tracked

S

Stingpie

1 models

Llama-Poro-2-8B-SFT-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
S

Stormtrooperaim

1 models

Kai-30B-Instruct-Q4_K_M-GGUF

30B 8K ctx
Q4_0
16.88GB file 19.37GB
FP16
60GB file 62.49GB
S

Straino

11 models

CodeLlama-34b-hf-Q4_K_M-GGUF

34B 8K ctx
Q4_0
19.13GB file 21.69GB
FP16
68GB file 70.56GB

NVIDIA-Nemotron-Nano-9B-v2-Base-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

phi-2-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

phi-2-Q5_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q5_0
0GB file 2GB

Phi-3-mini-128k-instruct-IQ4_NL-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3-mini-128k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3-mini-128k-instruct-Q5_K_M-GGUF

3.8B 8K ctx
Q5_0
2.61GB file 4.67GB
FP16
7.6GB file 9.66GB

Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2.5-Coder-7B-Instruct-IQ4_NL-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen3-Coder-30B-A3B-Instruct-AWQ-4bit-Q4_K_M-GGUF

30B 8K ctx
Q4_0
16.88GB file 19.37GB
FP16
60GB file 62.49GB
S

Stratalab Org

5 models

gemma-3-1b-it-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q2_K_L
0.31GB file 2.33GB
Q2_K_XL
0.31GB file 2.33GB
Q2_M
0.31GB file 2.33GB
Q2_XXS
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_S
0.44GB file 2.46GB
Q3_K_XL
0.44GB file 2.46GB
Q3_XXS
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q4_K_XL
0.56GB file 2.58GB
Q4_NL
0.56GB file 2.58GB
Q4_XS
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q5_K_XL
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q6_K_XL
0.81GB file 2.83GB
Q1_M
1GB file 3.02GB
Q1_S
1GB file 3.02GB
Q8_0
1.06GB file 3.08GB
Q8_K_XL
1.06GB file 3.08GB
BF16
2GB file 4.02GB

gpt2-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_1
1.38GB file 3.41GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

Meta-Llama-3.1-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_L
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_XL
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_K_L
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_L
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q6_K_L
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Phi-3.5-mini-instruct-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB
Q2_K_L
1.19GB file 3.25GB
Q2_M
1.19GB file 3.25GB
Q3_K_L
1.66GB file 3.72GB
Q3_K_M
1.66GB file 3.72GB
Q3_K_S
1.66GB file 3.72GB
Q3_K_XL
1.66GB file 3.72GB
Q3_M
1.66GB file 3.72GB
Q3_XS
1.66GB file 3.72GB
Q4_0
2.14GB file 4.2GB
Q4_K_L
2.14GB file 4.2GB
Q4_K_M
2.14GB file 4.2GB
Q4_K_S
2.14GB file 4.2GB
Q4_XS
2.14GB file 4.2GB
Q5_K_L
2.61GB file 4.67GB
Q5_K_M
2.61GB file 4.67GB
Q5_K_S
2.61GB file 4.67GB
Q6_K
3.09GB file 5.15GB
Q6_K_L
3.09GB file 5.15GB
Q8_0
4.04GB file 6.1GB

Qwen3-8B-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
S

Strike0010

1 models

hs-classifier-70b-dpo-iter2-arm1

70B 8K ctx
FP16
140GB file 143.15GB
S

Stronman

1 models

Gemma-4-31B-it-abliterated-GGUF

31B 8K ctx
Q2_K
9.69GB file 12.2GB
Q3_K_M
13.56GB file 16.07GB
Q4_K_M
17.44GB file 19.95GB
Q5_K_M
21.31GB file 23.82GB
Q8_0
32.94GB file 35.45GB
S

Strykes

1 models

emberforge-3b-reasoner

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
S

Stuchapin

1 models

Carnice-V2-27B-MTP-GGUF

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB
Q4_XS
15.19GB file 17.63GB
Q5_K_M
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB
S

Stupeter

1 models

Qwen2.5-0.5B-Instruct-GGUF

0.5B 8K ctx
Q2_0
0.16GB file 2.17GB
Q3_0
0.22GB file 2.23GB
Q4_0
0.28GB file 2.29GB
Q5_0
0.34GB file 2.35GB
Q6_0
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB
FP16
1GB file 3.01GB
S

Stupid Ve

1 models

Qwen2.5-0.5B-Q8_0-GGUF

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB