All Supported Models

29681 AI models · 198875 quantization formats tracked

S

Shawnapakbin

1 models

e-cli-bundled-helper-phi35-gguf

35B 8K ctx
Q4_K_M
19.69GB file 22.26GB
S

Shazzadulimun

3 models

gemma3-270m-aurora-ml-v3-gguf

3B 8K ctx
FP16
6GB file 8.05GB

llama31-8b-aurora-chat-v3-gguf

8B 8K ctx
FP16
16GB file 18.13GB

NDP-Nemotron-3-Nano-4B-tool-calling

4B 8K ctx
Q4_0
2.25GB file 4.32GB
Q8_0
4.25GB file 6.32GB
S

Shb777

1 models

Llama-3.3-8B-Instruct-128K-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
S

Shdid

1 models

llama3.1_korean_v1.1_sft_by_aidx-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
S

Sheanno

1 models

Llama-3.2-1B-Instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
S

Sheep Huan

2 models

Qwen2-0.5B-Instruct-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB

Qwen2-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
S

Sheglov

1 models

Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

35B 8K ctx
Q4_K_M
19.69GB file 22.26GB
Q5_K_M
24.06GB file 26.63GB
Q6_K
28.44GB file 31.01GB
Q8_0
37.19GB file 39.76GB
S

Shehrozrafaqat

1 models

gemma-3-1b-it-GGUF

1B 8K ctx
Q2_XXS
0.31GB file 2.33GB
Q2_M
0.31GB file 2.33GB
Q2_K_XL
0.31GB file 2.33GB
Q2_K_L
0.31GB file 2.33GB
Q2_K
0.31GB file 2.33GB
Q3_K_S
0.44GB file 2.46GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_XL
0.44GB file 2.46GB
Q3_XXS
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_XS
0.56GB file 2.58GB
Q4_NL
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q4_K_XL
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q5_K_XL
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q6_K_XL
0.81GB file 2.83GB
Q1_S
1GB file 3.02GB
Q1_M
1GB file 3.02GB
Q8_0
1.06GB file 3.08GB
Q8_K_XL
1.06GB file 3.08GB
BF16
2GB file 4.02GB
S

Sheikhaei

1 models

llama-3.2-1b-english-persian-translator

1B 8K ctx
Q8_0
1.06GB file 3.08GB
S

Sheldonrobinson

30 models

codegemma-7b-it-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

codegemma-7b-it-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

gemma-2-9b-it-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

gemma-2-9b-it-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

gemma-2-9b-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

gemma-2-9b-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

gemma-7b-aps-it-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

gemma-7b-aps-it-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Llama-3.1-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3.2-3B-Instruct-Q4_0-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB

Llama-3.2-3B-Instruct-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Llama-Guard-3-1B-Q4_0-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB

Llama-Guard-3-1B-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

Phi-3.5-mini-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3.5-mini-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Phi-3.5-MoE-instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

Phi-3.5-MoE-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Qwen2.5-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-7B-Instruct-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Qwen2.5-Coder-1.5B-Instruct-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Qwen2.5-Coder-1.5B-Instruct-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-Coder-7B-Instruct-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Qwen2.5-Math-1.5B-Instruct-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Qwen2.5-Math-1.5B-Instruct-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

Qwen2.5-Math-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-Math-7B-Instruct-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

shieldgemma-9b-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

shieldgemma-9b-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

TEN_Turn_Detection-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB