All Supported Models

29681 AI models · 198875 quantization formats tracked

S

Shakaze

1 models

Llama-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
S

Shamil12

7 models

EXAONE-3.5-2.4B-Instruct-abliterated-IQ4_NL-GGUF

2.4B 8K ctx
Q4_0
1.35GB file 3.39GB
FP16
4.8GB file 6.84GB

Qwen2.5-3B-Instruct-QwQ-Q2_K-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
FP16
6GB file 8.05GB

Qwen2.5-Math-1.5B-Instruct-Q2_K-GGUF

1.5B 8K ctx
Q2_0
0.47GB file 2.49GB
FP16
3GB file 5.02GB

Qwen2.5-Math-1.5B-Instruct-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Qwen2.5-Math-1.5B-Instruct-Q5_K_M-GGUF

1.5B 8K ctx
Q5_0
1.03GB file 3.05GB
FP16
3GB file 5.02GB

Qwen2.5-Math-1.5B-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Skywork-o1-Open-Llama-3.1-8B-Q2_K-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
FP16
16GB file 18.13GB
S

Shanearora

1 models

i-am-a-good-big-instruct-model

13B 8K ctx
FP16
26GB file 28.21GB
S

Shanthan1998

1 models

Math-llama

Unknown 8K ctx
Q4_K_M
0GB file 2GB
S

Shaowenchen

18 models

baichuan2-7b-base-gguf

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

baichuan2-7b-chat-gguf

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

chinese-alpaca-2-13b-16k-gguf

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K
5.69GB file 7.9GB
Q3_K_L
5.69GB file 7.9GB
Q3_K_S
5.69GB file 7.9GB
Q4_0
7.31GB file 9.52GB
Q4_1
7.31GB file 9.52GB
Q4_K
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_0
8.94GB file 11.15GB
Q5_1
8.94GB file 11.15GB
Q5_K
8.94GB file 11.15GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

chinese-alpaca-2-13b-gguf

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K
5.69GB file 7.9GB
Q3_K_L
5.69GB file 7.9GB
Q3_K_S
5.69GB file 7.9GB
Q4_0
7.31GB file 9.52GB
Q4_1
7.31GB file 9.52GB
Q4_K
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_0
8.94GB file 11.15GB
Q5_1
8.94GB file 11.15GB
Q5_K
8.94GB file 11.15GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

chinese-alpaca-2-7b-16k-gguf

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

chinese-alpaca-2-7b-gguf

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

chinese-llama-2-13b-16k-gguf

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K
5.69GB file 7.9GB
Q3_K_L
5.69GB file 7.9GB
Q3_K_S
5.69GB file 7.9GB
Q4_0
7.31GB file 9.52GB
Q4_1
7.31GB file 9.52GB
Q4_K
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_0
8.94GB file 11.15GB
Q5_1
8.94GB file 11.15GB
Q5_K
8.94GB file 11.15GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

chinese-llama-2-13b-gguf

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K
5.69GB file 7.9GB
Q3_K_L
5.69GB file 7.9GB
Q3_K_S
5.69GB file 7.9GB
Q4_0
7.31GB file 9.52GB
Q4_1
7.31GB file 9.52GB
Q4_K
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_0
8.94GB file 11.15GB
Q5_1
8.94GB file 11.15GB
Q5_K
8.94GB file 11.15GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

chinese-llama-2-7b-16k-gguf

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

chinese-llama-2-7b-gguf

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

colossal-llama-2-7b-base-gguf

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

llama-2-13b-langchain-chat-gguf

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K
5.69GB file 7.9GB
Q3_K_L
5.69GB file 7.9GB
Q3_K_S
5.69GB file 7.9GB
Q4_0
7.31GB file 9.52GB
Q4_1
7.31GB file 9.52GB
Q4_K
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_0
8.94GB file 11.15GB
Q5_1
8.94GB file 11.15GB
Q5_K
8.94GB file 11.15GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

llama-2-7b-langchain-chat-gguf

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

longchat-13b-16k-gguf

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K
5.69GB file 7.9GB
Q3_K_L
5.69GB file 7.9GB
Q3_K_S
5.69GB file 7.9GB
Q4_0
7.31GB file 9.52GB
Q4_1
7.31GB file 9.52GB
Q4_K
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_0
8.94GB file 11.15GB
Q5_1
8.94GB file 11.15GB
Q5_K
8.94GB file 11.15GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

longchat-7b-v1.5-32k-gguf

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

vicuna-13b-v1.5-16k-gguf

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_K
5.69GB file 7.9GB
Q3_K_L
5.69GB file 7.9GB
Q3_K_S
5.69GB file 7.9GB
Q4_0
7.31GB file 9.52GB
Q4_1
7.31GB file 9.52GB
Q4_K
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_0
8.94GB file 11.15GB
Q5_1
8.94GB file 11.15GB
Q5_K
8.94GB file 11.15GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB

vicuna-33b-v1.3-gguf

33B 8K ctx
Q2_K
10.31GB file 12.85GB
Q3_K
14.44GB file 16.98GB
Q3_K_L
14.44GB file 16.98GB
Q3_K_S
14.44GB file 16.98GB
Q4_0
18.56GB file 21.1GB
Q4_1
18.56GB file 21.1GB
Q4_K
18.56GB file 21.1GB
Q4_K_S
18.56GB file 21.1GB
Q5_0
22.69GB file 25.23GB
Q5_1
22.69GB file 25.23GB
Q5_K
22.69GB file 25.23GB
Q5_K_S
22.69GB file 25.23GB
Q6_K
26.81GB file 29.35GB
Q8_0
35.06GB file 37.6GB

vicuna-7b-v1.5-16k-gguf

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K
3.06GB file 5.17GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q4_K
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q5_K
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
S

Shaoyinwu

1 models

Llama-3-8B-iMES-FT01

8B 8K ctx
Q8_0
8.5GB file 10.63GB
S

Shariyat

1 models

gemma-4-E2B-it-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q3_S
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
S

Shashank V H

1 models

llama-3-8b-fine_tuned_web-app_generator

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
S

Shashi1305

1 models

llama-3-8b-chat-doctor

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
S

Shawn1251

1 models

granite-guardian-3.1-2b-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB