All Supported Models

29681 AI models · 198875 quantization formats tracked

S

Sawd231

2 models

gemma-2-2b-it-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
S

Saxo

12 models

Linkbricks-Horizon-AI-Korean-Advanced-12B

12B 8K ctx
Q4_0
6.75GB file 8.95GB
Q5_0
8.25GB file 10.45GB
Q6_0
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB
BF16
24GB file 26.2GB

Linkbricks-Horizon-AI-Korean-Advanced-27B

27B 8K ctx
Q4_0
15.19GB file 17.63GB
Q5_0
18.56GB file 21GB
Q6_0
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB
FP16
54GB file 56.44GB

Linkbricks-Horizon-AI-Korean-Advanced-56B

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB

Linkbricks-Horizon-AI-Korean-Advanced-70B

70B 8K ctx
Q4_0
39.38GB file 42.53GB
Q5_0
48.13GB file 51.28GB
FP16
140GB file 143.15GB

Linkbricks-Horizon-AI-Korean-Advanced-8B

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Linkbricks-Horizon-AI-Korean-Gemma-2-sft-dpo-27B

27B 8K ctx
Q4_0
15.19GB file 17.63GB
Q5_0
18.56GB file 21GB
Q6_0
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB

Linkbricks-Horizon-AI-Korean-llama-3.1-sft-dpo-8B

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Linkbricks-Horizon-AI-Korean-llama3-sft-dpo-8b-base

8B 8K ctx
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Linkbricks-Horizon-AI-Korean-llama3.1-sft-dpo-70B

70B 8K ctx
Q4_0
39.38GB file 42.53GB
Q5_0
48.13GB file 51.28GB
FP16
140GB file 143.15GB

Linkbricks-Horizon-AI-Korean-llama3.1-sft-rlhf-dpo-8B

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Linkbricks-Horizon-AI-Korean-Mistral-Nemo-sft-dpo-12B

12B 8K ctx
Q4_0
6.75GB file 8.95GB
Q5_0
8.25GB file 10.45GB
Q6_0
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB
BF16
24GB file 26.2GB

Linkbricks-Horizon-AI-Korean-Mixtral-sft-dpo-8x7b

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
S

Sayhan

9 models

gemma-7b-GGUF-quantized

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB

gemma-7b-it-GGUF-quantized

7B 8K ctx
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB

MiniCPM-3B-OpenHermes-2.5-v2-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Mistral_Pro_8B_v0.1-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Mistral-7B-Instruct-v0.2-turkish-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Mixtral-8x7B-v0.1-turkish-GGUF

7B 8K ctx
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

OpenHermes-2.5-Strix-Philosophy-Mistral-7B-LoRA

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

phi-2-super-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q2_K
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_0
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_0
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

Trendyol-LLM-7b-base-v0.1-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
S

Sbeltz

1 models

QwQ-32B-Preview-Q3_K_S-GGUF

32B 8K ctx
Q3_0
14GB file 16.52GB
FP16
64GB file 66.52GB
S

Sberryman

1 models

Llama-xLAM-2-8b-fc-r-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
S

Sc0M3R

2 models

Llama-3-8B-Instruct-Gradient-1048k-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Phi-3-medium-128k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB
S

Scaleszw

1 models

another_model

Unknown 8K ctx
FP16
0GB file 2GB
S

Schrst

1 models

Qwen2.5-Coder-0.5B-Instruct-GGUF

0.5B 8K ctx
Q3_K_L
0.22GB file 2.23GB
Q3_K_XL
0.22GB file 2.23GB
Q3_M
0.22GB file 2.23GB
Q4_0
0.28GB file 2.29GB
Q4_K_L
0.28GB file 2.29GB
Q4_K_M
0.28GB file 2.29GB
Q4_K_S
0.28GB file 2.29GB
Q4_XS
0.28GB file 2.29GB
Q5_K_L
0.34GB file 2.35GB
Q5_K_M
0.34GB file 2.35GB
Q5_K_S
0.34GB file 2.35GB
Q6_K
0.41GB file 2.42GB
Q6_K_L
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB
S

Sci Fi Vy

4 models

DeepSeek-R1-0528-Qwen3-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_L
2.5GB file 4.63GB
Q2_K_XL
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_XL
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_K_XL
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q5_K_XL
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q6_K_XL
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB
Q8_K_XL
8.5GB file 10.63GB
BF16
16GB file 18.13GB

gemma-2-9b-it-GGUF

9B 8K ctx
Q3_K_L
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q4_XS
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB

gemma-3-270m-it-GGUF

1B 8K ctx
Q2_K
0.31GB file 2.33GB
Q2_K_L
0.31GB file 2.33GB
Q2_K_XL
0.31GB file 2.33GB
Q2_M
0.31GB file 2.33GB
Q2_XXS
0.31GB file 2.33GB
Q3_K_M
0.44GB file 2.46GB
Q3_K_S
0.44GB file 2.46GB
Q3_K_XL
0.44GB file 2.46GB
Q3_XXS
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q4_K_M
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q4_K_XL
0.56GB file 2.58GB
Q4_NL
0.56GB file 2.58GB
Q4_XS
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q5_K_S
0.69GB file 2.71GB
Q5_K_XL
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q6_K_XL
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
Q8_K_XL
1.06GB file 3.08GB

gpt-oss-20b-GGUF

20B 8K ctx
Q2_K
6.25GB file 8.58GB
Q2_K_L
6.25GB file 8.58GB
Q3_K_M
8.75GB file 11.08GB
Q3_K_S
8.75GB file 11.08GB
Q4_0
11.25GB file 13.58GB
Q4_1
11.25GB file 13.58GB
Q4_K_M
11.25GB file 13.58GB
Q4_K_S
11.25GB file 13.58GB
Q4_K_XL
11.25GB file 13.58GB
Q5_K_M
13.75GB file 16.08GB
Q5_K_S
13.75GB file 16.08GB
Q6_K
16.25GB file 18.58GB
Q6_K_XL
16.25GB file 18.58GB
Q8_0
21.25GB file 23.58GB
Q8_K_XL
21.25GB file 23.58GB
S

Sci Phi

1 models

Triplex

Unknown 8K ctx
Q4_K_M
0GB file 2GB