All Supported Models

29681 AI models · 198875 quantization formats tracked

S

Sirnax

1 models

qwen3-71M-c4-final-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB
S

Siro Kr

2 models

gpt-oss-10.8b-specialized-harmful-pruned-moe-only-15-experts-Q4_K_M-GGUF

10.8B 8K ctx
Q4_0
6.08GB file 8.26GB
FP16
21.6GB file 23.78GB

gpt-oss-9.0b-specialized-all-pruned-moe-only-12-experts-Q4_K_M-GGUF

9.0B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB
S

Sirovub

4 models

LLaMA3-iterative-DPO-final-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

Nous-Hermes-13b-GGUF

13B 8K ctx
Q8_0
13.81GB file 16.02GB

SFR-Iterative-DPO-LLaMA-3-8B-R-GGUF

8B 8K ctx
BF16
16GB file 18.13GB

vicuna-33b-v1.3-GGUF

33B 8K ctx
Q8_0
35.06GB file 37.6GB
S

Sithum8363

1 models

Architect_Assistant_Final_GGUF

0.5B 8K ctx
Q4_K_M
0.28GB file 2.29GB
S

Six Open

5 models

granite-34b-code-instruct-Q5_K_M-GGUF

34B 8K ctx
Q5_K_M
23.38GB file 25.94GB

Meta-Llama-3-8B-Instruct-IQ4_NL-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3-8B-IQ3_M-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Phi-3-mini-4k-instruct-IQ4_NL-imat.gguf

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3-mini-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB
S

Sizzlebop

33 models

Capricornus-MoT-1.7B-Supreme1-Q8_0-GGUF

1.7B 8K ctx
Q8_0
1.81GB file 3.84GB

crystal-think-v1.0-IQ4_NL-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB

crystal-think-v1.0-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB

crystal-think-v1.0-Q5_K_S-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q5_0
0GB file 2GB

Crystal-Think-V2-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB

Crystal-Think-V2-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Draco-CoderMini-3B-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

ewre324-Thinker-SmolLM2-135M-Instruct-Reasoning-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

FairyR1-32B-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

Gliese-4B-OSS-0410-IQ4_NL-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

granite-3.3-2b-instruct-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

Kuwutu-7B-IQ4_NL-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Kuwutu-7B-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

LFM2-1.2B-Tool-IQ4_NL-GGUF

1.2B 8K ctx
Q4_0
0.67GB file 2.69GB
FP16
2.4GB file 4.42GB

LFM2-1.2B-Tool-Q8_0-GGUF

1.2B 8K ctx
Q8_0
1.28GB file 3.3GB

Lucy-IQ4_NL-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

Lucy-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

MiniCPM4-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

MiniCPM4-8B-Q5_K_S-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

Qwen2.5-7B-minperplexity-2-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-7B-minperplexity-2-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Qwen3-0.6B-Base-Q8_0-GGUF

0.6B 8K ctx
Q8_0
0.64GB file 2.65GB

Qwen3-0.6B-Q5_K_M-GGUF

0.6B 8K ctx
Q5_0
0.41GB file 2.42GB
FP16
1.2GB file 3.21GB

Qwen3-4B-NexusPrime-IQ4_XS-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

Qwen3-ReactJs-code-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

Qwen3-ReactJs-code-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Raptor-X2-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB

Raptor-X2-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Seed-Coder-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Seed-Coder-8B-Reasoning-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Viper-Coder-v1.4-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Viper-OneCoder-UIGEN-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

x1-7B-v0.1-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
S

Sjsjwjshh

1 models

Qwen2.5-1.5B-Instruct-GGUF

1.5B 8K ctx
Q2_0
0.47GB file 2.49GB
Q3_0
0.66GB file 2.68GB
Q4_0
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q6_0
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB
FP16
3GB file 5.02GB
S

Sk12154

1 models

llama_instruct_sft

Unknown 8K ctx
Q8_0
0GB file 2GB
Q5_K_M
0GB file 2GB
Q6_K
0GB file 2GB
S

Skarmani

4 models

granite-3.1-2b-instruct-Q5_K_M-GGUF

2B 8K ctx
Q5_0
1.38GB file 3.41GB
FP16
4GB file 6.03GB

Llama-3.1-8B-Instruct-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

Llama-3.2-1B-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

Mistral-7B-Instruct-v0.2-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB
S

Skds852

1 models

Qwen2.5-7B-Instruct-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
FP16
14GB file 16.11GB