All Supported Models

29681 AI models · 198875 quantization formats tracked

S

Steblyanko

1 models

paper-summarizer-llama-3.2-1b-instruct-Q4KS-GGUF

1B 8K ctx
Q4_K_S
0.56GB file 2.58GB
S

Stefan Coder1

2 models

Scalable-tuned-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB

Scalable-vanilla-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
S

Stefancosma

7 models

Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Phi-4-mini-instruct-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Phi-4-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen2.5-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen3-14B-Instruct-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB
S

Stellali0115

4 models

Llama-2-13b-hf-Q4_K_M-GGUF

13B 8K ctx
Q4_0
7.31GB file 9.52GB
FP16
26GB file 28.21GB

Llama-2-7b-hf-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Llama-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
S

Stephen Genusa

3 models

Apriel-1.5-15b-Thinker-Q4_K_M-GGUF

15B 8K ctx
Q4_0
8.44GB file 10.69GB
FP16
30GB file 32.25GB

Apriel-1.5-15b-Thinker-Q8_0-GGUF

15B 8K ctx
Q8_0
15.94GB file 18.19GB

RLT-32B-Q5_0-GGUF

32B 8K ctx
Q5_0
22GB file 24.52GB
S

Stephen Steckler

1 models

quantized

Unknown 8K ctx
FP16
0GB file 2GB
S

Stephenlzc

2 models

dolphin-llama3-zh-cn-uncensored

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Mistral-7B-v0.3-Chinese-Chat-uncensored

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q8_0
7.44GB file 9.55GB
S

Sterlixlol

1 models

kazi

27B 8K ctx
Q8_0
28.69GB file 31.13GB
S

Steve Tran

1 models

naruto-gemma-2-9b

9B 8K ctx
Q8_0
9.56GB file 11.71GB
FP16
18GB file 20.15GB
S

Steveleancommerce

1 models

Meta-Llama-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB