All Supported Models

29681 AI models · 198875 quantization formats tracked

W

Wilson989

1 models

speechless-codellama-34b-v2.0-GGUF

34B 8K ctx
Q4_K_M
19.13GB file 21.69GB
W

Wilsondesouza

1 models

Aurora-1.0-Hermes-3.1-8B-PTBR-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
W

Wilsonwang9411

1 models

Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
W

Win10

13 models

falcon-mamba-7b-instruct-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

GPT-OSS-26B-abliterated-Preview-Q4_K_M-GGUF

26B 8K ctx
Q4_0
14.63GB file 17.06GB
FP16
52GB file 54.43GB

GPT-OSS-26B-abliterated-Preview-Q8_0-GGUF

26B 8K ctx
Q8_0
27.63GB file 30.06GB

granite-3.0-8b-instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

internlm2_5-20b-chat-abliterated-Q6_K-GGUF

20B 8K ctx
Q6_0
16.25GB file 18.58GB
FP16
40GB file 42.33GB

llama3-13.45b-Instruct-Q4_K_M-GGUF

13.45B 8K ctx
Q4_0
7.57GB file 9.79GB
FP16
26.9GB file 29.12GB

llama3-13.45b-Instruct-Q5_K_M-GGUF

13.45B 8K ctx
Q5_0
9.25GB file 11.47GB
FP16
26.9GB file 29.12GB

llama3-13.45b-Instruct-Q6_K-GGUF

13.45B 8K ctx
Q6_0
10.93GB file 13.15GB
FP16
26.9GB file 29.12GB

llama3-13.45b-Instruct-Q8_0-GGUF

13.45B 8K ctx
Q8_0
14.29GB file 16.51GB

magnum-v2-12b-Q8_0-GGUF

12B 8K ctx
Q8_0
12.75GB file 14.95GB

miscii-14b-1028-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB

Phi-3.5-mini-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Pixtral-12B-2409-hf-text-only-Q8_0-GGUF

12B 8K ctx
Q8_0
12.75GB file 14.95GB
W

Winexe0

1 models

Phi-4-mini-instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB
W

Winfix75

1 models

phi-4-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
W

Winninghealth

1 models

WiNGPT-Babel

1.5B 8K ctx
Q4_K_M
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q8_0
1.59GB file 3.61GB
W

Winstcha

1 models

rewrite-7B-newtesla-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
W

Winvoker

1 models

Meta-Llama-3.1-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
W

Wirxer

1 models

OmniCoder-9B-heretic-GGUF

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB