All Supported Models

29681 AI models · 198875 quantization formats tracked

V

V R Date

8 models

DictaLM-3.0-1.7B-Thinking-Q4_K_M-GGUF

1.7B 8K ctx
Q4_0
0.96GB file 2.99GB
FP16
3.4GB file 5.43GB

DictaLM-3.0-1.7B-Thinking-Q8_0-GGUF

1.7B 8K ctx
Q8_0
1.81GB file 3.84GB

DictaLM-3.0-24B-Base-W4A16-Q4_0-GGUF

24B 8K ctx
Q4_0
13.5GB file 15.89GB

DictaLM-3.0-24B-Base-W4A16-Q4_K_S-GGUF

24B 8K ctx
Q4_0
13.5GB file 15.89GB
FP16
48GB file 50.39GB

DictaLM-3.0-24B-Thinking-FP8-Q4_0-GGUF

24B 8K ctx
Q4_0
13.5GB file 15.89GB

DictaLM-3.0-24B-Thinking-FP8-Q4_K_M-GGUF

24B 8K ctx
Q4_0
13.5GB file 15.89GB

DictaLM-3.0-24B-Thinking-FP8-Q4_K_S-GGUF

24B 8K ctx
Q4_0
13.5GB file 15.89GB

DictaLM-3.0-24B-Thinking-W4A16-Q4_K_M-GGUF

24B 8K ctx
Q4_0
13.5GB file 15.89GB
FP16
48GB file 50.39GB
V

V S R V

2 models

raga-radar-v2-Q3_K_M-GGUF

Unknown 8K ctx
Q3_0
0GB file 2GB
FP16
0GB file 2GB

raga-radar-v2-Q6_K-GGUF

Unknown 8K ctx
Q6_0
0GB file 2GB
FP16
0GB file 2GB
V

V000000

1 models

Qwen2.5-Lumen-14B-Q6_K-GGUF

14B 8K ctx
Q6_0
11.38GB file 13.61GB
FP16
28GB file 30.23GB
V

V102Ss

2 models

Alice-Qwen3-4B-Instruct-2507-Heretic-Light-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB

Alice-Qwopus3.5-9B-RP-GGUF

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
V

V8Karlo

5 models

Qwen2-7B-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

Qwen2.5-0.5B-Instruct-Q8_0-GGUF

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB

Qwen2.5-0.5B-Q8_0-GGUF

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB

Qwen2.5-3B-Instruct-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

UNCENSORED-Phi-3-mini-4k-geminified-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB
V

Vahhab70

1 models

CodeQwen1.5-7B-Chat-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
V

Vai Ton

2 models

Minerva-3B-base-v1.0-Q5_K_M-GGUF

3B 8K ctx
Q5_K_M
2.06GB file 4.11GB

Minerva-3B-base-v1.0-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB
V

Vaibhavsatpathy

3 models

Meta-Llama-3-8B-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Meta-Llama-3.1-8B-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Meta-Llama-3.1-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
V

Valid Name1

1 models

Qwen3-0.6B-Q4_K_M-GGUF

0.6B 8K ctx
Q4_0
0.34GB file 2.35GB
FP16
1.2GB file 3.21GB
V

Valle Horn

1 models

german-audio-correction-gemma2

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB