All Supported Models

29681 AI models · 198875 quantization formats tracked

V

Vraiti

1 models

granite-q4km

Unknown 8K ctx
Q4_K_M
0GB file 2GB
V

Vreiiii

1 models

Meta-Llama-3-8B-Instruct-Q6_K-GGUF

8B 8K ctx
Q6_K
6.5GB file 8.63GB
V

Vsevolodl

4 models

Llama-3-70B-Instruct-Gradient-1048k-GGUF

70B 8K ctx
Q2_K
21.88GB file 25.03GB
Q3_K_S
30.63GB file 33.78GB
Q3_K_M
30.63GB file 33.78GB
Q3_K_L
30.63GB file 33.78GB
Q4_K_S
39.38GB file 42.53GB
Q4_K_M
39.38GB file 42.53GB
Q4_0
39.38GB file 42.53GB
Q5_K_S
48.13GB file 51.28GB
Q5_K_M
48.13GB file 51.28GB
Q5_0
48.13GB file 51.28GB

Llama-3-8B-Instruct-Gradient-1048k-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_L
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

prometheus-7b-v2.0-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_S
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_0
3.94GB file 6.05GB
Q5_K_S
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_0
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

prometheus-8x7b-v2.0-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_K_S
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
V

Vsreddy1918

1 models

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
V

Vtriple

1 models

threatflux-0.6B-gguf

0.6B 8K ctx
FP16
1.2GB file 3.21GB
V

Vu Tong

2 models

gemma-2b-t

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

merge

Unknown 8K ctx
FP16
0GB file 2GB
V

Vutuka

1 models

Llama-3.1-8B-african-aya

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q8_0
8.5GB file 10.63GB
V

Vxntx

1 models

Gistral-16B-Q8_0-GGUF

16B 8K ctx
Q8_0
17GB file 19.26GB
V

Vyo J

1 models

Qwen2.5-Coder-1.5B-Instruct-be-GGUF

1.5B 8K ctx
Q4_K_M
0.84GB file 2.86GB
Q8_0
1.59GB file 3.61GB
W

W Ahmad

1 models

Qwen3.5-9B-GGUF-MoQ

9B 8K ctx
BF16
18GB file 20.15GB