All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Anthracite Org

14 models

magnum-v1-32b-gguf

32B 8K ctx
Q2_0
10GB file 12.52GB
Q3_0
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q6_0
26GB file 28.52GB
Q8_0
34GB file 36.52GB
FP16
64GB file 66.52GB

magnum-v2-123b-gguf

123B 8K ctx
Q2_0
38.44GB file 42.46GB
Q3_0
53.81GB file 57.83GB
Q4_0
69.19GB file 73.21GB
Q5_0
84.56GB file 88.58GB
Q6_0
99.94GB file 103.96GB
Q1_0
123GB file 127.02GB
FP16
246GB file 250.02GB

magnum-v2-12b-gguf

12B 8K ctx
Q3_0
5.25GB file 7.45GB
Q4_0
6.75GB file 8.95GB
Q5_0
8.25GB file 10.45GB
Q6_0
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

magnum-v2-32b-gguf

32B 8K ctx
Q3_0
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q6_0
26GB file 28.52GB
Q8_0
34GB file 36.52GB

magnum-v2-4b-gguf

4B 8K ctx
Q3_M
1.75GB file 3.82GB
Q3_S
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q4_XS
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

magnum-v2-72b-gguf

72B 8K ctx
Q3_M
31.5GB file 34.68GB
Q3_S
31.5GB file 34.68GB
Q4_K_M
40.5GB file 43.68GB
Q4_XS
40.5GB file 43.68GB
Q5_K_M
49.5GB file 52.68GB
Q6_K
58.5GB file 61.68GB
Q8_0
76.5GB file 79.68GB

magnum-v2.5-12b-kto-gguf

12B 8K ctx
Q3_M
5.25GB file 7.45GB
Q3_S
5.25GB file 7.45GB
Q4_K_M
6.75GB file 8.95GB
Q4_XS
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q8_0
12.75GB file 14.95GB

magnum-v3-34b-gguf

34B 8K ctx
Q3_M
14.88GB file 17.44GB
Q3_S
14.88GB file 17.44GB
Q4_K_M
19.13GB file 21.69GB
Q4_XS
19.13GB file 21.69GB
Q5_K_M
23.38GB file 25.94GB
Q6_K
27.63GB file 30.19GB
Q8_0
36.13GB file 38.69GB

magnum-v4-123b-gguf

123B 8K ctx
Q3_K_L
53.81GB file 57.83GB
Q4_K_M
69.19GB file 73.21GB
Q5_K_M
84.56GB file 88.58GB
Q6_K
99.94GB file 103.96GB
Q8_0
130.69GB file 134.71GB

magnum-v4-12b-gguf

12B 8K ctx
Q3_K_L
5.25GB file 7.45GB
Q4_K_M
6.75GB file 8.95GB
Q5_K_M
8.25GB file 10.45GB
Q6_K
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

magnum-v4-22b-gguf

22B 8K ctx
Q3_K_L
9.63GB file 11.99GB
Q4_K_M
12.38GB file 14.74GB
Q5_K_M
15.13GB file 17.49GB
Q6_K
17.88GB file 20.24GB
Q8_0
23.38GB file 25.74GB

magnum-v4-27b-gguf

27B 8K ctx
Q3_K_L
11.81GB file 14.25GB
Q4_K_M
15.19GB file 17.63GB
Q5_K_M
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB

magnum-v4-72b-gguf

72B 8K ctx
Q3_K_L
31.5GB file 34.68GB
Q4_K_M
40.5GB file 43.68GB
Q5_K_M
49.5GB file 52.68GB
Q6_K
58.5GB file 61.68GB
Q8_0
76.5GB file 79.68GB

magnum-v4-9b-gguf

9B 8K ctx
Q3_K_L
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
A

Anti2906

1 models

gemma-2-2b-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB
A

Antigma

9 models

Devstral-Small-2505-GGUF

2505B 8K ctx
Q2_0
782.81GB file 825.85GB
Q3_0
1095.94GB file 1138.98GB
Q4_0
1409.06GB file 1452.1GB
Q5_0
1722.19GB file 1765.23GB
Q6_0
2035.31GB file 2078.35GB
Q8_0
2661.56GB file 2704.6GB

Qwen3-0.6B-Base-GGUF

0.6B 8K ctx
Q4_0
0.34GB file 2.35GB

Qwen3-0.6B-GGUF

0.6B 8K ctx
Q4_0
0.34GB file 2.35GB

Qwen3-1.7B-GGUF

1.7B 8K ctx
Q4_0
0.96GB file 2.99GB

Qwen3-14B-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB

Qwen3-30B-A3B-GGUF

30B 8K ctx
Q4_0
16.88GB file 19.37GB

Qwen3-32B-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB

Qwen3-4B-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB

Qwen3-8B-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
A

Antirez

1 models

deepseek-v4-gguf

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q4_0
2.25GB file 4.32GB
A

Antiven0M

1 models

finch-shorirp

Unknown 8K ctx
Q6_K
0GB file 2GB
A

Anton Cook

1 models

dypromotion

8B 8K ctx
Q8_0
8.5GB file 10.63GB
A

Antongoy

1 models

ReaderLM-v2-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB
A

Antoniostepien

2 models

agentic-qwen-gguf

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

peer-ai-reviewer

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB
A

Antonisbast

1 models

Llama-3.2-3B-Gordon-Ramsay-DPO-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
A

Antony Pk

1 models

llama-3-8b-chat-doctor

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB