All Supported Models

29681 AI models · 198875 quantization formats tracked

M

Muhammadfiaz

1 models

gemma-2b-it

2B 8K ctx
FP16
4GB file 6.03GB
M

Muhammed Afsal P M

1 models

Llama-base-3.1-8B-invoice-gguf-sft

8B 8K ctx
FP16
16GB file 18.13GB
M

Muhammed Ksee

1 models

Qwen3.5-9B-Instruct-Turca-TurkishLLM-GGUF

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
M

Muhammedshamil

1 models

law-Llama-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
M

Muharamesa

1 models

fined-tune-ilama3-new

Unknown 8K ctx
Q4_K_M
0GB file 2GB
M

Mukel

14 models

Llama-3.2-1B-Instruct-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
Q8_0
1.06GB file 3.08GB

Llama-3.2-3B-Instruct-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q8_0
3.19GB file 5.24GB

Qwen2.5-0.5B-Instruct-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
Q8_0
0.53GB file 2.54GB

Qwen2.5-1.5B-Instruct-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
Q8_0
1.59GB file 3.61GB

Qwen2.5-14B-Instruct-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
Q8_0
14.88GB file 17.11GB

Qwen2.5-3B-Instruct-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q8_0
3.19GB file 5.24GB

Qwen2.5-7B-Instruct-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q8_0
7.44GB file 9.55GB

Qwen2.5-Coder-0.5B-Instruct-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
Q8_0
0.53GB file 2.54GB

Qwen2.5-Coder-1.5B-Instruct-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
Q8_0
1.59GB file 3.61GB

Qwen2.5-Coder-14B-Instruct-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
Q8_0
14.88GB file 17.11GB

Qwen2.5-Coder-3B-Instruct-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q8_0
3.19GB file 5.24GB

Qwen2.5-Coder-7B-Instruct-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q8_0
7.44GB file 9.55GB

Qwen2.5-Math-1.5B-Instruct-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
Q8_0
1.59GB file 3.61GB

Qwen2.5-Math-7B-Instruct-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q8_0
7.44GB file 9.55GB
M

Multimodalart

2 models

YuE-s1-7B-anneal-en-cot-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

YuE-s2-1B-general-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB
M

Multiverse Computing C A I

1 models

Hypernova-60B-2602-GGUF

60B 8K ctx
FP16
120GB file 122.98GB
M

Mungert

221 models

A.X-4.0-Light-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q1_0
0GB file 2GB
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

AceInstruct-1.5B-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
Q4_0
0.84GB file 2.86GB
Q4_1
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q5_1
1.03GB file 3.05GB
Q6_0
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB
BF16
3GB file 5.02GB

AceMath-1.5B-Instruct-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
Q4_0
0.84GB file 2.86GB
Q4_1
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q5_1
1.03GB file 3.05GB
Q6_0
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB
BF16
3GB file 5.02GB

AceMath-7B-Instruct-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

AceMath-RL-Nemotron-7B-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

AceReason-Nemotron-7B-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

AesCoder-4B-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

AI21-Jamba-Reasoning-3B-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_1
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

AM-Thinking-v1-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q5_1
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q1_0
1GB file 3.02GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

Apriel-1.5-15b-Thinker-GGUF

15B 8K ctx
Q2_0
4.69GB file 6.94GB
Q3_0
6.56GB file 8.81GB
Q4_0
8.44GB file 10.69GB
Q4_1
8.44GB file 10.69GB
Q5_0
10.31GB file 12.56GB
Q5_1
10.31GB file 12.56GB
Q6_0
12.19GB file 14.44GB
Q1_0
15GB file 17.25GB
Q8_0
15.94GB file 18.19GB
BF16
30GB file 32.25GB

AQUA-7B-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

Arch-Agent-1.5B-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
Q4_0
0.84GB file 2.86GB
Q4_1
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q5_1
1.03GB file 3.05GB
Q6_0
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB
BF16
3GB file 5.02GB

Arch-Agent-32B-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
Q3_0
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_1
22GB file 24.52GB
Q6_0
26GB file 28.52GB
Q1_0
32GB file 34.52GB
Q8_0
34GB file 36.52GB
BF16
64GB file 66.52GB

Arch-Agent-3B-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_1
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

Arch-Agent-7B-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

Arch-Router-1.5B-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
Q4_0
0.84GB file 2.86GB
Q4_1
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q5_1
1.03GB file 3.05GB
Q6_0
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB
BF16
3GB file 5.02GB

Aryabhata-1.0-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q1_0
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

C2S-Scale-Gemma-2-27B-GGUF

27B 8K ctx
Q2_0
8.44GB file 10.88GB
Q3_0
11.81GB file 14.25GB
Q4_0
15.19GB file 17.63GB
Q4_1
15.19GB file 17.63GB
Q5_0
18.56GB file 21GB
Q5_1
18.56GB file 21GB
Q6_0
21.94GB file 24.38GB
Q1_0
27GB file 29.44GB
Q8_0
28.69GB file 31.13GB
BF16
54GB file 56.44GB

cogito-v1-preview-llama-8B-GGUF

70B 8K ctx
Q2_0
21.88GB file 25.03GB
Q3_0
30.63GB file 33.78GB
Q4_0
39.38GB file 42.53GB
Q4_1
39.38GB file 42.53GB
Q5_0
48.13GB file 51.28GB
Q5_1
48.13GB file 51.28GB
Q6_0
56.88GB file 60.03GB
Q8_0
74.38GB file 77.53GB
BF16
140GB file 143.15GB

Dans-PersonalityEngine-V1.3.0-24b-GGUF

24B 8K ctx
Q2_0
7.5GB file 9.89GB
Q3_0
10.5GB file 12.89GB
Q4_0
13.5GB file 15.89GB
Q4_1
13.5GB file 15.89GB
Q5_0
16.5GB file 18.89GB
Q5_1
16.5GB file 18.89GB
Q6_0
19.5GB file 21.89GB
Q1_0
24GB file 26.39GB
Q8_0
25.5GB file 27.89GB
BF16
48GB file 50.39GB

DASD-4B-Thinking-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

DeepCoder-1.5B-Preview-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
Q4_0
0.84GB file 2.86GB
Q4_1
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q5_1
1.03GB file 3.05GB
Q6_0
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB
BF16
3GB file 5.02GB

DeepCoder-14B-Preview-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q5_1
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q1_0
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Devstral-Small-2505-GGUF

2505B 8K ctx
Q2_0
782.81GB file 825.85GB
Q3_0
1095.94GB file 1138.98GB
Q4_0
1409.06GB file 1452.1GB
Q4_1
1409.06GB file 1452.1GB
Q5_0
1722.19GB file 1765.23GB
Q5_1
1722.19GB file 1765.23GB
Q6_0
2035.31GB file 2078.35GB
Q1_0
2505GB file 2548.04GB
Q8_0
2661.56GB file 2704.6GB
BF16
5010GB file 5053.04GB

DMind-1-mini-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q5_1
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q1_0
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

DMind-3-GGUF

20B 8K ctx
Q2_0
6.25GB file 8.58GB
Q3_0
8.75GB file 11.08GB
Q4_0
11.25GB file 13.58GB
Q4_1
11.25GB file 13.58GB
Q5_0
13.75GB file 16.08GB
Q5_1
13.75GB file 16.08GB
Q6_0
16.25GB file 18.58GB
Q1_0
20GB file 22.33GB
Q8_0
21.25GB file 23.58GB
BF16
40GB file 42.33GB

DMind-3-mini-GGUF

4B 8K ctx
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

ERNIE-4.5-0.3B-PT-GGUF

0.3B 8K ctx
Q3_0
0.13GB file 2.13GB
Q4_0
0.17GB file 2.17GB
Q4_1
0.17GB file 2.17GB
Q5_0
0.21GB file 2.21GB
Q5_1
0.21GB file 2.21GB
Q6_0
0.24GB file 2.24GB
Q8_0
0.32GB file 2.32GB
BF16
0.6GB file 2.6GB

EXAONE-4.0-1.2B-GGUF

1.2B 8K ctx
Q3_0
0.53GB file 2.55GB
Q4_0
0.67GB file 2.69GB
Q4_1
0.67GB file 2.69GB
Q5_0
0.83GB file 2.85GB
Q5_1
0.83GB file 2.85GB
Q6_0
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB
BF16
2.4GB file 4.42GB

EXAONE-4.0-32B-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
Q3_0
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_1
22GB file 24.52GB
Q6_0
26GB file 28.52GB
Q1_0
32GB file 34.52GB
Q8_0
34GB file 36.52GB
BF16
64GB file 66.52GB

EXAONE-Deep-2.4B-GGUF

2.4B 8K ctx
Q2_0
0.75GB file 2.79GB
Q3_0
1.05GB file 3.09GB
Q4_0
1.35GB file 3.39GB
Q4_1
1.35GB file 3.39GB
Q5_0
1.65GB file 3.69GB
Q5_1
1.65GB file 3.69GB
Q6_0
1.95GB file 3.99GB
Q1_0
2.4GB file 4.44GB
Q8_0
2.55GB file 4.59GB
BF16
4.8GB file 6.84GB

EXAONE-Deep-32B-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
Q3_0
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_1
22GB file 24.52GB
Q6_0
26GB file 28.52GB
Q1_0
32GB file 34.52GB
Q8_0
34GB file 36.52GB
BF16
64GB file 66.52GB

EXAONE-Deep-7.8B-GGUF

7.8B 8K ctx
Q2_0
2.44GB file 4.57GB
Q3_0
3.41GB file 5.54GB
Q4_0
4.39GB file 6.52GB
Q4_1
4.39GB file 6.52GB
Q5_0
5.36GB file 7.49GB
Q5_1
5.36GB file 7.49GB
Q6_0
6.34GB file 8.47GB
Q8_0
8.29GB file 10.42GB
BF16
15.6GB file 17.73GB

FairyR1-32B-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
Q3_0
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_1
22GB file 24.52GB
Q6_0
26GB file 28.52GB
Q1_0
32GB file 34.52GB
Q8_0
34GB file 36.52GB
BF16
64GB file 66.52GB

Fathom-Search-4B-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Fin-R1-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q5_1
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

Foundation-Sec-8B-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

functiongemma-270m-it-GGUF

9B 8K ctx
Q3_0
3.94GB file 6.09GB
Q4_0
5.06GB file 7.21GB
Q4_1
5.06GB file 7.21GB
Q5_0
6.19GB file 8.34GB
Q5_1
6.19GB file 8.34GB
Q6_0
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB

gemma-3-1b-it-gguf

1B 8K ctx
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

gemma-3-270m-it-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q5_1
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

GigaChat3-10B-A1.8B-GGUF

10B 8K ctx
Q2_0
3.13GB file 5.29GB
Q3_0
4.38GB file 6.54GB
Q4_0
5.63GB file 7.79GB
Q4_1
5.63GB file 7.79GB
Q5_0
6.88GB file 9.04GB
Q5_1
6.88GB file 9.04GB
Q6_0
8.13GB file 10.29GB
Q1_0
10GB file 12.16GB
Q8_0
10.63GB file 12.79GB
BF16
20GB file 22.16GB

GLM-4.7-Flash-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q1_0
0GB file 2GB
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

GLM-Z1-9B-0414-GGUF

9B 8K ctx
Q2_0
2.81GB file 4.96GB
Q3_0
3.94GB file 6.09GB
Q4_0
5.06GB file 7.21GB
Q4_1
5.06GB file 7.21GB
Q5_0
6.19GB file 8.34GB
Q5_1
6.19GB file 8.34GB
Q6_0
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB

gpt-oss-20b-Derestricted-GGUF

20B 8K ctx
Q2_0
6.25GB file 8.58GB
Q3_0
8.75GB file 11.08GB
Q4_0
11.25GB file 13.58GB
Q4_1
11.25GB file 13.58GB
Q5_0
13.75GB file 16.08GB
Q5_1
13.75GB file 16.08GB
Q6_0
16.25GB file 18.58GB
Q1_0
20GB file 22.33GB
Q8_0
21.25GB file 23.58GB
BF16
40GB file 42.33GB

gpt-oss-20b-heretic-GGUF

20B 8K ctx
Q2_0
6.25GB file 8.58GB
Q3_0
8.75GB file 11.08GB
Q4_0
11.25GB file 13.58GB
Q4_1
11.25GB file 13.58GB
Q5_0
13.75GB file 16.08GB
Q5_1
13.75GB file 16.08GB
Q6_0
16.25GB file 18.58GB
Q1_0
20GB file 22.33GB
Q8_0
21.25GB file 23.58GB
BF16
40GB file 42.33GB

gpt-oss-safeguard-20b-GGUF

20B 8K ctx
Q2_0
6.25GB file 8.58GB
Q3_0
8.75GB file 11.08GB
Q4_0
11.25GB file 13.58GB
Q4_1
11.25GB file 13.58GB
Q5_0
13.75GB file 16.08GB
Q5_1
13.75GB file 16.08GB
Q6_0
16.25GB file 18.58GB
Q1_0
20GB file 22.33GB
Q8_0
21.25GB file 23.58GB
BF16
40GB file 42.33GB

granite-20b-code-base-8k-GGUF

20B 8K ctx
Q2_0
6.25GB file 8.58GB
Q3_0
8.75GB file 11.08GB
Q4_0
11.25GB file 13.58GB
Q4_1
11.25GB file 13.58GB
Q5_0
13.75GB file 16.08GB
Q5_1
13.75GB file 16.08GB
Q6_0
16.25GB file 18.58GB
Q1_0
20GB file 22.33GB
Q8_0
21.25GB file 23.58GB
BF16
40GB file 42.33GB

granite-20b-code-base-r1.1-GGUF

20B 8K ctx
Q2_0
6.25GB file 8.58GB
Q3_0
8.75GB file 11.08GB
Q4_0
11.25GB file 13.58GB
Q4_1
11.25GB file 13.58GB
Q5_0
13.75GB file 16.08GB
Q5_1
13.75GB file 16.08GB
Q6_0
16.25GB file 18.58GB
Q1_0
20GB file 22.33GB
Q8_0
21.25GB file 23.58GB
BF16
40GB file 42.33GB

granite-20b-code-instruct-8k-GGUF

20B 8K ctx
Q2_0
6.25GB file 8.58GB
Q3_0
8.75GB file 11.08GB
Q4_0
11.25GB file 13.58GB
Q4_1
11.25GB file 13.58GB
Q5_0
13.75GB file 16.08GB
Q5_1
13.75GB file 16.08GB
Q6_0
16.25GB file 18.58GB
Q1_0
20GB file 22.33GB
Q8_0
21.25GB file 23.58GB
BF16
40GB file 42.33GB

granite-20b-code-instruct-r1.1-GGUF

20B 8K ctx
Q2_0
6.25GB file 8.58GB
Q3_0
8.75GB file 11.08GB
Q4_0
11.25GB file 13.58GB
Q4_1
11.25GB file 13.58GB
Q5_0
13.75GB file 16.08GB
Q5_1
13.75GB file 16.08GB
Q6_0
16.25GB file 18.58GB
Q1_0
20GB file 22.33GB
Q8_0
21.25GB file 23.58GB
BF16
40GB file 42.33GB

granite-3.0-1b-a400m-base-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q5_1
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

granite-3.0-2b-base-GGUF

2B 8K ctx
Q3_0
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_1
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
BF16
4GB file 6.03GB

granite-3.0-2b-instruct-GGUF

2B 8K ctx
Q3_0
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_1
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
BF16
4GB file 6.03GB

granite-3.0-3b-a800m-base-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_1
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

granite-3.0-8b-base-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

granite-3.0-8b-instruct-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

granite-3.0-8b-lora-intrinsics-v0.1-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

granite-3.1-1b-a400m-base-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q5_1
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

granite-3.1-1b-a400m-instruct-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q5_1
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

granite-3.1-2b-instruct-GGUF

2B 8K ctx
Q3_0
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_1
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
BF16
4GB file 6.03GB

granite-3.1-3b-a800m-base-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_1
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

granite-3.1-3b-a800m-instruct-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_1
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

granite-3.1-8b-instruct-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

granite-3.1-8b-lora-intrinsics-v0.1-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

granite-3.2-2b-instruct-GGUF

2B 8K ctx
Q2_0
0.63GB file 2.66GB
Q3_0
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_1
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q1_0
2GB file 4.03GB
Q8_0
2.13GB file 4.16GB
BF16
4GB file 6.03GB

granite-3.2-8b-instruct-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q1_0
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

granite-3.2-8b-instruct-preview-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

granite-3.3-8b-instruct-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

granite-3b-code-base-128k-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_1
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

granite-3b-code-base-2k-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_1
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

granite-3b-code-instruct-128k-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_1
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

granite-3b-code-instruct-2k-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_1
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

granite-4.0-tiny-preview-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q1_0
0GB file 2GB
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

granite-7b-instruct-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

granite-8b-code-base-128k-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

granite-8b-code-base-4k-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

granite-8b-code-instruct-128k-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

granite-8b-code-instruct-4k-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

granite-guardian-3.0-2b-GGUF

2B 8K ctx
Q3_0
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_1
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
BF16
4GB file 6.03GB

granite-guardian-3.0-8b-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

granite-guardian-3.1-2b-GGUF

2B 8K ctx
Q3_0
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_1
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
BF16
4GB file 6.03GB

granite-guardian-3.1-8b-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

granite-guardian-3.2-3b-a800m-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_1
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

granite-guardian-3.2-5b-GGUF

5B 8K ctx
Q2_0
1.56GB file 3.64GB
Q3_0
2.19GB file 4.27GB
Q4_0
2.81GB file 4.89GB
Q4_1
2.81GB file 4.89GB
Q5_0
3.44GB file 5.52GB
Q5_1
3.44GB file 5.52GB
Q6_0
4.06GB file 6.14GB
Q8_0
5.31GB file 7.39GB
BF16
10GB file 12.08GB

HyperCLOVAX-SEED-Text-Instruct-0.5B-GGUF

0.5B 8K ctx
Q3_0
0.22GB file 2.23GB
Q4_0
0.28GB file 2.29GB
Q4_1
0.28GB file 2.29GB
Q5_0
0.34GB file 2.35GB
Q5_1
0.34GB file 2.35GB
Q6_0
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB
BF16
1GB file 3.01GB

II-Search-4B-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

instinct-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q1_0
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

Jan-nano-128k-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q1_0
0GB file 2GB
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

Jan-v1-4B-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Josiefied-Qwen3-8B-abliterated-v1-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

kanana-1.5-8b-instruct-2505-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

LFM2-1.2B-Extract-GGUF

1.2B 8K ctx
Q3_0
0.53GB file 2.55GB
Q4_0
0.67GB file 2.69GB
Q4_1
0.67GB file 2.69GB
Q5_0
0.83GB file 2.85GB
Q5_1
0.83GB file 2.85GB
Q6_0
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB
BF16
2.4GB file 4.42GB

LFM2-1.2B-RAG-GGUF

1.2B 8K ctx
Q3_0
0.53GB file 2.55GB
Q4_0
0.67GB file 2.69GB
Q4_1
0.67GB file 2.69GB
Q5_0
0.83GB file 2.85GB
Q5_1
0.83GB file 2.85GB
Q6_0
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB
BF16
2.4GB file 4.42GB

LFM2-1.2B-Tool-GGUF

1.2B 8K ctx
Q3_0
0.53GB file 2.55GB
Q4_0
0.67GB file 2.69GB
Q4_1
0.67GB file 2.69GB
Q5_0
0.83GB file 2.85GB
Q5_1
0.83GB file 2.85GB
Q6_0
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB
BF16
2.4GB file 4.42GB

LFM2-2.6B-Exp-GGUF

2.6B 8K ctx
Q3_0
1.14GB file 3.18GB
Q4_0
1.46GB file 3.5GB
Q4_1
1.46GB file 3.5GB
Q5_0
1.79GB file 3.83GB
Q5_1
1.79GB file 3.83GB
Q6_0
2.11GB file 4.15GB
Q8_0
2.76GB file 4.8GB
BF16
5.2GB file 7.24GB

LFM2-2.6B-GGUF

2.6B 8K ctx
Q3_0
1.14GB file 3.18GB
Q4_0
1.46GB file 3.5GB
Q4_1
1.46GB file 3.5GB
Q5_0
1.79GB file 3.83GB
Q5_1
1.79GB file 3.83GB
Q6_0
2.11GB file 4.15GB
Q8_0
2.76GB file 4.8GB
BF16
5.2GB file 7.24GB

LFM2-2.6B-Transcript-GGUF

2.6B 8K ctx
Q3_0
1.14GB file 3.18GB
Q4_0
1.46GB file 3.5GB
Q4_1
1.46GB file 3.5GB
Q5_0
1.79GB file 3.83GB
Q5_1
1.79GB file 3.83GB
Q6_0
2.11GB file 4.15GB
Q8_0
2.76GB file 4.8GB
BF16
5.2GB file 7.24GB

LFM2-350M-Extract-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

LFM2.5-1.2B-Base-GGUF

1.2B 8K ctx
Q3_0
0.53GB file 2.55GB
Q4_0
0.67GB file 2.69GB
Q4_1
0.67GB file 2.69GB
Q5_0
0.83GB file 2.85GB
Q5_1
0.83GB file 2.85GB
Q6_0
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB
BF16
2.4GB file 4.42GB

LFM2.5-1.2B-Instruct-GGUF

1.2B 8K ctx
Q3_0
0.53GB file 2.55GB
Q4_0
0.67GB file 2.69GB
Q4_1
0.67GB file 2.69GB
Q5_0
0.83GB file 2.85GB
Q5_1
0.83GB file 2.85GB
Q8_0
1.28GB file 3.3GB
BF16
2.4GB file 4.42GB

LFM2.5-1.2B-Thinking-GGUF

1.2B 8K ctx
Q3_0
0.53GB file 2.55GB
Q4_0
0.67GB file 2.69GB
Q4_1
0.67GB file 2.69GB
Q5_0
0.83GB file 2.85GB
Q5_1
0.83GB file 2.85GB
Q8_0
1.28GB file 3.3GB
BF16
2.4GB file 4.42GB

Llama-2-7b-chat-hf-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

Llama-3_3-Nemotron-Super-49B-v1_5-GGUF

49B 8K ctx
Q2_0
15.31GB file 18.11GB
Q3_0
21.44GB file 24.24GB
Q4_0
27.56GB file 30.36GB
Q4_1
27.56GB file 30.36GB
Q5_0
33.69GB file 36.49GB
Q5_1
33.69GB file 36.49GB
Q6_0
39.81GB file 42.61GB
Q1_0
49GB file 51.8GB
Q8_0
52.06GB file 54.86GB
BF16
98GB file 100.8GB

Llama-3_3-Nemotron-Super-49B-v1-GGUF

49B 8K ctx
Q2_0
15.31GB file 18.11GB
Q3_0
21.44GB file 24.24GB
Q4_0
27.56GB file 30.36GB
Q4_1
27.56GB file 30.36GB
Q5_0
33.69GB file 36.49GB
Q5_1
33.69GB file 36.49GB
Q6_0
39.81GB file 42.61GB
Q1_0
49GB file 51.8GB
Q8_0
52.06GB file 54.86GB
BF16
98GB file 100.8GB

Llama-3.1-70B-Instruct-GGUF

70B 8K ctx
Q2_0
21.88GB file 25.03GB
Q3_0
30.63GB file 33.78GB
Q4_0
39.38GB file 42.53GB
Q4_1
39.38GB file 42.53GB
Q5_0
48.13GB file 51.28GB
Q5_1
48.13GB file 51.28GB
Q6_0
56.88GB file 60.03GB
Q6_K
56.88GB file 60.03GB
Q1_0
70GB file 73.15GB
Q8_0
74.38GB file 77.53GB
BF16
140GB file 143.15GB

Llama-3.1-8B-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Llama-3.1-8B-Instruct-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Llama-3.1-Minitron-4B-Width-Base-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Llama-3.1-Nemotron-Nano-4B-v1.1-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Llama-3.1-Nemotron-Nano-8B-v1-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Llama-3.2-1B-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

Llama-3.2-1B-Instruct-GGUF

1B 8K ctx
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q4_1
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

Llama-3.2-3B-Instruct-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

Llama-Guard-3-8B-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q1_0
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Llama-xLAM-2-8b-fc-r-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Llama3.3-8B-Instruct-Thinking-Claude-4.5-Opus-High-Reasoning-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

LongWriter-Zero-32B-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
Q3_0
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_1
22GB file 24.52GB
Q6_0
26GB file 28.52GB
Q1_0
32GB file 34.52GB
Q8_0
34GB file 36.52GB
BF16
64GB file 66.52GB

Lucy-128k-GGUF

1.7B 8K ctx
Q2_0
0.53GB file 2.56GB
Q3_0
0.74GB file 2.77GB
Q4_0
0.96GB file 2.99GB
Q4_1
0.96GB file 2.99GB
Q5_0
1.17GB file 3.2GB
Q5_1
1.17GB file 3.2GB
Q6_0
1.38GB file 3.41GB
Q1_0
1.7GB file 3.73GB
Q8_0
1.81GB file 3.84GB
BF16
3.4GB file 5.43GB

Lucy-GGUF

1.7B 8K ctx
Q2_0
0.53GB file 2.56GB
Q3_0
0.74GB file 2.77GB
Q4_0
0.96GB file 2.99GB
Q4_1
0.96GB file 2.99GB
Q5_0
1.17GB file 3.2GB
Q5_1
1.17GB file 3.2GB
Q6_0
1.38GB file 3.41GB
Q1_0
1.7GB file 3.73GB
Q8_0
1.81GB file 3.84GB
BF16
3.4GB file 5.43GB

Magistral-Small-2506-abliterated-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q1_0
0GB file 2GB
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

medgemma-27b-text-it-GGUF

27B 8K ctx
Q2_0
8.44GB file 10.88GB
Q3_0
11.81GB file 14.25GB
Q4_0
15.19GB file 17.63GB
Q4_1
15.19GB file 17.63GB
Q5_0
18.56GB file 21GB
Q5_1
18.56GB file 21GB
Q6_0
21.94GB file 24.38GB
Q1_0
27GB file 29.44GB
Q8_0
28.69GB file 31.13GB
BF16
54GB file 56.44GB

mem-agent-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q1_0
0GB file 2GB
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q8_0
0GB file 2GB

Meta-Llama-3-8B-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Meta-Llama-3-8B-Instruct-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Midm-2.0-Base-Instruct-GGUF

2.0B 8K ctx
Q2_0
0.63GB file 2.66GB
Q3_0
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_1
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q1_0
2GB file 4.03GB
Q8_0
2.13GB file 4.16GB
BF16
4GB file 6.03GB

MiniCPM4-0.5B-GGUF

0.5B 8K ctx
Q3_0
0.22GB file 2.23GB
Q4_0
0.28GB file 2.29GB
Q4_1
0.28GB file 2.29GB
Q5_0
0.34GB file 2.35GB
Q5_1
0.34GB file 2.35GB
Q6_0
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB
BF16
1GB file 3.01GB

MiniCPM4-8B-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

MiniCPM4.1-8B-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

MiroThinker-1.7-mini-GGUF

235B 8K ctx
Q3_0
102.81GB file 108.66GB
Q4_0
132.19GB file 138.04GB
Q4_1
132.19GB file 138.04GB
Q5_0
161.56GB file 167.41GB
Q5_1
161.56GB file 167.41GB
Q6_0
190.94GB file 196.79GB
Q8_0
249.69GB file 255.54GB

MiroThinker-v1.0-30B-GGUF

30B 8K ctx
Q2_0
9.38GB file 11.87GB
Q3_0
13.13GB file 15.62GB
Q4_0
16.88GB file 19.37GB
Q4_1
16.88GB file 19.37GB
Q5_0
20.63GB file 23.12GB
Q5_1
20.63GB file 23.12GB
Q6_0
24.38GB file 26.87GB
Q1_0
30GB file 32.49GB
Q8_0
31.88GB file 34.37GB
BF16
60GB file 62.49GB

MiroThinker-v1.0-8B-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

MiroThinker-v1.5-30B-GGUF

30B 8K ctx
Q2_0
9.38GB file 11.87GB
Q3_0
13.13GB file 15.62GB
Q4_0
16.88GB file 19.37GB
Q4_1
16.88GB file 19.37GB
Q5_0
20.63GB file 23.12GB
Q5_1
20.63GB file 23.12GB
Q6_0
24.38GB file 26.87GB
Q1_0
30GB file 32.49GB
Q8_0
31.88GB file 34.37GB
BF16
60GB file 62.49GB

Mistral-7B-Instruct-v0.1-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

Mistral-Crab-DPO-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q1_0
0GB file 2GB
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

Nanbeige4-3B-Thinking-2511-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_1
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

Nanbeige4.1-3B-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_1
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

Nemotron-Mini-4B-Instruct-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

NextCoder-14B-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q5_1
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q1_0
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

NextCoder-7B-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

NVIDIA-Nemotron-3-Nano-30B-A3B-BF16-GGUF

30B 8K ctx
Q2_0
9.38GB file 11.87GB
Q3_0
13.13GB file 15.62GB
Q4_0
16.88GB file 19.37GB
Q4_1
16.88GB file 19.37GB
Q5_0
20.63GB file 23.12GB
Q5_1
20.63GB file 23.12GB
Q6_0
24.38GB file 26.87GB
Q1_0
30GB file 32.49GB
Q8_0
31.88GB file 34.37GB
BF16
60GB file 62.49GB

NVIDIA-Nemotron-3-Super-120B-A12B-BF16-GGUF

120B 8K ctx
Q2_0
37.5GB file 41.47GB
Q3_0
52.5GB file 56.47GB
Q4_0
67.5GB file 71.47GB
Q4_1
67.5GB file 71.47GB
Q5_0
82.5GB file 86.47GB
Q5_1
82.5GB file 86.47GB
Q6_0
97.5GB file 101.47GB
Q1_0
120GB file 123.97GB
Q8_0
127.5GB file 131.47GB
BF16
240GB file 243.97GB

NVIDIA-Nemotron-Nano-12B-v2-GGUF

12B 8K ctx
Q2_0
3.75GB file 5.95GB
Q3_0
5.25GB file 7.45GB
Q4_0
6.75GB file 8.95GB
Q4_1
6.75GB file 8.95GB
Q5_0
8.25GB file 10.45GB
Q5_1
8.25GB file 10.45GB
Q6_0
9.75GB file 11.95GB
Q1_0
12GB file 14.2GB
Q8_0
12.75GB file 14.95GB
BF16
24GB file 26.2GB

OlympicCoder-32B-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
Q3_0
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_1
22GB file 24.52GB
Q6_0
26GB file 28.52GB
Q1_0
32GB file 34.52GB
Q8_0
34GB file 36.52GB
BF16
64GB file 66.52GB

OlympicCoder-7B-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

OpenCodeReasoning-Nemotron-14B-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q5_1
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q1_0
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

OpenCodeReasoning-Nemotron-32B-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
Q3_0
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_1
22GB file 24.52GB
Q6_0
26GB file 28.52GB
Q1_0
32GB file 34.52GB
Q8_0
34GB file 36.52GB
BF16
64GB file 66.52GB

OpenCodeReasoning-Nemotron-32B-IOI-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
Q3_0
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_1
22GB file 24.52GB
Q6_0
26GB file 28.52GB
Q1_0
32GB file 34.52GB
Q8_0
34GB file 36.52GB
BF16
64GB file 66.52GB

OpenCodeReasoning-Nemotron-7B-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

openhands-lm-7b-v0.1-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

OpenMath-Nemotron-1.5B-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
Q4_0
0.84GB file 2.86GB
Q4_1
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q5_1
1.03GB file 3.05GB
Q6_0
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB
BF16
3GB file 5.02GB

OpenReasoning-Nemotron-1.5B-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
Q4_0
0.84GB file 2.86GB
Q4_1
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q5_1
1.03GB file 3.05GB
Q6_0
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB
BF16
3GB file 5.02GB

OpenReasoning-Nemotron-14B-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q5_1
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q1_0
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

OpenReasoning-Nemotron-32B-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
Q3_0
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_1
22GB file 24.52GB
Q6_0
26GB file 28.52GB
Q1_0
32GB file 34.52GB
Q8_0
34GB file 36.52GB
BF16
64GB file 66.52GB

OpenReasoning-Nemotron-7B-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

OpenThinker3-7B-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

Orchestrator-8B-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Pantheon-Proto-RP-1.8-30B-A3B-GGUF

30B 8K ctx
Q2_0
9.38GB file 11.87GB
Q3_0
13.13GB file 15.62GB
Q4_0
16.88GB file 19.37GB
Q4_1
16.88GB file 19.37GB
Q5_0
20.63GB file 23.12GB
Q5_1
20.63GB file 23.12GB
Q6_0
24.38GB file 26.87GB
Q1_0
30GB file 32.49GB
Q8_0
31.88GB file 34.37GB
BF16
60GB file 62.49GB

phi-4-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q1_0
4GB file 6.07GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Phi-4-mini-instruct-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q5_1
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q1_0
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Phi-4-mini-instruct.gguf

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q1_0
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Phi-4-mini-reasoning-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q5_1
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q1_0
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Phi-4-reasoning-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q5_1
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q1_0
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Phi-4-reasoning-plus-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q5_1
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q1_0
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

PLM-1.8B-Instruct-GGUF

1.8B 8K ctx
Q3_0
0.79GB file 2.82GB
Q4_0
1.01GB file 3.04GB
Q4_1
1.01GB file 3.04GB
Q5_0
1.24GB file 3.27GB
Q5_1
1.24GB file 3.27GB
Q6_0
1.46GB file 3.49GB
Q8_0
1.91GB file 3.94GB
BF16
3.6GB file 5.63GB

pokee_research_7b-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

Qwen2.5-0.5B-Instruct-GGUF

0.5B 8K ctx
Q3_0
0.22GB file 2.23GB
Q4_0
0.28GB file 2.29GB
Q4_1
0.28GB file 2.29GB
Q5_0
0.34GB file 2.35GB
Q6_0
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB
BF16
1GB file 3.01GB

Qwen2.5-1.5B-Instruct-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
Q4_0
0.84GB file 2.86GB
Q4_1
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q5_1
1.03GB file 3.05GB
Q6_0
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB
BF16
3GB file 5.02GB

Qwen2.5-14B-Instruct-1M-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q5_1
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q1_0
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Qwen2.5-14B-Instruct-GGUF

14B 8K ctx
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Qwen2.5-3B-Instruct-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

Qwen2.5-7B-Instruct-1M-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q1_0
7GB file 9.11GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

Qwen2.5-7B-Instruct-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

Qwen3-0.6B-GGUF

0.6B 8K ctx
Q3_0
0.26GB file 2.27GB
Q4_0
0.34GB file 2.35GB
Q4_1
0.34GB file 2.35GB
Q5_0
0.41GB file 2.42GB
Q5_1
0.41GB file 2.42GB
Q6_0
0.49GB file 2.5GB
Q8_0
0.64GB file 2.65GB
BF16
1.2GB file 3.21GB

Qwen3-1.7B-GGUF

1.7B 8K ctx
Q3_0
0.74GB file 2.77GB
Q4_0
0.96GB file 2.99GB
Q4_1
0.96GB file 2.99GB
Q5_0
1.17GB file 3.2GB
Q5_1
1.17GB file 3.2GB
Q6_0
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB
BF16
3.4GB file 5.43GB

Qwen3-14B-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q5_1
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q1_0
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Qwen3-30B-A1.5B-High-Speed-GGUF

30B 8K ctx
Q2_0
9.38GB file 11.87GB
Q3_0
13.13GB file 15.62GB
Q4_0
16.88GB file 19.37GB
Q4_1
16.88GB file 19.37GB
Q5_0
20.63GB file 23.12GB
Q5_1
20.63GB file 23.12GB
Q6_0
24.38GB file 26.87GB
Q8_0
31.88GB file 34.37GB
BF16
60GB file 62.49GB

Qwen3-30B-A3B-GGUF

30B 8K ctx
Q2_0
9.38GB file 11.87GB
Q3_0
13.13GB file 15.62GB
Q4_0
16.88GB file 19.37GB
Q4_1
16.88GB file 19.37GB
Q5_0
20.63GB file 23.12GB
Q5_1
20.63GB file 23.12GB
Q6_0
24.38GB file 26.87GB
Q1_0
30GB file 32.49GB
Q8_0
31.88GB file 34.37GB
BF16
60GB file 62.49GB

Qwen3-30B-A3B-Instruct-2507-GGUF

30B 8K ctx
Q2_0
9.38GB file 11.87GB
Q3_0
13.13GB file 15.62GB
Q4_0
16.88GB file 19.37GB
Q4_1
16.88GB file 19.37GB
Q5_0
20.63GB file 23.12GB
Q5_1
20.63GB file 23.12GB
Q6_0
24.38GB file 26.87GB
Q1_0
30GB file 32.49GB
Q8_0
31.88GB file 34.37GB
BF16
60GB file 62.49GB

Qwen3-30B-A3B-Thinking-2507-GGUF

30B 8K ctx
Q2_0
9.38GB file 11.87GB
Q3_0
13.13GB file 15.62GB
Q4_0
16.88GB file 19.37GB
Q4_1
16.88GB file 19.37GB
Q5_0
20.63GB file 23.12GB
Q5_1
20.63GB file 23.12GB
Q6_0
24.38GB file 26.87GB
Q1_0
30GB file 32.49GB
Q8_0
31.88GB file 34.37GB
BF16
60GB file 62.49GB

Qwen3-30B-A6B-16-Extreme-GGUF

30B 8K ctx
Q2_0
9.38GB file 11.87GB
Q3_0
13.13GB file 15.62GB
Q4_0
16.88GB file 19.37GB
Q4_1
16.88GB file 19.37GB
Q5_0
20.63GB file 23.12GB
Q5_1
20.63GB file 23.12GB
Q6_0
24.38GB file 26.87GB
Q1_0
30GB file 32.49GB
Q8_0
31.88GB file 34.37GB
BF16
60GB file 62.49GB

Qwen3-32B-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
Q3_0
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_1
22GB file 24.52GB
Q6_0
26GB file 28.52GB
Q1_0
32GB file 34.52GB
Q8_0
34GB file 36.52GB

Qwen3-4B-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Qwen3-4B-Instruct-2507-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Qwen3-4B-Thinking-2507-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

Qwen3-8B-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Qwen3-Coder-30B-A3B-Instruct-GGUF

30B 8K ctx
Q2_0
9.38GB file 11.87GB
Q3_0
13.13GB file 15.62GB
Q4_0
16.88GB file 19.37GB
Q4_1
16.88GB file 19.37GB
Q5_0
20.63GB file 23.12GB
Q5_1
20.63GB file 23.12GB
Q1_0
30GB file 32.49GB
Q8_0
31.88GB file 34.37GB
BF16
60GB file 62.49GB

Qwen3-Coder-Next-GGUF

57B 8K ctx
Q2_0
17.81GB file 20.74GB
Q3_0
24.94GB file 27.87GB
Q4_0
32.06GB file 34.99GB
Q4_1
32.06GB file 34.99GB
Q5_0
39.19GB file 42.12GB
Q5_1
39.19GB file 42.12GB
Q6_0
46.31GB file 49.24GB
Q8_0
60.56GB file 63.49GB
BF16
114GB file 116.93GB

Qwen3Guard-Gen-8B-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

QwenLong-L1-32B-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
Q3_0
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_1
22GB file 24.52GB
Q6_0
26GB file 28.52GB
Q1_0
32GB file 34.52GB
Q8_0
34GB file 36.52GB
BF16
64GB file 66.52GB

QwQ-32B-ArliAI-RpR-v4-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
Q3_0
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_1
22GB file 24.52GB
Q6_0
26GB file 28.52GB
Q1_0
32GB file 34.52GB
Q8_0
34GB file 36.52GB
BF16
64GB file 66.52GB

QwQ-32B-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
Q3_0
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_1
22GB file 24.52GB
Q6_0
26GB file 28.52GB
Q1_0
32GB file 34.52GB
Q8_0
34GB file 36.52GB
BF16
64GB file 66.52GB

Refact-1_6B-fim-GGUF

6B 8K ctx
Q2_0
1.88GB file 3.98GB
Q3_0
2.63GB file 4.73GB
Q4_0
3.38GB file 5.48GB
Q4_1
3.38GB file 5.48GB
Q5_0
4.13GB file 6.23GB
Q5_1
4.13GB file 6.23GB
Q6_0
4.88GB file 6.98GB
Q1_0
6GB file 8.1GB
Q8_0
6.38GB file 8.48GB
BF16
12GB file 14.1GB

rwkv7-0.1B-g1-GGUF

0.1B 8K ctx
Q3_0
0.04GB file 2.04GB
Q4_0
0.06GB file 2.06GB
Q4_1
0.06GB file 2.06GB
Q5_0
0.07GB file 2.07GB
Q5_1
0.07GB file 2.07GB
Q6_0
0.08GB file 2.08GB
Q8_0
0.11GB file 2.11GB
BF16
0.2GB file 2.2GB

rwkv7-0.4B-world-GGUF

0.4B 8K ctx
Q2_0
0.13GB file 2.14GB
Q3_0
0.18GB file 2.19GB
Q4_0
0.23GB file 2.24GB
Q4_1
0.23GB file 2.24GB
Q5_0
0.28GB file 2.29GB
Q5_1
0.28GB file 2.29GB
Q6_0
0.33GB file 2.34GB
Q1_0
0.4GB file 2.41GB
Q8_0
0.43GB file 2.44GB
BF16
0.8GB file 2.81GB

rwkv7-1.5B-g1-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
Q4_0
0.84GB file 2.86GB
Q4_1
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q5_1
1.03GB file 3.05GB
Q6_0
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB
BF16
3GB file 5.02GB

rwkv7-1.5B-world-GGUF

1.5B 8K ctx
Q2_0
0.47GB file 2.49GB
Q3_0
0.66GB file 2.68GB
Q4_0
0.84GB file 2.86GB
Q4_1
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q5_1
1.03GB file 3.05GB
Q6_0
1.22GB file 3.24GB
Q1_0
1.5GB file 3.52GB
Q8_0
1.59GB file 3.61GB
BF16
3GB file 5.02GB

rwkv7-191M-world-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q1_0
0GB file 2GB
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

rwkv7-2.9B-g1-GGUF

2.9B 8K ctx
Q3_0
1.27GB file 3.32GB
Q4_0
1.63GB file 3.68GB
Q4_1
1.63GB file 3.68GB
Q5_0
1.99GB file 4.04GB
Q5_1
1.99GB file 4.04GB
Q6_0
2.36GB file 4.41GB
Q8_0
3.08GB file 5.13GB
BF16
5.8GB file 7.85GB

rwkv7-2.9B-world-GGUF

2.9B 8K ctx
Q2_0
0.91GB file 2.96GB
Q3_0
1.27GB file 3.32GB
Q4_0
1.63GB file 3.68GB
Q4_1
1.63GB file 3.68GB
Q5_0
1.99GB file 4.04GB
Q5_1
1.99GB file 4.04GB
Q6_0
2.36GB file 4.41GB
Q1_0
2.9GB file 4.95GB
Q8_0
3.08GB file 5.13GB
BF16
5.8GB file 7.85GB

rwkv7-7.2B-g0-GGUF

7.2B 8K ctx
Q2_0
2.25GB file 4.37GB
Q3_0
3.15GB file 5.27GB
Q4_0
4.05GB file 6.17GB
Q4_1
4.05GB file 6.17GB
Q5_0
4.95GB file 7.07GB
Q5_1
4.95GB file 7.07GB
Q6_0
5.85GB file 7.97GB
Q8_0
7.65GB file 9.77GB
BF16
14.4GB file 16.52GB

RWKV7-Goose-World3-2.9B-HF-GGUF

2.9B 8K ctx
Q3_0
1.27GB file 3.32GB
Q4_0
1.63GB file 3.68GB
Q4_1
1.63GB file 3.68GB
Q5_0
1.99GB file 4.04GB
Q5_1
1.99GB file 4.04GB
Q6_0
2.36GB file 4.41GB
Q8_0
3.08GB file 5.13GB
BF16
5.8GB file 7.85GB

Seed-Coder-8B-Reasoning-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Skywork-SWE-32B-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
Q3_0
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_1
22GB file 24.52GB
Q6_0
26GB file 28.52GB
Q1_0
32GB file 34.52GB
Q8_0
34GB file 36.52GB
BF16
64GB file 66.52GB

SmallThinker-21BA3B-Instruct-GGUF

21B 8K ctx
Q2_0
6.56GB file 8.9GB
Q3_0
9.19GB file 11.53GB
Q4_0
11.81GB file 14.15GB
Q4_1
11.81GB file 14.15GB
Q5_0
14.44GB file 16.78GB
Q5_1
14.44GB file 16.78GB
Q6_0
17.06GB file 19.4GB
Q1_0
21GB file 23.34GB
Q8_0
22.31GB file 24.65GB
BF16
42GB file 44.34GB

SmallThinker-4BA0.6B-Instruct

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

SmolLM2-1.7B-Instruct-GGUF

1.7B 8K ctx
Q3_0
0.74GB file 2.77GB
Q4_0
0.96GB file 2.99GB
Q4_1
0.96GB file 2.99GB
Q5_0
1.17GB file 3.2GB
Q5_1
1.17GB file 3.2GB
Q6_0
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB
BF16
3.4GB file 5.43GB

SmolLM2-135M-Instruct-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

SmolLM2-360M-Instruct-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

Strand-Rust-Coder-14B-v1-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q5_1
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q1_0
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

SWE-agent-LM-32B-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
Q3_0
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_1
22GB file 24.52GB
Q6_0
26GB file 28.52GB
Q1_0
32GB file 34.52GB
Q8_0
34GB file 36.52GB
BF16
64GB file 66.52GB

SWE-Dev-32B-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
Q3_0
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_1
22GB file 24.52GB
Q6_0
26GB file 28.52GB
Q1_0
32GB file 34.52GB
Q8_0
34GB file 36.52GB
BF16
64GB file 66.52GB

TEN_Turn_Detection-GGUF

Unknown 8K ctx
BF16
0GB file 2GB
Q1_0
0GB file 2GB
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

Tongyi-DeepResearch-30B-A3B-GGUF

30B 8K ctx
Q2_0
9.38GB file 11.87GB
Q3_0
13.13GB file 15.62GB
Q4_0
16.88GB file 19.37GB
Q4_1
16.88GB file 19.37GB
Q5_0
20.63GB file 23.12GB
Q5_1
20.63GB file 23.12GB
Q6_0
24.38GB file 26.87GB
Q1_0
30GB file 32.49GB
Q8_0
31.88GB file 34.37GB
BF16
60GB file 62.49GB

UserLM-8b-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

VibeThinker-1.5B-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
Q4_0
0.84GB file 2.86GB
Q4_1
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q5_1
1.03GB file 3.05GB
Q6_0
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB
BF16
3GB file 5.02GB

VulnLLM-R-7B-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_1
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_1
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

WEBGEN-4B-Preview-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB

xLAM-2-32b-fc-r-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
Q3_0
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q4_1
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q5_1
22GB file 24.52GB
Q6_0
26GB file 28.52GB
Q1_0
32GB file 34.52GB
Q8_0
34GB file 36.52GB
BF16
64GB file 66.52GB

xLAM-2-3b-fc-r-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_1
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

Youtu-LLM-2B-GGUF

2B 8K ctx
Q3_0
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_1
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
BF16
4GB file 6.03GB

ZR1-1.5B-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
Q4_0
0.84GB file 2.86GB
Q4_1
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q5_1
1.03GB file 3.05GB
Q6_0
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB
BF16
3GB file 5.02GB
M

Munish0838

8 models

Matter-0.1-7B-boost-DPO-preview-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Matter-0.1-7B-boost-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Matter-0.1-7B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Matter-0.1-Slim-7B-A-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Matter-0.1-Slim-7B-B-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Matter-0.1-Slim-7B-C-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q3_K_M
3.06GB file 5.17GB
Q3_K_S
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q5_K_M
4.81GB file 6.92GB
Q5_K_S
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Mistral-7B-OpenOrca-Q4_K_M-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

Mistral-7B-OpenOrca-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB