All Supported Models

29681 AI models · 198875 quantization formats tracked

I

Ibm Ai Platform

1 models

Bamba-9B-v1

9B 8K ctx
FP16
18GB file 20.15GB
I

Ibm Granite

17 models

granite-20b-code-base-8k-GGUF

20B 8K ctx
Q4_K_M
11.25GB file 13.58GB

granite-20b-code-instruct-8k-GGUF

20B 8K ctx
Q4_K_M
11.25GB file 13.58GB

granite-3.3-2b-base-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_1
1.38GB file 3.41GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

granite-3.3-2b-instruct-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_1
1.38GB file 3.41GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

granite-3.3-8b-base-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

granite-3.3-8b-instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

granite-34b-code-base-8k-GGUF

34B 8K ctx
Q4_K_M
19.13GB file 21.69GB

granite-34b-code-instruct-8k-GGUF

34B 8K ctx
Q4_K_M
19.13GB file 21.69GB

granite-3b-code-base-2k-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB

granite-3b-code-instruct-2k-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB

granite-4.0-tiny-preview-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_L
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_K_S
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q6_K
0GB file 2GB
Q8_0
0GB file 2GB

granite-4.1-30b-GGUF

30B 8K ctx
Q2_K
9.38GB file 11.87GB
Q3_K_L
13.13GB file 15.62GB
Q3_K_M
13.13GB file 15.62GB
Q3_K_S
13.13GB file 15.62GB
Q4_0
16.88GB file 19.37GB
Q4_1
16.88GB file 19.37GB
Q4_K_M
16.88GB file 19.37GB
Q4_K_S
16.88GB file 19.37GB
Q5_0
20.63GB file 23.12GB
Q5_1
20.63GB file 23.12GB
Q5_K_M
20.63GB file 23.12GB
Q5_K_S
20.63GB file 23.12GB
Q6_K
24.38GB file 26.87GB
Q8_0
31.88GB file 34.37GB
BF16
60GB file 62.49GB

granite-4.1-3b-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_1
2.06GB file 4.11GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

granite-4.1-8b-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

granite-8b-code-base-4k-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

granite-8b-code-instruct-4k-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

granite-guardian-3.3-8b-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
I

Ibm Research

4 models

granite-3.2-2b-instruct-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_1
1.38GB file 3.41GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

granite-3.2-8b-instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

granite-guardian-3.2-3b-a800m-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

granite-guardian-3.2-5b-GGUF

5B 8K ctx
Q4_K_M
2.81GB file 4.89GB
Q5_K_M
3.44GB file 5.52GB
Q6_K
4.06GB file 6.14GB
Q8_0
5.31GB file 7.39GB
I

Ibndias

2 models

kanana-safeguard-8b-Q2_K-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
FP16
16GB file 18.13GB

kanana-safeguard-8b-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
I

Ibraeh

1 models

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
I

Ibrahho

1 models

model

Unknown 8K ctx
Q4_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB
Q8_0
0GB file 2GB
I

Icecubetr

1 models

Kumru-2B-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q2_XXS
0.63GB file 2.66GB
Q3_K_M
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q4_XS
1.13GB file 3.16GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
I

Icefog72

1 models

Elbaz-NVIDIA-Nemotron-3-Nano-30B-A3B-PRISM-Q5_K_M

0B 8K ctx
Q5_K_M
0GB file 2GB
I

Ichi Nya

1 models

eveler_gguf

12B 8K ctx
Q4_0
6.75GB file 8.95GB
FP16
24GB file 26.2GB
I

Ichsan2895

3 models

Merak-7B-v3-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Merak-7B-v4-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

Merak-7B-v5-PROTOTYPE1-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB