All Supported Models

29681 AI models · 198875 quantization formats tracked

P

Paiml

1 models

albor-370m-v1

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB
P

Palominohh

2 models

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Instruct-Q4_K_S-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
P

Pancho101

1 models

Uncensored-1b-Creative_Writing_RP-GGUF

1B 8K ctx
FP16
2GB file 4.02GB
P

Pandaiedu

1 models

Gemma3-1b-it

1B 8K ctx
Q4_0
0.56GB file 2.58GB
Q8_0
1.06GB file 3.08GB
P

Pankaj217

2 models

granite-3.3-8b-instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

granite-8b-code-instruct-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB
P

Pankajligade

1 models

tinyllama-irac-gguf

1.1B 8K ctx
Q4_0
0.62GB file 2.64GB
FP16
2.2GB file 4.22GB
P

Pankajmathur

5 models

Mimma-3-12b-Q4_K_M-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB
FP16
24GB file 26.2GB

Mimma-3-27b-Q2_K-GGUF

27B 8K ctx
Q2_0
8.44GB file 10.88GB
FP16
54GB file 56.44GB

Mimma-3-27b-Q4_K_M-GGUF

27B 8K ctx
Q4_0
15.19GB file 17.63GB
FP16
54GB file 56.44GB

RenCoder-Ministral-3-8B-Instruct-2512-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

RenCoder-Ministral-8B-Instruct-2410-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q4_XS
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
P

Pankajpandey Dev

2 models

Carbon-3B-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_M
1.31GB file 3.36GB
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Qwen3-0.6B-Hindi-Instruct-v1-GGUF

0.6B 8K ctx
Q2_K
0.19GB file 2.2GB
Q4_K_M
0.34GB file 2.35GB
Q5_K_M
0.41GB file 2.42GB
Q8_0
0.64GB file 2.65GB
P

Panos345

2 models

Qwen2.5-Coder-1.5B-Q4_0-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB

Refact-1_6-base-Q4_K_M-GGUF

6B 8K ctx
Q4_0
3.38GB file 5.48GB
FP16
12GB file 14.1GB
P

Pantelnm

1 models

Llama-3-8b-Alpaca-Finetuned-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB