All Supported Models

29681 AI models · 198875 quantization formats tracked

P

Pavankumarbalijepalli

1 models

phi2-sqlcoder

Unknown 8K ctx
FP16
0GB file 2GB
P

Paviththiren

2 models

Qwen2.5-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-7B-Instruct-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB
P

Pavoldobias

1 models

instructlab-merlinite-7b

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
P

Pawan Krd

1 models

Meta-Llama-3-8B-Instruct-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_0
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
P

Pawlaszc

1 models

DigitalForensicsText2SQLite

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB
FP16
6GB file 8.05GB
P

Pawlyk

1 models

mistral-7b-finetune-lora-wiki

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q8_0
7.44GB file 9.55GB
P

Pbatra

7 models

DeepSeek-R1-Distill-Llama-8B-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Q8_0
8.5GB file 10.63GB

DeepSeek-R1-Distill-Qwen-1.5B-GGUF

1.5B 8K ctx
Q2_K
0.47GB file 2.49GB
Q3_K_S
0.66GB file 2.68GB
Q3_K_M
0.66GB file 2.68GB
Q3_K_L
0.66GB file 2.68GB
Q4_0
0.84GB file 2.86GB
Q4_K_M
0.84GB file 2.86GB
Q4_K_S
0.84GB file 2.86GB
Q5_K_S
1.03GB file 3.05GB
Q5_K_M
1.03GB file 3.05GB
Q5_0
1.03GB file 3.05GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

DeepSeek-R1-Distill-Qwen-14B-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
Q8_0
14.88GB file 17.11GB

DeepSeek-R1-Distill-Qwen-32B-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB

DeepSeek-R1-Distill-Qwen-7B-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q8_0
7.44GB file 9.55GB

Llama-3.1-8B-Instruct-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Q8_0
8.5GB file 10.63GB

TinyLlama-1.1B-Chat-v1.0-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB
Q3_K_M
0.48GB file 2.5GB
Q3_K_L
0.48GB file 2.5GB
Q3_K_S
0.48GB file 2.5GB
Q4_0
0.62GB file 2.64GB
Q4_K_M
0.62GB file 2.64GB
Q4_K_S
0.62GB file 2.64GB
Q5_K_S
0.76GB file 2.78GB
Q5_K_M
0.76GB file 2.78GB
Q5_0
0.76GB file 2.78GB
Q6_K
0.89GB file 2.91GB
Q8_0
1.17GB file 3.19GB
FP32
4.4GB file 6.42GB
P

Pcuenq

5 models

gemma-2-2b-it-Q4_0-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB

Llama-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.2-1B-Instruct-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

Llama-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Qwen2.5-0.5B-Instruct-with-new-merges-serialization-Q8_0-GGUF

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB
P

Pechaut

1 models

Mistral-C64Wizard-instruct-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB
P

Pedalnomica

1 models

Qwen2.5-0.5B-Instruct-GGUF-q2_k

0.5B 8K ctx
Q2_0
0.16GB file 2.17GB
FP16
1GB file 3.01GB