All Supported Models

29681 AI models · 198875 quantization formats tracked

P

Polar Bears W

1 models

Qwen2.5-32B-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB
P

Polushinm

1 models

Kodify-Nano-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
Q8_0
0GB file 2GB
P

Polystation

1 models

llama-3.2-3B-catalaV3-gguf

3B 8K ctx
FP16
6GB file 8.05GB
P

Polyverse

18 models

gemma-2-2b-it-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

gemma-2-2b-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

gemma-2-9b-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

gemma-2-9b-Q5_K_M-GGUF

9B 8K ctx
Q5_0
6.19GB file 8.34GB
FP16
18GB file 20.15GB

Llama-3.1-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3.2-1B-Q4_0-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB

Llama-3.2-1B-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

Llama-3.2-3B-Q5_K_M-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3-8B-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

Meta-Llama-3-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

Phi-3-mini-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Qwen2-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2-7B-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB
P

Pomelk1N

1 models

RuadaptQwen2.5-32B-instruct-4-bit-AWQ-GGUF

32B 8K ctx
Q4_K_M
18GB file 20.52GB
P

Pomni

1 models

OWoTGPT-1.3-GGUF

1.3B 8K ctx
Q2_0
0.41GB file 2.43GB
Q3_0
0.57GB file 2.59GB
Q4_0
0.73GB file 2.75GB
Q4_1
0.73GB file 2.75GB
Q5_0
0.89GB file 2.91GB
Q5_1
0.89GB file 2.91GB
Q6_0
1.06GB file 3.08GB
FP4
1.3GB file 3.32GB
Q1_0
1.3GB file 3.32GB
Q8_0
1.38GB file 3.4GB
BF16
2.6GB file 4.62GB
P

Pony Ding

1 models

Mayishenxiang-Llama-model-8B

8B 8K ctx
Q8_0
8.5GB file 10.63GB
P

Pony Of The Doom

1 models

Bielik-1.5B-reasoning-preview-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
Q6_0
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB
FP16
3GB file 5.02GB
P

Pony Wen

1 models

Llama-3.2-3B-Instruct-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB
P

Popiazaza

1 models

Qwen2.5-Coder-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB