All Supported Models

29681 AI models · 198875 quantization formats tracked

P

Pepistrafforello

1 models

Meta-Llama-3-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
P

Peppi314

2 models

SR2AM-v0.1-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

SR2AM-v1.0-30B-IQ2XXS-asym-GGUF

30B 8K ctx
Q2_0
9.38GB file 11.87GB
FP16
60GB file 62.49GB
P

Percyraskova

1 models

MLMLML

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
P

Pererikgronvik

4 models

jamph-qwen2.5-coder-14b-instruct-q5_k_m

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

jamph-qwen2.5-coder-14b-instruct-q8_0

14B 8K ctx
Q8_0
14.88GB file 17.11GB

jamph-qwen2.5-coder-7b-instruct-q8_0

7B 8K ctx
Q8_0
7.44GB file 9.55GB

jamph-qwen2.5-coder-7b-q4_k_m

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
P

Perfect Presentation

1 models

rcrc-chat-v5-gemma-1b-cpt-sft

1B 8K ctx
Q4_K_M
0.56GB file 2.58GB
Q5_K_M
0.69GB file 2.71GB
Q8_0
1.06GB file 3.08GB
P

Performanceoptician

5 models

Llama-3.1-Tulu-3-8B-IQ3_XXS-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

MiniCPM3-4B-IQ4_NL-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB

OpenCoder-8B-Instruct-IQ3_XXS-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Qwen2.5-3B-Instruct-IQ4_NL-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Qwen2.5-7B-Instruct-IQ3_XXS-GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
FP16
14GB file 16.11GB
P

Persadian

2 models

DeepSeek-V4-Flash-GGUF

284B 8K ctx
Q1_S
284GB file 290.65GB

DeepSeek-V4-Flash-IQ1_S-XL

284B 8K ctx
Q1_S
284GB file 290.65GB
P

Pestova

1 models

deepseek-coder-1.3b-function-calling-v1

1.3B 8K ctx
FP16
2.6GB file 4.62GB
P

Peterl111

2 models

functiongemma-270m-it-Q2_K-GGUF

9B 8K ctx
Q2_0
2.81GB file 4.96GB
FP16
18GB file 20.15GB

functiongemma-270m-it-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB
P

Peterpeter8585

6 models

Llama-3-Open-Ko-8B-Instruct-preview-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

Llama-3-Open-Ko-8B-Instruct-preview-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Llama-3.2-1B-Instruct-Q2_K-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
FP16
2GB file 4.02GB

zephyr-7b-beta-Q2_K-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
FP16
14GB file 16.11GB

zephyr-7b-beta-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

zephyr-7b-beta-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB