All Supported Models

29681 AI models · 198875 quantization formats tracked

P

Patlegu

2 models

opnsense-agent-mistral

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

opnsense-agent-phi35

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
P

Patrickbdevaney

2 models

solidity

Unknown 8K ctx
Q2_K
0GB file 2GB
Q3_K_M
0GB file 2GB
Q5_K_M
0GB file 2GB

WizardLM-1b-GGUF

1B 8K ctx
Q5_K_M
0.69GB file 2.71GB
P

Patrickera

2 models

Meta-Llama-3-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Qwen2.5-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
P

Patrickzj

2 models

Llama-3.2-3B-Instruct-Q2_K-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
P

Patryks1

1 models

Qwen2.5-Coder-1.5B-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB
P

Paul Stansifer

15 models

qw-llama3.1-2e-4x1-8b-gguf

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q4_K_M
4.5GB file 6.63GB
Q8_0
8.5GB file 10.63GB

qw-us-gemma2-oldstyle-9b-adapter

9B 8K ctx
Q8_0
9.56GB file 11.71GB

qw3-gemma-7b-1x2e-4

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

qw3-gemma2-9b-1x2e-4

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB

qw3-gemma2-9b-1x4e-4

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB

qw3-gemma2-9b-1x6e-4

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

qw3-llama2-13b-1x2e-4

13B 8K ctx
Q8_0
13.81GB file 16.02GB

qw3-llama3-8b-1x2e-4

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

qw3-mistral0.1-7b-1x2e-4

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

qw3-mistralopenorca-7b-1x2e-4

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

qw3-yi1.5-9b-1x2e-4

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB

qwpl-gemma-2e-4x1-7b-4e-5

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

qwpl-gemma-4x1e-4-7b-1e-4

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

qwpl-gemma-7b-4x2e-5

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

qwpl-mistral-4x1e-4-7b-1e-4

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
P

Pauldyu57

1 models

gemma4-cnc-ll-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q8_0
4.25GB file 6.32GB
P

Paulkl

1 models

mixtral-8x7b-instruct-v0.1_Q4b_wa

7B 8K ctx
FP16
14GB file 16.11GB
P

Paulo037

1 models

stable-code-instruct-3b-spider-1500-steps-Q4

3B 8K ctx
Q4_K
1.69GB file 3.74GB
FP16
6GB file 8.05GB
P

Paultimothymooney

22 models

datagemma-rag-27b-it-Q4_K_M-GGUF

27B 8K ctx
Q4_0
15.19GB file 17.63GB
FP16
54GB file 56.44GB

datagemma-rag-27b-it-Q8_0-GGUF

27B 8K ctx
Q8_0
28.69GB file 31.13GB

datagemma-rig-27b-it-Q4_K_M-GGUF

27B 8K ctx
Q4_0
15.19GB file 17.63GB
FP16
54GB file 56.44GB

datagemma-rig-27b-it-Q8_0-GGUF

27B 8K ctx
Q8_0
28.69GB file 31.13GB

gemma-2-27b-it-Q4_K_M-GGUF

27B 8K ctx
Q4_0
15.19GB file 17.63GB
FP16
54GB file 56.44GB

gemma-2-27b-it-Q8_0-GGUF

27B 8K ctx
Q8_0
28.69GB file 31.13GB

gemma-2-9b-it-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

gemma-2-9b-it-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Instruct-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Phi-3.5-mini-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3.5-mini-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

phi-4-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Qwen2-7B-Instruct-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Qwen2.5-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-7B-Instruct-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Qwen2.5-Coder-0.5B-Instruct-Q8_0-GGUF

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB

Qwen2.5-Coder-1.5B-Instruct-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

Qwen2.5-Coder-3B-Instruct-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

Qwen2.5-Coder-7B-Instruct-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB