All Supported Models

29681 AI models · 198875 quantization formats tracked

P

Probiotic Farmer

2 models

phi-4-Q5_K_M-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

phi-4-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
P

Professorf

23 models

AMD-OLMo-1B-gguf

1B 8K ctx
Q8_0
1.06GB file 3.08GB

AMD-OLMo-1B-SFT-gguf

1B 8K ctx
Q8_0
1.06GB file 3.08GB

CodeLlama-7b-Instruct-hf-gguf

7B 8K ctx
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB
BF16
14GB file 16.11GB

Dolphin-Mistral-24B-Venice-Edition-gguf

24B 8K ctx
Q2_0
7.5GB file 9.89GB
Q3_0
10.5GB file 12.89GB
Q4_0
13.5GB file 15.89GB
Q5_0
16.5GB file 18.89GB
Q6_0
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB
BF16
48GB file 50.39GB

gemma-2-9b-q8_0-gguf

9B 8K ctx
Q8_0
9.56GB file 11.71GB

gpt-oss-20b-mxfp4-gguf

20B 8K ctx
FP4
20GB file 22.33GB
BF16
40GB file 42.33GB

Llama-3.1-8B-Instruct-gguf

8B 8K ctx
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB

Llama-3.2-1B-Instruct-f16-gguf

1B 8K ctx
FP16
2GB file 4.02GB

Llama-3.2-1B-Instruct-gguf

1B 8K ctx
Q4_0
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
BF16
2GB file 4.02GB

Llama-3.2-3B-Instruct-gguf

3B 8K ctx
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

Meta-Llama-3-1-8B-Instruct-f16-gguf

8B 8K ctx
FP16
16GB file 18.13GB

Meta-Llama-3-1-8B-Instruct-q8_0-gguf

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Meta-Llama-3-8B-Instruct-16f-gguf

8B 8K ctx
FP16
16GB file 18.13GB

Meta-Llama-3-8B-Instruct-gguf

8B 8K ctx
FP16
16GB file 18.13GB

phi-1-gguf

1B 8K ctx
FP16
2GB file 4.02GB

phi-3-mini-128k-f16-gguf

16B 8K ctx
FP16
32GB file 34.26GB

Phi-4-mini-instruct-gguf

14B 8K ctx
Q4_0
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Qwen2.5-0.5B-Instruct-gguf

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB

Qwen2.5-7B-Instruct-1M-gguf

7B 8K ctx
Q8_0
7.44GB file 9.55GB

SmolLM-135M-Instruct-gguf

Unknown 8K ctx
Q8_0
0GB file 2GB

SmolLM2-1.7B-Instruct-gguf

1.7B 8K ctx
Q8_0
1.81GB file 3.84GB

SmolLM2-135M-Instruct-gguf

Unknown 8K ctx
Q8_0
0GB file 2GB

SmolLM2-360M-Instruct

Unknown 8K ctx
Q8_0
0GB file 2GB
P

Professorsynapse

1 models

nexus-tools_sft17

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
P

Prometheus Eval

1 models

prometheus-7b-v2.0-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
P

Promptagainstthemachine

1 models

cveparrot

Unknown 8K ctx
FP16
0GB file 2GB
P

Protecttors

1 models

sample-files

0.5B 8K ctx
FP16
1GB file 3.01GB
P

Proto Neuron 3

2 models

NeuNego-3B-Dark

3B 8K ctx
FP16
6GB file 8.05GB

NeuTomic_1.8B_v1

1.8B 8K ctx
FP16
3.6GB file 5.63GB
P

Prsyahmi

6 models

malaysian-gemma-2B-16k-instructions-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB

malaysian-mistral-7b-32k-instructions-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_M
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q4_K_S
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
FP16
14GB file 16.11GB

malaysian-mistral-7b-32k-instructions-v2-ckpt-1700-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
FP16
14GB file 16.11GB

malaysian-mistral-7b-32k-instructions-v4-GGUF

7B 8K ctx
Q2_K
2.19GB file 4.3GB
Q3_K_L
3.06GB file 5.17GB
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
Q6_K
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

mallam-1.1b-20k-instructions-v2-GGUF

1.1B 8K ctx
Q2_K
0.34GB file 2.36GB
Q3_K_L
0.48GB file 2.5GB
Q4_K_M
0.62GB file 2.64GB
Q5_K_M
0.76GB file 2.78GB
Q6_K
0.89GB file 2.91GB
Q8_0
1.17GB file 3.19GB

mallam-5b-20k-instructions-v2-GGUF

5B 8K ctx
Q2_K
1.56GB file 3.64GB
Q3_K_L
2.19GB file 4.27GB
Q4_K_M
2.81GB file 4.89GB
Q5_K_M
3.44GB file 5.52GB
Q6_K
4.06GB file 6.14GB
Q8_0
5.31GB file 7.39GB
P

Pruthvirahul

1 models

astramind-gguf

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
P

Pshebel

1 models

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB