All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Antoste

29 models

gemma-2-2b-it-Q2_K-GGUF

2B 8K ctx
Q2_0
0.63GB file 2.66GB
FP16
4GB file 6.03GB

gemma-2-2b-Q2_K-GGUF

2B 8K ctx
Q2_0
0.63GB file 2.66GB
FP16
4GB file 6.03GB

gemma-2-2b-Q3_K_S-GGUF

2B 8K ctx
Q3_0
0.88GB file 2.91GB
FP16
4GB file 6.03GB

gemma-2-9b-it-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

gemma-2-9b-it-Q6_K-GGUF

9B 8K ctx
Q6_0
7.31GB file 9.46GB
FP16
18GB file 20.15GB

gpt2-xl-conversational-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB

Llama-3.1-8B-Italian-SAVA-Q2_K-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
FP16
16GB file 18.13GB

Loquace-410m-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Loquace-7B-Q3_K_S-GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
FP16
14GB file 16.11GB

Magiq-3-Q2_K-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q2_0
0GB file 2GB

Magiq-3-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB

Meta-Llama-3.1-8B-Instruct-IQ3_M-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Minerva-3B-base-v1.0-IQ3_M-GGUF

3B 8K ctx
Q3_0
1.31GB file 3.36GB
FP16
6GB file 8.05GB

Phi-3-medium-128k-instruct-Q2_K-GGUF

3.8B 8K ctx
Q2_0
1.19GB file 3.25GB
FP16
7.6GB file 9.66GB

Phi-3-medium-128k-instruct-Q3_K_S-GGUF

3.8B 8K ctx
Q3_0
1.66GB file 3.72GB
FP16
7.6GB file 9.66GB

Phi-3-medium-128k-instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

Phi-3-medium-128k-instruct-Q5_0-GGUF

0B 8K ctx
Q5_0
0GB file 2GB

Phi-3-mini-128k-instruct-IQ3_M-GGUF

3.8B 8K ctx
Q3_0
1.66GB file 3.72GB
FP16
7.6GB file 9.66GB

Phi-3-mini-128k-instruct-Q2_K-GGUF

3.8B 8K ctx
Q2_0
1.19GB file 3.25GB
FP16
7.6GB file 9.66GB

Qqqwen2-0.5B-Instruct-Q5_K_S-GGUF

0.5B 8K ctx
Q5_0
0.34GB file 2.35GB
FP16
1GB file 3.01GB

Qwen2-1.5B-Instruct-IQ3_M-GGUF

1.5B 8K ctx
Q3_0
0.66GB file 2.68GB
FP16
3GB file 5.02GB

Qwen2-1.5B-Instruct-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Qwen2-1.5B-Instruct-Q4_K_S-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

Qwen2-1.5B-Instruct-Q5_K_M-GGUF

1.5B 8K ctx
Q5_0
1.03GB file 3.05GB
FP16
3GB file 5.02GB

Qwen2-1.5B-Instruct-Q5_K_S-GGUF

1.5B 8K ctx
Q5_0
1.03GB file 3.05GB
FP16
3GB file 5.02GB

Qwen2-7B-Instruct-Q2_K-GGUF

7B 8K ctx
Q2_0
2.19GB file 4.3GB
FP16
14GB file 16.11GB

Qwen2.5-3B-Instruct-Q2_K-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
FP16
6GB file 8.05GB

SmolLM2-360M-Instruct-ita-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
A

Anu Amba

3 models

Llama-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.2-3B-Instruct-Q6_K-GGUF

3B 8K ctx
Q6_0
2.44GB file 4.49GB
FP16
6GB file 8.05GB

Llama3.3-8B-Instruct-Thinking-Claude-4.5-Opus-High-Reasoning-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
A

Anubhavmittra

2 models

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Phi-4-mini-instruct-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB
A

Anuragxone

1 models

Phi-4-mini-instruct-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB
A

Anvix

1 models

Qwen2-0.5B-Instruct-Q4_K_M-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
FP16
1GB file 3.01GB
A

Anysecret Io

1 models

anysecret-assistant

13B 8K ctx
Q4_K_M
7.31GB file 9.52GB
Q5_K_M
8.94GB file 11.15GB
Q8_0
13.81GB file 16.02GB
A

Anza27

2 models

Seed-Coder-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Seed-Coder-8B-Reasoning-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
A

Anzuo

1 models

QwQ-32B-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB
A

Aoiandroid

1 models

gemma-3-1b-it-qat-q4_0-gguf

1B 8K ctx
Q4_0
0.56GB file 2.58GB
A

Aokitools

6 models

japanese-laws-egov-base-202508011434

Unknown 8K ctx
FP16
0GB file 2GB

japanese-laws-egov-instruct-202508031857

Unknown 8K ctx
FP16
0GB file 2GB

japanese-laws-egov-instruct-202508051206

Unknown 8K ctx
FP16
0GB file 2GB

japanese-laws-egov-instruct-202508071025

Unknown 8K ctx
FP16
0GB file 2GB

japanese-laws-egov-instruct-202508182216

Unknown 8K ctx
FP16
0GB file 2GB

japanese-laws-egov-merge-202508191230

Unknown 8K ctx
FP16
0GB file 2GB