All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Adriey

3 models

Bellatrix-1.5B-xElite-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

Pictor-1338-QwenP-1.5B-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB

QwQ-R1-Distill-1.5B-CoT-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB
A

Adrlau

2 models

Chocolatine-3B-Instruct-DPO-Revised-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
A

Adv 11

3 models

gemma-3-1b-it-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Instruct-Q4_K_S-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
A

Adv Rahul

2 models

Axion-Pro-30B

30B 8K ctx
Q4_0
16.88GB file 19.37GB
FP16
60GB file 62.49GB

Axion-Thinking-21B-A3B-Q4_K_M-GGUF

21B 8K ctx
Q4_0
11.81GB file 14.15GB
FP16
42GB file 44.34GB
A

Advait Tahilyani

1 models

Phi-3-medium-128k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB
A

Aeon Core X Lab

1 models

Axion-Movie-Explainer

1.5B 8K ctx
Q4_K_M
0.84GB file 2.86GB
A

Aes Sedai

1 models

GLM-4.5-GGUF

4.5B 8K ctx
Q2_K
1.41GB file 3.48GB
Q4_K
2.53GB file 4.6GB
Q5_K
3.09GB file 5.16GB
Q6_K
3.66GB file 5.73GB
Q8_0
4.78GB file 6.85GB
A

Aessaputra

1 models

gemma-3-1b-it-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
A

Aetxebeste

1 models

Gemma-Kimu-9b-it-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB
A

Afg1

2 models

gemma-2-27b-it

27B 8K ctx
Q2_K
8.44GB file 10.88GB
Q4_K_M
15.19GB file 17.63GB
Q6_K
21.94GB file 24.38GB

gemma-2-2b-it

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_0
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q6_K
1.63GB file 3.66GB