All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Ayodele01

4 models

gemma-4-21b-a4b-it-REAP-GGUF

21B 8K ctx
Q3_K_M
9.19GB file 11.53GB
Q4_K_M
11.81GB file 14.15GB
Q5_K_M
14.44GB file 16.78GB
Q8_0
22.31GB file 24.65GB

gemma-4-E2B-Gemini-3.1-Pro-Reasoning-Distill-GGUF

2B 8K ctx
Q3_K_M
0.88GB file 2.91GB
Q4_K_M
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q8_0
2.13GB file 4.16GB

gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-GGUF

4B 8K ctx
Q3_K_M
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q8_0
4.25GB file 6.32GB

Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB
Q5_K_M
18.56GB file 21GB
Q8_0
28.69GB file 31.13GB
BF16
54GB file 56.44GB
A

Ayoubkirouane

1 models

Mistral-Depth-UP-Scaled-9B-AlpacaInstruct-gguf

9B 8K ctx
Q8_0
9.56GB file 11.71GB
A

Ayuag

1 models

yukt-med

Unknown 8K ctx
Q4_K_M
0GB file 2GB
A

Ayush Ash

1 models

Nanbeige4.1-3B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
A

Ayushmangarg

1 models

model

Unknown 8K ctx
Q4_K_M
0GB file 2GB
A

Ayushrupapara

1 models

llama3_gujarati_4bit_gguf

4B 8K ctx
FP16
8GB file 10.07GB
A

Ayy Y O O

3 models

MiniCPM4-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

MiniCPM4-8B-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB

MiniCPM4-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
A

Ayylex

3 models

Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Qwen2.5-7B-Instruct-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
A

Azatvaliev

1 models

sieve-llama-3.2-1b-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
A

Azerty76

1 models

Llama-3.1-8B-Lexi-Uncensored-GGUF

8B 8K ctx
Q2_M
2.5GB file 4.63GB
Q2_K_L
2.5GB file 4.63GB
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_XL
3.5GB file 5.63GB
Q3_M
3.5GB file 5.63GB
Q3_XS
3.5GB file 5.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_L
4.5GB file 6.63GB
Q5_K_L
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q6_K_L
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB