All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Adamjen

1 models

Devstral-Small-2-24B-Opus-Reasoning

24B 8K ctx
Q4_K_M
13.5GB file 15.89GB
Q5_K_M
16.5GB file 18.89GB
A

Adamo1139

1 models

Danube3-4b-4chan-HESOYAM-2510-GGUF

4B 8K ctx
Q3_K_S
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
A

Adapala

1 models

Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB
A

Adaptiveaiventures

1 models

Llama-32-1B-finetuned-aaivtest5

1B 8K ctx
FP16
2GB file 4.02GB
A

Adarshmoradiya

1 models

Testing

Unknown 8K ctx
Q4_K_M
0GB file 2GB
A

Adavande

1 models

isentri

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q8_0
8.5GB file 10.63GB
BF16
16GB file 18.13GB
A

Ade111

1 models

Qwen3-4B-Thinking-2507-Q4_K_M-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB
A

Adeebaldkheel

1 models

ALLaM-7B-Instruct-preview-reasoning

7B 8K ctx
Q8_0
7.44GB file 9.55GB
A

Adeelahmad

2 models

ReasonableLlama3-3B-Jr

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q4_K
1.69GB file 3.74GB
Q6_0
2.44GB file 4.49GB
Q8_K
3.19GB file 5.24GB
Q8_0
3.19GB file 5.24GB

ReasonableQwen3-4B

4B 8K ctx
Q3_K
1.75GB file 3.82GB
Q4_K
2.25GB file 4.32GB
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB
A

Adeep H

1 models

Meta-Llama-3-8B-Q5_0-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB