All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Aswqazx

2 models

Qwen2.5-14B-Instruct-Q5_K_M-GGUF

14B 8K ctx
Q5_0
9.63GB file 11.86GB
FP16
28GB file 30.23GB

Qwen2.5-7B-Instruct-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB
A

Async Builds

1 models

qwen3-1.7b-promql

1.7B 8K ctx
Q4_K_M
0.96GB file 2.99GB
A

Asynclee

1 models

SmolLM2-360M-Instruct-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
A

Asystemoffields

2 models

IBM-granite-4.1-8b-heretic-PMRA-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Ministral-3-8B-Instruct-PMRA-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB
A

Ataeff

1 models

g

Unknown 8K ctx
Q8_0
0GB file 2GB
Q4_0
0GB file 2GB
A

Atahmih

6 models

Llama-2-7b-chat-hf-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

Llama-2-7b-chat-hf-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Llama-2-7b-chat-hf-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Llama-2-7b-hf-Q4_0-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB

Llama-2-7b-hf-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen3-0.6B-Q4_K_M-GGUF

0.6B 8K ctx
Q4_0
0.34GB file 2.35GB
FP16
1.2GB file 3.21GB
A

Atakan Tekparmak

1 models

MiniCPM3-4B-GGUF

4B 8K ctx
FP16
8GB file 10.07GB
A

Atcodespaceexplore

1 models

granite-3.3-8b-instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
A

Ateeqalghamdi

1 models

Quranak-Qwin-2.5-14B

14B 8K ctx
Q5_K_M
9.63GB file 11.86GB
A

Atla A I

2 models

Selene-1-Mini-Llama-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Selene-1-Mini-Llama-3.1-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB