All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Alirizaercan

1 models

qwen2.5-0.5b-lunarlander-action-gguf

0.5B 8K ctx
Q4_K_M
0.28GB file 2.29GB
A

Alisonalvezz

2 models

Llama-3.2-1B-Q2_K-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
A

All For R A G

1 models

70b-elo-gec-2epoch

70B 8K ctx
Q4_K_M
39.38GB file 42.53GB
A

Allisterb

1 models

gemma3_270m_tools_test

4B 8K ctx
Q8_0
4.25GB file 6.32GB
BF16
8GB file 10.07GB
A

Allmalab

1 models

gpt2-aze

Unknown 8K ctx
FP16
0GB file 2GB
A

Allstax

2 models

AI-G-Expander-v5-GGUF

5B 8K ctx
Q4_K_M
2.81GB file 4.89GB
Q5_K_M
3.44GB file 5.52GB
Q6_K
4.06GB file 6.14GB

AI-G-Expander-v6-GGUF

6B 8K ctx
Q4_K_M
3.38GB file 5.48GB
Q5_K_M
4.13GB file 6.23GB
Q6_K
4.88GB file 6.98GB
A

Almax000

1 models

cellsentry-model

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB
A

Almeida1003

1 models

cabecinha-neuro-intent-classifier-v4_q4_k_m

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
A

Alokabhishek

5 models

gemma-1.1-7b-it-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
FP16
14GB file 16.11GB

gemma-7b-it-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
FP16
14GB file 16.11GB

Llama-2-7b-chat-hf-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB

Meta-Llama-3-8B-Instruct-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB

Mistral-7B-Instruct-v0.2-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
Q5_K_M
4.81GB file 6.92GB
A

Alpacapilot

1 models

Phi-4-mini-instruct-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB