All Supported Models

29681 AI models · 198875 quantization formats tracked

A

A R T E X I T

1 models

Llama-PLLuM-8B-instruct-ArtexIT-reasoning-GGUF

8B 8K ctx
Q5_K_M
5.5GB file 7.63GB
Q8_0
8.5GB file 10.63GB
A

A S T A R O T H0405

2 models

LFM2-8B-A1B-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q4_0
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

LFM2.5-1.2B-Instruct-GGUF

1.2B 8K ctx
Q4_0
0.67GB file 2.69GB
Q4_K_M
0.67GB file 2.69GB
Q5_K_M
0.83GB file 2.85GB
Q6_K
0.98GB file 3GB
Q8_0
1.28GB file 3.3GB
BF16
2.4GB file 4.42GB
A

A X O N V E R T E X A I R E S E A R C H

5 models

Llama-3.1-Nemotron-Safety-Guard-8B-v3-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Nemotron-Content-Safety-Reasoning-4B-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB

NVIDIA-Nemotron-Nano-9B-v2-Q8_0-GGUF

9B 8K ctx
Q8_0
9.56GB file 11.71GB

OpenGuardrails-Text-2510-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Qwen3Guard-Gen-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
A

A Y I N E D J I M I

3 models

CyberSec-Assistant-3B-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q8_0
3.19GB file 5.24GB

ISO27001-Expert-1.5B-GGUF

1.5B 8K ctx
Q4_K_M
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q8_0
1.59GB file 3.61GB

RGPD-Expert-1.5B-GGUF

1.5B 8K ctx
Q4_K_M
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q8_0
1.59GB file 3.61GB
A

A634579

1 models

Qwopus-GLM-18B-Merged-GGUF

9B 8K ctx
Q3_K_L
3.94GB file 6.09GB
Q4_XS
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q4_K_M
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
A

A8Nova

2 models

Phi-3-mini-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3.5-mini-instruct-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB
A

Aa1602295777

1 models

SmolLM2-1.7B-Instruct-GGUF

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q2_K_L
0.53GB file 2.56GB
Q3_K_L
0.74GB file 2.77GB
Q3_K_M
0.74GB file 2.77GB
Q3_K_S
0.74GB file 2.77GB
Q3_K_XL
0.74GB file 2.77GB
Q3_M
0.74GB file 2.77GB
Q3_XS
0.74GB file 2.77GB
Q4_XS
0.96GB file 2.99GB
Q4_K_S
0.96GB file 2.99GB
Q4_K_M
0.96GB file 2.99GB
Q4_K_L
0.96GB file 2.99GB
Q4_0
0.96GB file 2.99GB
Q5_K_L
1.17GB file 3.2GB
Q5_K_M
1.17GB file 3.2GB
Q5_K_S
1.17GB file 3.2GB
Q6_K_L
1.38GB file 3.41GB
Q6_K
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB
A

Aab20Abdullah

2 models

Akin-Yurt-Llama3-8B

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

qwen_OSINT

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q8_0
4.25GB file 6.32GB
A

Aaditya

1 models

gemma-2b-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
A

Aaeru

1 models

gemma-3-4b-Quran-1epochs-GGUF

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q8_0
4.25GB file 6.32GB