All Supported Models

29681 AI models · 198875 quantization formats tracked

A

And Emili

1 models

aera-4b-GGUF

4B 8K ctx
Q4_0
2.25GB file 4.32GB
FP16
8GB file 10.07GB
A

Andhiyaulhaq

1 models

natural2sql

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
A

Ando Shy

2 models

Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.2-1B-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
A

Andquant

13 models

gemma-2-2b-it-IQ4_NL-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

gemma-2-9b-it-IQ4_NL-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

Llama-3.1-8B-Instruct-IQ4_NL-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-IQ4_NL-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.2-1B-Instruct-IQ4_NL-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Instruct-Q5_K_M-GGUF

1B 8K ctx
Q5_0
0.69GB file 2.71GB
FP16
2GB file 4.02GB

Llama-3.2-1B-IQ4_NL-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-3B-Instruct-IQ4_NL-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Llama-3.2-3B-IQ4_NL-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Qwen2.5-3B-Instruct-IQ4_NL-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Qwen2.5-7B-Instruct-IQ4_NL-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen3-4B-Q8_0-GGUF

4B 8K ctx
Q8_0
4.25GB file 6.32GB
A

Andreasmartin

2 models

Mistral-7B-Instruct-gender-bias-dpo-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Mistral-7B-Instruct-gender-bias-sft-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
A

Andreasnbg

1 models

Huihui-GLM-5.1-abliterated-GGUF

Unknown 8K ctx
Q3_K
0GB file 2GB
A

Andreass123

2 models

gemma-2b-translation-v0.150-Q4_K_M-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB

Llama-3-Ko-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
A

Andreribeiro87

2 models

Qwen3.5-35B-A3B-telco-tracka-GGUF

35B 8K ctx
Q4_K_M
19.69GB file 22.26GB
Q4_0
19.69GB file 22.26GB
Q5_K_M
24.06GB file 26.63GB
Q5_0
24.06GB file 26.63GB
BF16
70GB file 72.57GB

telco-troubleshooting-agentic-challenge-gguf

Unknown 8K ctx
BF16
0GB file 2GB
Q4_K_M
0GB file 2GB
Q4_NL
0GB file 2GB
Q4_XS
0GB file 2GB
A

Andresgr96

2 models

gemma-3-1b-it-qat-A

1B 8K ctx
Q8_0
1.06GB file 3.08GB

gemma-3-1b-it-qat-B

1B 8K ctx
Q8_0
1.06GB file 3.08GB
A

Andrewheins55

1 models

GLM-4.7-Flash-GGUF

Unknown 8K ctx
Q4_K_S
0GB file 2GB
Q2_XXS
0GB file 2GB
Q3_K_M
0GB file 2GB
Q3_K_S
0GB file 2GB
Q3_K_XL
0GB file 2GB
Q3_XXS
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q4_K_M
0GB file 2GB
Q2_M
0GB file 2GB
Q4_K_XL
0GB file 2GB
Q4_NL
0GB file 2GB
Q4_XS
0GB file 2GB
Q5_K_M
0GB file 2GB
Q5_K_S
0GB file 2GB
Q5_K_XL
0GB file 2GB
Q6_K
0GB file 2GB
BF16
0GB file 2GB
Q8_K_XL
0GB file 2GB
Q8_0
0GB file 2GB
Q6_K_XL
0GB file 2GB
FP4
0GB file 2GB
Q1_0
0GB file 2GB
Q1_M
0GB file 2GB
Q1_S
0GB file 2GB
Q2_K
0GB file 2GB
Q2_K_L
0GB file 2GB
Q2_K_XL
0GB file 2GB