All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Akolit

1 models

aldan-mix-8x7B-gguf

7B 8K ctx
Q4_0
3.94GB file 6.05GB
A

Akronik

2 models

Qwen2.5-0.5B-Instruct-GGUF

0.5B 8K ctx
Q2_0
0.16GB file 2.17GB
Q3_0
0.22GB file 2.23GB
Q4_0
0.28GB file 2.29GB
Q5_0
0.34GB file 2.35GB
Q6_0
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB
FP16
1GB file 3.01GB

Qwen2.5-Coder-3B-Instruct-GGUF

3B 8K ctx
Q2_0
0.94GB file 2.99GB
Q3_0
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q6_0
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
FP16
6GB file 8.05GB
A

Aksara L L M

5 models

aksarallm-1.5b-native-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q6_0
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

AksaraLLM-Qwen-1.5B-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q6_0
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

AksaraLLM-Qwen-1.5B-v5-public-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q6_0
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

Kiel-Pro-0.5B-v3-chat-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
Q5_0
0.34GB file 2.35GB
Q6_0
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB

Kiel-Pro-0.5B-v3-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
Q5_0
0.34GB file 2.35GB
Q6_0
0.41GB file 2.42GB
Q8_0
0.53GB file 2.54GB
A

Akshatsharma14195

1 models

gemma-2-2b-it-Q4_0-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
A

Akshay1996

2 models

Phi-3-mini-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

phi-4-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB
A

Akshaykdeo

2 models

Phi-3.5-mini-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-4-mini-instruct-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB
A

Al Hin

1 models

Llama-3.2-1B-Instruct-IMat-GGUF

1B 8K ctx
Q2_XXS
0.31GB file 2.33GB
Q2_XS
0.31GB file 2.33GB
Q2_S
0.31GB file 2.33GB
Q2_M
0.31GB file 2.33GB
Q2_K_S
0.31GB file 2.33GB
Q2_K
0.31GB file 2.33GB
Q3_XS
0.44GB file 2.46GB
Q3_K_L
0.44GB file 2.46GB
Q3_K
0.44GB file 2.46GB
Q3_K_S
0.44GB file 2.46GB
Q3_M
0.44GB file 2.46GB
Q3_S
0.44GB file 2.46GB
Q3_XXS
0.44GB file 2.46GB
Q4_K
0.56GB file 2.58GB
Q4_XS
0.56GB file 2.58GB
Q4_K_S
0.56GB file 2.58GB
Q4_NL
0.56GB file 2.58GB
Q5_K_S
0.69GB file 2.71GB
Q5_K
0.69GB file 2.71GB
Q6_K
0.81GB file 2.83GB
Q1_M
1GB file 3.02GB
Q1_S
1GB file 3.02GB
Q8_0
1.06GB file 3.08GB
FP16
2GB file 4.02GB
BF16
2GB file 4.02GB
A

Al Sam Cur123

1 models

Mistral-Nemo-InstructContinuedFine

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q4_0
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
A

Al X

1 models

Qwen2.5-14B-Instruct-1M-Q8_0-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB
A

Aladar

4 models

llama-2-tiny-random-GGUF

Unknown 8K ctx
FP16
0GB file 2GB

tiny-random-BloomForCausalLM-GGUF

Unknown 8K ctx
FP16
0GB file 2GB

tiny-random-LlamaForCausalLM-GGUF

Unknown 8K ctx
FP16
0GB file 2GB

TinyLLama-v0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB