All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Alex Linguist

1 models

AllwissenGPT-7B

7B 8K ctx
FP16
14GB file 16.11GB
A

Alex01837178373

7 models

GrayLine-Qwen3-8B-Q3_K_M-GGUF

8B 8K ctx
Q3_0
3.5GB file 5.63GB
FP16
16GB file 18.13GB

Llama-3.2-3B-Instruct-GGUF

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
Q5_K_M
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB
BF16
6GB file 8.05GB

Nanbeige4.1-3B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Qwen2.5-0.5B-Instruct-GGUF

0.5B 8K ctx
Q3_K_M
0.22GB file 2.23GB
Q4_K_M
0.28GB file 2.29GB
Q5_K_M
0.34GB file 2.35GB
Q6_K
0.41GB file 2.42GB
BF16
1GB file 3.01GB

Qwen2.5-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Qwen2.5-7B-Instruct-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

Qwen2.5-Coder-7B-Instruct-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB
A

Alex156

2 models

Meta-Llama-3-8B-Q2_K-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Q2_K-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
FP16
16GB file 18.13GB
A

Alex2110

1 models

qwen2.5-0.5b-code-bcp-v2

0.5B 8K ctx
Q4_K_M
0.28GB file 2.29GB
A

Alex2790

1 models

LFM2-8B-A1B-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q4_0
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB
A

Alexander Kyng

1 models

Mistral-Small-119B-2603-ik-GGUF

119B 8K ctx
Q4_K_R4
66.94GB file 70.89GB
Q5_K_R4
81.81GB file 85.76GB
BF16
238GB file 241.95GB
A

Alexander T G

3 models

gemma-3-1b-it-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-1B-Instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

QwQ-32B-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB
A

Alexandreteles

1 models

bonito-v1-gguf

1B 8K ctx
Q4_0
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
A

Alexcovo

5 models

codegemma-1.1-7b-it-Q4_K_M-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

codegemma-1.1-7b-it-Q5_K_M-GGUF

7B 8K ctx
Q5_K_M
4.81GB file 6.92GB

Llama3-ChatQA-1.5-8B-256K-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

NVIDIA-Nemotron-Nano-12B-v2-Q4_K_M-GGUF

12B 8K ctx
Q4_0
6.75GB file 8.95GB
FP16
24GB file 26.2GB

pokee7b.Q8_0.gguf

7B 8K ctx
Q8_0
7.44GB file 9.55GB
A

Alexedelsburg

1 models

Puma-3b-GGUF

3B 8K ctx
Q4_1
1.69GB file 3.74GB