All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Anquachdev

1 models

Vi-Qwen2-7B-RAG-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
A

Anrgxone0

3 models

Llama-3.2-1B-Instruct-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Llama-3.2-3B-Instruct-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB
A

Ans0N Wr0Ng

3 models

llama3.1-8b-cantonese_gguf_v3

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

llama3.1-8b-cantonese-gguf-test

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Qwen2.5-14b-Cantonese-gguf

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB
Q4_K_M
7.88GB file 10.11GB
Q8_0
14.88GB file 17.11GB
A

Ansdn999

1 models

gemma-2-2b-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB
A

Ansh0X

2 models

ace-0.5b-gguf

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
BF16
1GB file 3.01GB

mamba-2.8b-instruct-openhermes-gguf

2.8B 8K ctx
Q5_0
1.92GB file 3.97GB
Q8_0
2.97GB file 5.02GB
BF16
5.6GB file 7.65GB
A

Antash420

1 models

Llama-3.1-8B-Instruct-Q5_K_S-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB
A

Anteater Lan

2 models

llama-traditional-chinese-120M-Q5_K_M-GGUF

Unknown 8K ctx
Q5_0
0GB file 2GB
FP16
0GB file 2GB

llama-traditional-chinese-120M-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
A

Anthonym21

1 models

slipstream-glm-z1-9b-gguf

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
Q8_0
9.56GB file 11.71GB
A

Anthonymeo

2 models

augmented-smilodon-1

Unknown 8K ctx
FP16
0GB file 2GB

llama3.1-factory-Q4_K_M-GGUF

Unknown 8K ctx
Q4_0
0GB file 2GB
FP16
0GB file 2GB
A

Anthonymikinka

1 models

Qwen35-35B-Layers-Split

35B 8K ctx
FP16
70GB file 72.57GB