All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Ashercn97

2 models

QwQ-32B-Preview-Q2_K-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
FP16
64GB file 66.52GB

Skywork-o1-Open-Llama-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
A

Ashfaqfardin

1 models

titulm-llama-3.2-1b-v1.1-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q6_0
0.81GB file 2.83GB
Q8_0
1.06GB file 3.08GB
A

Ashish K

1 models

HindiModel

Unknown 8K ctx
Q4_1
0GB file 2GB
Q4_0
0GB file 2GB
A

Ashton Is Not Here

1 models

CodeLlama_7B_nlp_pp

7B 8K ctx
Q8_0
7.44GB file 9.55GB
A

Ashwin999

1 models

qwen3-4b-html-spatial-gguf

4B 8K ctx
Q4_K_M
2.25GB file 4.32GB
Q8_0
4.25GB file 6.32GB
A

Asidaddy

1 models

Deepseek-V4-Flash-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
A

Asit03

2 models

LB-14-05-25

Unknown 8K ctx
Q4_K_M
0GB file 2GB

vicuna-14-05-25

13B 8K ctx
Q4_K_M
7.31GB file 9.52GB
A

Askalgore

1 models

Dolphin-Mistral-24B-Venice-Edition-heretic-2

24B 8K ctx
Q8_0
25.5GB file 27.89GB
BF16
48GB file 50.39GB
A

Askaye

1 models

VibeThinker-1.5B-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q6_0
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB
FP16
3GB file 5.02GB
A

Astardeeppro

1 models

OpenAi-GPT-oss-20b-abliterated-uncensored-NEO-Imatrix-gguf

20B 8K ctx
Q4_NL
11.25GB file 13.58GB
Q5_1
13.75GB file 16.08GB
Q8_0
21.25GB file 23.58GB