All Supported Models

29681 AI models · 198875 quantization formats tracked

A

Aakash098

1 models

ShinchanAI-small

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
A

Aapo01

1 models

gemma-3-1b-it-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB
A

Aaron Feng753

3 models

GLM-4-32B-0414-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

GLM-4-32B-0414-Q5_K_S-GGUF

32B 8K ctx
Q5_0
22GB file 24.52GB
FP16
64GB file 66.52GB

granite-3.2-8b-instruct-preview-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
A

Aarony630

1 models

alio-medical

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
A

Aaryan K

15 models

GLM-4.7-Flash-GGUF

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q4_1
0GB file 2GB
Q5_0
0GB file 2GB
Q5_1
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

GLM-4.7-GGUF

4.7B 8K ctx
Q2_0
1.47GB file 3.55GB
Q3_0
2.06GB file 4.14GB
Q4_0
2.64GB file 4.72GB
Q5_0
3.23GB file 5.31GB
Q6_0
3.82GB file 5.9GB
Q8_0
4.99GB file 7.07GB

IQuest-Coder-V1-40B-Instruct-GGUF

40B 8K ctx
Q2_0
12.5GB file 15.16GB
Q3_0
17.5GB file 20.16GB
Q4_0
22.5GB file 25.16GB
Q4_1
22.5GB file 25.16GB
Q5_0
27.5GB file 30.16GB
Q5_1
27.5GB file 30.16GB
Q6_0
32.5GB file 35.16GB
Q8_0
42.5GB file 45.16GB

Kimi-Linear-48B-A3B-Instruct-GGUF

48B 8K ctx
Q2_0
15GB file 17.79GB
Q4_0
27GB file 29.79GB
Q8_0
51GB file 53.79GB

MiniMax-M2.1-GGUF

2.1B 8K ctx
Q2_0
0.66GB file 2.69GB
Q3_0
0.92GB file 2.95GB
Q4_0
1.18GB file 3.21GB
Q4_1
1.18GB file 3.21GB
Q5_0
1.44GB file 3.47GB
Q5_1
1.44GB file 3.47GB
Q6_0
1.71GB file 3.74GB
Q8_0
2.23GB file 4.26GB

MiniMax-M2.7-GGUF

2.7B 8K ctx
Q2_0
0.84GB file 2.88GB
Q4_0
1.52GB file 3.56GB
Q4_1
1.52GB file 3.56GB
Q5_0
1.86GB file 3.9GB
Q5_1
1.86GB file 3.9GB
Q6_0
2.19GB file 4.23GB
Q8_0
2.87GB file 4.91GB

Mistral-Small-4-119B-2603-GGUF

119B 8K ctx
Q2_0
37.19GB file 41.14GB
Q3_0
52.06GB file 56.01GB
Q4_0
66.94GB file 70.89GB
Q4_1
66.94GB file 70.89GB
Q5_0
81.81GB file 85.76GB
Q5_1
81.81GB file 85.76GB
Q6_0
96.69GB file 100.64GB
Q8_0
126.44GB file 130.39GB

NousCoder-14B-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q5_1
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Qwen3.5-0.8B-GGUF

0.8B 8K ctx
Q2_0
0.25GB file 2.26GB
Q3_0
0.35GB file 2.36GB
Q4_0
0.45GB file 2.46GB
Q4_1
0.45GB file 2.46GB
Q5_0
0.55GB file 2.56GB
Q5_1
0.55GB file 2.56GB
Q6_0
0.65GB file 2.66GB
Q8_0
0.85GB file 2.86GB
FP16
1.6GB file 3.61GB

Qwen3.5-2B-GGUF

2B 8K ctx
Q2_0
0.63GB file 2.66GB
Q3_0
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_1
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
FP16
4GB file 6.03GB

Qwen3.5-4B-GGUF

4B 8K ctx
Q2_0
1.25GB file 3.32GB
Q3_0
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q6_0
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
FP16
8GB file 10.07GB

Qwen3.5-9B-GGUF

9B 8K ctx
Q2_0
2.81GB file 4.96GB
Q3_0
3.94GB file 6.09GB
Q4_0
5.06GB file 7.21GB
Q4_1
5.06GB file 7.21GB
Q5_0
6.19GB file 8.34GB
Q5_1
6.19GB file 8.34GB
Q6_0
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
FP16
18GB file 20.15GB

Qwen3.6-27B-GGUF

27B 8K ctx
Q2_0
8.44GB file 10.88GB
Q3_0
11.81GB file 14.25GB
Q4_0
15.19GB file 17.63GB
Q4_1
15.19GB file 17.63GB
Q5_0
18.56GB file 21GB
Q6_0
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB
BF16
54GB file 56.44GB

Solar-Open-100B-GGUF

100B 8K ctx
Q2_0
31.25GB file 34.89GB
Q3_0
43.75GB file 47.39GB
Q4_0
56.25GB file 59.89GB
Q4_1
56.25GB file 59.89GB
Q5_0
68.75GB file 72.39GB
Q5_1
68.75GB file 72.39GB
Q6_0
81.25GB file 84.89GB
Q8_0
106.25GB file 109.89GB

Youtu-LLM-2B-GGUF

2B 8K ctx
Q2_0
0.63GB file 2.66GB
Q3_0
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_1
1.38GB file 3.41GB
Q6_0
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
FP16
4GB file 6.03GB
A

Aashish1904

20 models

DASD-4B-Thinking-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

datagemma-rag-27b-it-Q2_K-GGUF

27B 8K ctx
Q2_0
8.44GB file 10.88GB
FP16
54GB file 56.44GB

datagemma-rag-27b-it-Q4_K_M-GGUF

27B 8K ctx
Q4_0
15.19GB file 17.63GB
FP16
54GB file 56.44GB

gemma-2-27b-it-abliterated-Q4_K_M-GGUF

27B 8K ctx
Q4_0
15.19GB file 17.63GB
FP16
54GB file 56.44GB

gemma-2-2b-jpn-it-Q2_K-GGUF

2B 8K ctx
Q2_0
0.63GB file 2.66GB
FP16
4GB file 6.03GB

granite-3.0-2b-instruct-Q2_K-GGUF

2B 8K ctx
Q2_0
0.63GB file 2.66GB
FP16
4GB file 6.03GB

granite-3.0-2b-instruct-Q4_K_M-GGUF

2B 8K ctx
Q4_0
1.13GB file 3.16GB
FP16
4GB file 6.03GB

granite-3.0-2b-instruct-Q8_0-GGUF

2B 8K ctx
Q8_0
2.13GB file 4.16GB

granite-3.0-8b-instruct-Q2_K-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
FP16
16GB file 18.13GB

granite-3.0-8b-instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

granite-3.0-8b-instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Jan-v3-4B-base-instruct-GGUF

4B 8K ctx
Q2_K
1.25GB file 3.32GB
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q4_0
2.25GB file 4.32GB
Q4_1
2.25GB file 4.32GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q5_0
2.75GB file 4.82GB
Q5_1
2.75GB file 4.82GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB

Llama-3.1-Swallow-8B-v0.1-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

Llama-3.2-1B-Instruct-Q4_K_M-GGUF

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Llama-3.2-3B-Instruct-GGUF

3B 8K ctx
Q2_K
0.94GB file 2.99GB
Q3_K_L
1.31GB file 3.36GB
Q3_K_M
1.31GB file 3.36GB
Q3_K_S
1.31GB file 3.36GB
Q4_0
1.69GB file 3.74GB
Q4_1
1.69GB file 3.74GB
Q4_K_M
1.69GB file 3.74GB
Q4_K_S
1.69GB file 3.74GB
Q5_0
2.06GB file 4.11GB
Q5_1
2.06GB file 4.11GB
Q5_K_M
2.06GB file 4.11GB
Q5_K_S
2.06GB file 4.11GB
Q6_K
2.44GB file 4.49GB
Q8_0
3.19GB file 5.24GB

Llama-3.2-3B-Q4_K_M-GGUF

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB

Qwen3-1.7B-GGUF

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q3_K_L
0.74GB file 2.77GB
Q3_K_M
0.74GB file 2.77GB
Q3_K_S
0.74GB file 2.77GB
Q4_0
0.96GB file 2.99GB
Q4_1
0.96GB file 2.99GB
Q4_K_M
0.96GB file 2.99GB
Q4_K_S
0.96GB file 2.99GB
Q5_0
1.17GB file 3.2GB
Q5_1
1.17GB file 3.2GB
Q5_K_M
1.17GB file 3.2GB
Q5_K_S
1.17GB file 3.2GB
Q6_K
1.38GB file 3.41GB
Q8_0
1.81GB file 3.84GB

Qwen3-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q3_K_L
3.5GB file 5.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q5_1
5.5GB file 7.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

Qwen3.5-0.8B-GGUF

0.8B 8K ctx
Q2_K
0.25GB file 2.26GB
Q3_K_L
0.35GB file 2.36GB
Q3_K_M
0.35GB file 2.36GB
Q3_K_S
0.35GB file 2.36GB
Q4_0
0.45GB file 2.46GB
Q4_1
0.45GB file 2.46GB
Q4_K_M
0.45GB file 2.46GB
Q4_K_S
0.45GB file 2.46GB
Q5_0
0.55GB file 2.56GB
Q5_1
0.55GB file 2.56GB
Q5_K_M
0.55GB file 2.56GB
Q5_K_S
0.55GB file 2.56GB
Q6_K
0.65GB file 2.66GB
Q8_0
0.85GB file 2.86GB

Qwen3.5-2B-Base-GGUF

2B 8K ctx
Q2_K
0.63GB file 2.66GB
Q3_K_L
0.88GB file 2.91GB
Q3_K_M
0.88GB file 2.91GB
Q3_K_S
0.88GB file 2.91GB
Q4_0
1.13GB file 3.16GB
Q4_1
1.13GB file 3.16GB
Q4_K_M
1.13GB file 3.16GB
Q4_K_S
1.13GB file 3.16GB
Q5_0
1.38GB file 3.41GB
Q5_1
1.38GB file 3.41GB
Q5_K_M
1.38GB file 3.41GB
Q5_K_S
1.38GB file 3.41GB
Q6_K
1.63GB file 3.66GB
Q8_0
2.13GB file 4.16GB
A

Aashraf995

16 models

Chocolatine-3B-Instruct-DPO-Revised-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB

CodeQwen1.5-7B-Chat-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

CursorCore-QW2.5-7B-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

internlm2_5-7b-chat-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Llama-3.1-MedIT-SUN-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

mem-agent-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

Nemotron-Nano-9B

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

Nxcode-CQ-7B-orpo-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Nxcode-CQ-7B-orpo-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

OpenCoder-8B-Instruct-abliterated-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

OpenCoder-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

OpenCoder-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Phi-3-mini-128k-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Skywork-o1-Open-Llama-3.1-8B-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB

VibeThinker-1.5B-Q4_K_M-GGUF

1.5B 8K ctx
Q4_0
0.84GB file 2.86GB
FP16
3GB file 5.02GB

VibeThinker-1.5B-Q8_0-GGUF

1.5B 8K ctx
Q8_0
1.59GB file 3.61GB
A

Aathaval

1 models

Phi-4-mini-instruct-Q6_K-GGUF

14B 8K ctx
Q6_0
11.38GB file 13.61GB
FP16
28GB file 30.23GB
A

Aayushg159

2 models

Phi-3-medium-4k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_K_M
2.14GB file 4.2GB

Phi-3-mini-128k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_K_M
2.14GB file 4.2GB
A

Abagade

1 models

gemma-3-1b-bhagavad-gita-v1-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB