All Supported Models

29681 AI models · 198875 quantization formats tracked

C

Cmchenry66

2 models

Llama-3.1-8B-Instruct-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

Llama-3.1-8B-Instruct-Q5_K_S-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB
C

Cmh

1 models

vigogne-2-13b-chat-gguf

13B 8K ctx
Q3_K_L
5.69GB file 7.9GB
Q3_K_M
5.69GB file 7.9GB
Q3_K_S
5.69GB file 7.9GB
Q4_K_M
7.31GB file 9.52GB
Q4_K_S
7.31GB file 9.52GB
Q5_K_M
8.94GB file 11.15GB
Q5_K_S
8.94GB file 11.15GB
Q6_K
10.56GB file 12.77GB
Q8_0
13.81GB file 16.02GB
C

Cminja

5 models

Llama-3-8B-Instruct-Gradient-1048k-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

Llama-3-8B-Instruct-Gradient-1048k-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

Phi-3-mini-128k-instruct-Q2_K-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB

Phi-3-mini-128k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_K_M
2.14GB file 4.2GB

Phi-3-mini-128k-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB
C

Cmndcntrlcyber

2 models

qwen14b-code-rtpi-tools-gguf

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB

qwen14b-code-trainer-v6-gguf

14B 8K ctx
Q4_K_M
7.88GB file 10.11GB
C

Cmp Nct

3 models

acestep-5Hz-lm-4B-GGUF

4B 8K ctx
Q3_K_L
1.75GB file 3.82GB
Q3_K_M
1.75GB file 3.82GB
Q3_K_S
1.75GB file 3.82GB
Q4_K_M
2.25GB file 4.32GB
Q4_K_S
2.25GB file 4.32GB
Q5_K_M
2.75GB file 4.82GB
Q5_K_S
2.75GB file 4.82GB
Q6_K
3.25GB file 5.32GB
Q8_0
4.25GB file 6.32GB
FP16
8GB file 10.07GB

Qwen3-14B-GGUF

14B 8K ctx
Q2_K
4.38GB file 6.61GB
Q2_K_L
4.38GB file 6.61GB
Q2_K_XL
4.38GB file 6.61GB
Q2_M
4.38GB file 6.61GB
Q2_XXS
4.38GB file 6.61GB
Q3_K_M
6.13GB file 8.36GB
Q3_K_S
6.13GB file 8.36GB
Q3_K_XL
6.13GB file 8.36GB
Q3_XXS
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q4_1
7.88GB file 10.11GB
Q4_K_M
7.88GB file 10.11GB
Q4_K_S
7.88GB file 10.11GB
Q4_K_XL
7.88GB file 10.11GB
Q4_NL
7.88GB file 10.11GB
Q4_XS
7.88GB file 10.11GB
Q5_K_M
9.63GB file 11.86GB
Q5_K_S
9.63GB file 11.86GB
Q5_K_XL
9.63GB file 11.86GB
Q6_K
11.38GB file 13.61GB
Q6_K_XL
11.38GB file 13.61GB
Q1_M
14GB file 16.23GB
Q1_S
14GB file 16.23GB
Q8_0
14.88GB file 17.11GB
Q8_K_XL
14.88GB file 17.11GB
BF16
28GB file 30.23GB

Qwen3-8B-GGUF

8B 8K ctx
Q2_K
2.5GB file 4.63GB
Q2_K_L
2.5GB file 4.63GB
Q2_K_XL
2.5GB file 4.63GB
Q2_M
2.5GB file 4.63GB
Q2_XXS
2.5GB file 4.63GB
Q3_K_M
3.5GB file 5.63GB
Q3_K_S
3.5GB file 5.63GB
Q3_K_XL
3.5GB file 5.63GB
Q3_XXS
3.5GB file 5.63GB
Q4_1
4.5GB file 6.63GB
Q4_K_M
4.5GB file 6.63GB
Q4_K_S
4.5GB file 6.63GB
Q4_K_XL
4.5GB file 6.63GB
Q4_NL
4.5GB file 6.63GB
Q4_XS
4.5GB file 6.63GB
Q5_K_M
5.5GB file 7.63GB
Q5_K_S
5.5GB file 7.63GB
Q5_K_XL
5.5GB file 7.63GB
Q6_K
6.5GB file 8.63GB
Q6_K_XL
6.5GB file 8.63GB
Q1_M
8GB file 10.13GB
Q1_S
8GB file 10.13GB
Q8_0
8.5GB file 10.63GB
Q8_K_XL
8.5GB file 10.63GB
BF16
16GB file 18.13GB
C

Cnatale

1 models

Mistral-7B-Instruct-v0.1-Txt-2-Presto-SQL-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
C

Cnmoro

1 models

Qwen2.5-0.5B-Rag-Thinking-Q8_0-GGUF

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB
C

Co N De Nse A I

3 models

Claude4.6-Qwen3-1.7B-CoNDeNse-GGUF

1.7B 8K ctx
Q2_K
0.53GB file 2.56GB
Q3_K_M
0.74GB file 2.77GB
Q4_K_M
0.96GB file 2.99GB
Q5_K_M
1.17GB file 3.2GB
Q6_K
1.38GB file 3.41GB

GLM-5.1-Qwen3-0.6B-CoNDeNse-GGUF

0.6B 8K ctx
Q2_K
0.19GB file 2.2GB
Q3_K_M
0.26GB file 2.27GB
Q4_K_M
0.34GB file 2.35GB
Q5_K_M
0.41GB file 2.42GB
Q6_K
0.49GB file 2.5GB

GLM-5.1-Qwen3-1.7B-CoNDeNse-GGUF

1.7B 8K ctx
Q5_K_M
1.17GB file 3.2GB
C

Cobra6789

1 models

QwQ-32B-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB
C

Cobrakenji

12 models

granite-20b-code-base-GGUF

20B 8K ctx
Q4_K_M
11.25GB file 13.58GB

granite-20b-code-base-Q3_K_M-GGUF

20B 8K ctx
Q3_K_M
8.75GB file 11.08GB

granite-20b-code-instruct-Q2_K-GGUF

20B 8K ctx
Q2_0
6.25GB file 8.58GB
FP16
40GB file 42.33GB

granite-20b-code-instruct-Q5_K_M-GGUF

20B 8K ctx
Q5_0
13.75GB file 16.08GB
Q5_K_M
13.75GB file 16.08GB

granite-3.1-8b-instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

granite-3.2-8b-instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

granite-3.3-8b-instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

granite-34b-code-base-Q2_K-GGUF

34B 8K ctx
Q2_K
10.63GB file 13.19GB

granite-34b-code-instruct-Q4_K_M-GGUF

34B 8K ctx
Q4_0
19.13GB file 21.69GB
Q4_K_M
19.13GB file 21.69GB

granite-3b-code-base-Q5_K_M-GGUF

3B 8K ctx
Q5_K_M
2.06GB file 4.11GB

granite-8b-code-instruct-Q3_K_M-GGUF

8B 8K ctx
Q3_K_M
3.5GB file 5.63GB

granite-8b-code-instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB