All Supported Models

29681 AI models · 198875 quantization formats tracked

C

Cpellens

2 models

granite-8b-code-instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB

wavecoder-ultra-6.7b-Q4_K_M-GGUF

6.7B 8K ctx
Q4_K_M
3.77GB file 5.88GB
C

Cphan Intersystems

2 models

Qwen2.5-32B-Instruct-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB
C

Cpiuk

1 models

htech_compliance

Unknown 8K ctx
Q4_K_M
0GB file 2GB
C

Cptnemo Pata

1 models

Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB
C

Cr0N3

1 models

h0l0-3.4.2-13b-uncen

13B 8K ctx
Q2_K
4.06GB file 6.27GB
Q3_XS
5.69GB file 7.9GB
Q3_K
5.69GB file 7.9GB
Q3_S
5.69GB file 7.9GB
Q3_M
5.69GB file 7.9GB
Q3_K_S
5.69GB file 7.9GB
Q3_K_M
5.69GB file 7.9GB
Q3_K_L
5.69GB file 7.9GB
Q4_XS
7.31GB file 9.52GB
Q4_NL
7.31GB file 9.52GB
C

Crackrammer

1 models

PrismGuard-Qwen3.5-0.8B-GGUF

0.8B 8K ctx
Q8_0
0.85GB file 2.86GB
C

Cran May

34 models

B-and-W_Flycatcher-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

blossom-v3_1-baichuan2-13b-Q4_K_M-GGUF

13B 8K ctx
Q4_0
7.31GB file 9.52GB
FP16
26GB file 28.21GB

Gemma-2-9B-Chinese-Chat-IQ4_XS-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

Gemma-2-9B-Chinese-Chat-Q4_K_M-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

ghost-8b-beta-1608-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

granite-3.2-8b-instruct-preview-IQ4_NL-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

internlm2_5-7b-chat-IQ4_XS-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

internlm2_5-7b-chat-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Lamarck-14B-v0.7-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Llama-3.1-8B-Reason-Blend-888k-Q5_K_M-GGUF

8B 8K ctx
Q5_0
5.5GB file 7.63GB
FP16
16GB file 18.13GB

Llama-3.1-Tulu-3.1-8B-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

NQLSG-Qwen2.5-14B-MegaFusion-v5-roleplay-duplicate-Q3_K_S-GGUF

14B 8K ctx
Q3_0
6.13GB file 8.36GB
FP16
28GB file 30.23GB

openbuddy-llama3-8b-v21.1-8k-Q4_K_S-GGUF

8B 8K ctx
Q4_K_S
4.5GB file 6.63GB

openbuddy-llama3.1-8b-v22.2-131k-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

openbuddy-llama3.1-8b-v22.3-131k-IQ4_XS-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

openbuddy-llama3.1-8b-v22.3-131k-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

openbuddy-llama3.1-8b-v22.3-131k-Q4_K_S-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB

openbuddy-llama3.2-3b-v23.2-131k-Q5_K_M-GGUF

3B 8K ctx
Q5_0
2.06GB file 4.11GB
FP16
6GB file 8.05GB

openbuddy-mistral-22b-v21.1-32k-Q4_K_M-GGUF

22B 8K ctx
Q4_0
12.38GB file 14.74GB
Q4_K_M
12.38GB file 14.74GB

openbuddy-mistral-22b-v21.1-32k-Q4_K_S-GGUF

22B 8K ctx
Q4_K_S
12.38GB file 14.74GB

openbuddy-mistral-7b-v13.1-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

openbuddy-mistral2-7b-v20.2-32k-Q4_K_M-GGUF

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB

openbuddy-openllama-7b-v12-bf16-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB

openbuddy-openllama-7b-v5-fp16-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB

openbuddy-yi1.5-9b-v21.1-32k-Q4_K_S-GGUF

9B 8K ctx
Q4_0
5.06GB file 7.21GB
FP16
18GB file 20.15GB

Phi-3.5-mini-instruct-Q5_K_M-GGUF

3.8B 8K ctx
Q5_0
2.61GB file 4.67GB
FP16
7.6GB file 9.66GB

RA_Reasoner-Q5_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q5_0
0GB file 2GB

SLIDE-v2-Q2_K-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

SLIDE-v2-Q4_K_M-GGUF

Unknown 8K ctx
Q4_K_M
0GB file 2GB

SLIDE-v2-Q4_K_S-GGUF

Unknown 8K ctx
Q4_K_S
0GB file 2GB

SmolLM2-360M-Grpo-r999-Q5_K_M-GGUF

Unknown 8K ctx
Q5_0
0GB file 2GB
FP16
0GB file 2GB

T.E-8.1-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

UwU-7B-Instruct-abliterated-Q5_K_M-GGUF

7B 8K ctx
Q5_0
4.81GB file 6.92GB
FP16
14GB file 16.11GB

Viper-Coder-HybridMini-v1.3-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
C

Crane A I Labs

2 models

ganda-gemma-1b-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q8_0
1.06GB file 3.08GB

swahili-gemma-1b-GGUF

1B 8K ctx
Q2_0
0.31GB file 2.33GB
Q3_0
0.44GB file 2.46GB
Q4_0
0.56GB file 2.58GB
Q5_0
0.69GB file 2.71GB
Q8_0
1.06GB file 3.08GB
C

Crassusad44

1 models

nb-notram-llama-3.2-3b-instruct-Q8_0-GGUF

3B 8K ctx
Q8_0
3.19GB file 5.24GB
C

Creed Space

1 models

granite-guardian-3.0-2b-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
Q8_0
2.13GB file 4.16GB